Efficient Table Pre-training without Real Data: An Introduction to TAPEX
TAPEX, a table pre-training method that learns a neural SQL executor using synthetic SQL queries and execution results, achieving state-of-the-art results on table question answering and fact verification benchmarks.