Together AI· Inference platformStory of the weekResearch paper

DSGym: A holistic framework for evaluating and training data science agents

Together AI introduces DSGym, a unified framework for evaluating and training data science agents. It integrates existing benchmarks and adds novel scientific analysis tasks (DSBio, 90 bioinformatics tasks) and Kaggle competitions (DSPredict, 92 competitions). Using DSGym, the team trained a 4B model (Qwen3-4B-DSGym-SFT-2k) on 2,000 synthetic query-trajectory pairs, achieving state-of-the-art performance among open-source models on general data science benchmarks.

From the source

We address these limitations by introducing DSGym, an integrated framework for evaluating and training data science agents in self-contained execution environments. Using DSGym, we trained a state-of-the-art open-source data science agent.

together.ai