From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
AutoSynthData: Generating Training Data for Enterprise Agents
Turning model failures into training data for enterprise agents
ServiceNow CoreAI introduces AutoSynthData, a pipeline that identifies capability gaps in a target model by evaluating it in an enterprise environment, then generates and validates new training tasks that exercise those weaknesses.
The system uses a stronger teacher model to characterize successful behavior and produces tasks that are feasible, realistic, and difficult for the current model.
The approach is illustrated with the EnterpriseOps Gym environment and a released dataset.
From the source
At ServiceNow CoreAI, we built AutoSynthData to turn those capability gaps into training data. It uses a target model's failures and a stronger teacher's successes to decide what the model should learn next, then generates and validates new tasks that exercise those capabilities.
huggingface.co