AutoSynthData generates targeted training data for enterprise agents from failures
Original titleAutoSynthData: Generating Training Data for Enterprise Agents
AISummary
ServiceNow CoreAI introduced AutoSynthData, which uses a target model's failures and a stronger teacher's successes to generate and validate new agent training tasks.
In EnterpriseOps Gym experiments, the Hybrid domain produced 2,000 samples and raised Gemma-4-26B-A4B-it mean Pass@1 by 7.2 percentage points, while the ITSM domain produced 1,994 samples and raised it from 18.77% to 27.18%.
AIWhy it matters
The post shows how failure analysis, teacher demonstrations, and verifier checks combine into a repeatable pipeline for generating targeted agent training data.
Source: Hugging Face Blog · huggingface.co