Data and Environment Curation for Post-Training LLMs — Mahesh Sathiamoorthy, Bespoke Labs
Post-training gains depend heavily on task selection, rollout quality, and environment design. For many enterprise agents, curated SFT may deliver most of the value before costly RL.
Bespoke’s curation recipe selects source prompts, mixes and filters them, generates teacher answers, then filters again. Across its work, **multiple answers per question** helped, while the strongest model was not always the best teacher.
Treat data recipes and environments as versioned engineering assets. Start with **SFT** for the required behavior, run ablations at each curation stage, and reserve **RL** for gains that justify its added compute and infrastructure.
Bespoke’s curation recipe selects source prompts, mixes and filters them, generates teacher answers, then filters again. Across its work, **multiple answers per question** helped, while the strongest model was not always the best teacher. Treat data recipes and environments as versioned engineering assets. Start with **SFT** for the required behavior, run ablations at each curation stage, and reserve **RL** for gains that justify its added compute and infrastructure. Synthetic rewriting and task augmentation did not reliably help in the reported agent work. Production datasets can also be imbalanced, so fine-tuning may amplify rare-looking attributes unless the mix and outputs are checked carefully.
This turns post-training data and environments into versioned, ablated engineering systems rather than assuming more synthetic data, a stronger teacher, or RL will improve agents. Against the candidates’ emphasis on runtime harnesses and controls, it adds an upstream reliability constraint: prompt mix, answer diversity, filtering, and production imbalance can determine whether those systems receive useful behavior at all.