Devstral: 面向编码智能体应用微调语言模型
软件工程
2025-10-01 v1 人工智能
摘要
我们介绍了 Devstral-Small，一个用于代码智能体的轻量级开源模型，在 100B 规模以下的模型中具有最佳性能。在本技术报告中，我们概述了如何设计和开发模型，并在智能体软件开发中打造专门化能力。最终得到的模型 Devstral-Small 是一个小型 24B 模型，服务速度快且易于部署。尽管规模较小，Devstral-Small 与比其大一个数量级以上的模型相比，仍取得了具有竞争力的性能。
引用
@article{arxiv.2509.25193,
title = {Devstral: Fine-tuning Language Models for Coding Agent Applications},
author = {Abhinav Rastogi and Adam Yang and Albert Q. Jiang and Alexander H. Liu and Alexandre Sablayrolles and Amélie Héliou and Amélie Martin and Anmol Agarwal and Andy Ehrenberg and Andy Lo and Antoine Roux and Arthur Darcet and Arthur Mensch and Baptiste Bout and Baptiste Rozière and Baudouin De Monicault and Chris Bamford and Christian Wallenwein and Christophe Renaudin and Clémence Lanfranchi and Clément Denoix and Corentin Barreau and Darius Dabert Devon Mizelle and Diego de las Casas and Elliot Chane-Sane and Emilien Fugier and Emma Bou Hanna and Gabrielle Berrada and Gauthier Delerce and Gauthier Guinet and Georgii Novikov and Graham Neubig and Guillaume Lample and Guillaume Martin and Himanshu Jaju and Jan Ludziejewski and Jason Rute and Jean-Malo Delignon and JeanHadrien Chabran and Joachim Studnia and Joep Barmentlo and Jonas Amar and Josselin Somerville Roberts and Julien Denize and Karan Saxena and Karmesh Yadav and Kartik Khandelwal and Khyathi Raghavi Chandu and Kush Jain and Lélio Renard Lavaud and Léonard Blier and Lingxiao Zhao and Louis Martin and Lucile Saulnier and Luyu Gao and Marie Pellat and Mathilde Guillaumin and Mathis Felardos and Matthieu Dinot and Maxime Darrin and Maximilian Augustin and Mickaël Seznec and Neha Gupta and Nikhil Raghuraman and Olivier Duchenne and Patricia Wang and Patrick von Platen and Patryk Saffer and Paul Jacob and Paul Wambergue and Paula Kurylowicz and Philomène Chagniot and Pierre Stock and Pravesh Agrawal and Rémi Delacourt and Roman Soletskyi and Romain Sauvestre and Sagar Vaze and Sanchit Gandhi and Sandeep Subramanian and Shashwat Dalal and Siddharth Gandhi and Soham Ghosh and Srijan Mishra and Sumukh Aithal and Szymon Antoniak and Teven Le Scao and Thibaut Lavril and Thibault Schueller and Thomas Foubert and Thomas Robert and Thomas Wang and Timothée Lacroix and Tom Bewley and Valeriia Nemychnikova and Victor Paltz and Virgile Richard and Wen-Ding Li and William Marshall and Xingyao Wang and Xuanyu Zhang and Yihan Wan and Yunhao Tang},
journal= {arXiv preprint arXiv:2509.25193},
year = {2025}
}