Ministral 3
计算与语言
2026-01-14 v1
摘要
我们介绍了 Ministral 3 系列，这是一族专为计算与内存受限应用设计的参数高效稠密语言模型，提供三种模型规模：3B、8B 和 14B 参数。针对每种模型规模，我们发布了三个变体：用于通用目的的预训练基础模型、指令微调模型，以及用于复杂问题求解的推理模型。此外，我们提出了通过级联蒸馏推导 Ministral 3 模型的方法，这是一种迭代剪裁与结合蒸馏的持续训练技术。每个模型均具备图像理解能力，且均在 Apache 2.0 许可证下发布。
引用
@article{arxiv.2601.08584,
title = {Ministral 3},
author = {Alexander H. Liu and Kartik Khandelwal and Sandeep Subramanian and Victor Jouault and Abhinav Rastogi and Adrien Sadé and Alan Jeffares and Albert Jiang and Alexandre Cahill and Alexandre Gavaudan and Alexandre Sablayrolles and Amélie Héliou and Amos You and Andy Ehrenberg and Andy Lo and Anton Eliseev and Antonia Calvi and Avinash Sooriyarachchi and Baptiste Bout and Baptiste Rozière and Baudouin De Monicault and Clémence Lanfranchi and Corentin Barreau and Cyprien Courtot and Daniele Grattarola and Darius Dabert and Diego de las Casas and Elliot Chane-Sane and Faruk Ahmed and Gabrielle Berrada and Gaëtan Ecrepont and Gauthier Guinet and Georgii Novikov and Guillaume Kunsch and Guillaume Lample and Guillaume Martin and Gunshi Gupta and Jan Ludziejewski and Jason Rute and Joachim Studnia and Jonas Amar and Joséphine Delas and Josselin Somerville Roberts and Karmesh Yadav and Khyathi Chandu and Kush Jain and Laurence Aitchison and Laurent Fainsin and Léonard Blier and Lingxiao Zhao and Louis Martin and Lucile Saulnier and Luyu Gao and Maarten Buyl and Margaret Jennings and Marie Pellat and Mark Prins and Mathieu Poirée and Mathilde Guillaumin and Matthieu Dinot and Matthieu Futeral and Maxime Darrin and Maximilian Augustin and Mia Chiquier and Michel Schimpf and Nathan Grinsztajn and Neha Gupta and Nikhil Raghuraman and Olivier Bousquet and Olivier Duchenne and Patricia Wang and Patrick von Platen and Paul Jacob and Paul Wambergue and Paula Kurylowicz and Pavankumar Reddy Muddireddy and Philomène Chagniot and Pierre Stock and Pravesh Agrawal and Quentin Torroba and Romain Sauvestre and Roman Soletskyi and Rupert Menneer and Sagar Vaze and Samuel Barry and Sanchit Gandhi and Siddhant Waghjale and Siddharth Gandhi and Soham Ghosh and Srijan Mishra and Sumukh Aithal and Szymon Antoniak and Teven Le Scao and Théo Cachet and Theo Simon Sorg and Thibaut Lavril and Thiziri Nait Saada and Thomas Chabal and Thomas Foubert and Thomas Robert and Thomas Wang and Tim Lawson and Tom Bewley and Tom Bewley and Tom Edwards and Umar Jamil and Umberto Tomasini and Valeriia Nemychnikova and Van Phung and Vincent Maladière and Virgile Richard and Wassim Bouaziz and Wen-Ding Li and William Marshall and Xinghui Li and Xinyu Yang and Yassine El Ouahidi and Yihan Wang and Yunhao Tang and Zaccharie Ramzi},
journal= {arXiv preprint arXiv:2601.08584},
year = {2026}
}
备注
Release page: https://mistral.ai/news/mistral-3 ; Models available at https://huggingface.co/collections/mistralai/ministral-3