Apple Intelligence Foundation Language Models: Tech Report 2025
Machine Learning
2025-08-28 v3 Artificial Intelligence
Abstract
We introduce two multilingual, multimodal foundation language models that power Apple Intelligence features across Apple devices and services: i a 3B-parameter on-device model optimized for Apple silicon through architectural innovations such as KV-cache sharing and 2-bit quantization-aware training; and ii a scalable server model built on a novel Parallel-Track Mixture-of-Experts PT-MoE transformer that combines track parallelism, mixture-of-experts sparse computation, and interleaved global-local attention to deliver high quality with competitive cost on Apple's Private Cloud Compute platform. Both models are trained on large-scale multilingual and multimodal datasets sourced via responsible web crawling, licensed corpora, and high-quality synthetic data, then further refined with supervised fine-tuning and reinforcement learning on a new asynchronous platform. The resulting models support several additional languages while understanding images and executing tool calls. In public benchmarks and human evaluations, both the server model and the on-device model match or surpass comparably sized open baselines. A new Swift-centric Foundation Models framework exposes guided generation, constrained tool calling, and LoRA adapter fine-tuning, allowing developers to integrate these capabilities with a few lines of code. The latest advancements in Apple Intelligence models are grounded in our Responsible AI approach with safeguards like content filtering and locale-specific evaluation, as well as our commitment to protecting our users' privacy with innovations like Private Cloud Compute.
Keywords
Cite
@article{arxiv.2507.13575,
title = {Apple Intelligence Foundation Language Models: Tech Report 2025},
author = {Ethan Li and Anders Boesen Lindbo Larsen and Chen Zhang and Xiyou Zhou and Jun Qin and Dian Ang Yap and Narendran Raghavan and Xuankai Chang and Margit Bowler and Eray Yildiz and John Peebles and Hannah Gillis Coleman and Matteo Ronchi and Peter Gray and Keen You and Anthony Spalvieri-Kruse and Ruoming Pang and Reed Li and Yuli Yang and Emad Soroush and Zhiyun Lu and Crystal Xiao and Rong Situ and Jordan Huffaker and David Griffiths and Zaid Ahmed and Peng Zhang and Daniel Parilla and Asaf Liberman and Jennifer Mallalieu and Parsa Mazaheri and Qibin Chen and Manjot Bilkhu and Aonan Zhang and Eric Wang and Dave Nelson and Michael FitzMaurice and Thomas Voice and Jeremy Liu and Josh Shaffer and Shiwen Zhao and Prasanth Yadla and Farzin Rasteh and Pengsheng Guo and Arsalan Farooq and Jeremy Snow and Stephen Murphy and Tao Lei and Minsik Cho and George Horrell and Sam Dodge and Lindsay Hislop and Sumeet Singh and Alex Dombrowski and Aiswarya Raghavan and Sasha Sirovica and Mandana Saebi and Faye Lao and Max Lam and TJ Lu and Zhaoyang Xu and Karanjeet Singh and Marc Kirchner and David Mizrahi and Rajat Arora and Haotian Zhang and Henry Mason and Lawrence Zhou and Yi Hua and Ankur Jain and Felix Bai and Joseph Astrauskas and Floris Weers and Josh Gardner and Mira Chiang and Yi Zhang and Pulkit Agrawal and Tony Sun and Quentin Keunebroek and Matthew Hopkins and Bugu Wu and Tao Jia and Chen Chen and Xingyu Zhou and Nanzhu Wang and Peng Liu and Ruixuan Hou and Rene Rauch and Yuan Gao and Afshin Dehghan and Jonathan Janke and Zirui Wang and Cha Chen and Xiaoyi Ren and Feng Nan and Josh Elman and Dong Yin and Yusuf Goren and Jeff Lai and Yiran Fei and Syd Evans and Muyang Yu and Guoli Yin and Yi Qin and Erin Feldman and Isha Garg and Aparna Rajamani and Karla Vega and Walker Cheng and TJ Collins and Hans Han and Raul Rea Menacho and Simon Yeung and Sophy Lee and Phani Mutyala and Ying-Chang Cheng and Zhe Gan and Sprite Chu and Justin Lazarow and Alessandro Pappalardo and Federico Scozzafava and Jing Lu and Erik Daxberger and Laurent Duchesne and Jen Liu and David Güera and Stefano Ligas and Mary Beth Kery and Brent Ramerth and Ciro Sannino and Marcin Eichner and Haoshuo Huang and Rui Qian and Moritz Schwarzer-Becker and David Riazati and Mingfei Gao and Bailin Wang and Jack Cackler and Yang Lu and Ransen Niu and John Dennison and Guillaume Klein and Jeffrey Bigham and Deepak Gopinath and Navid Shiee and Darren Botten and Guillaume Tartavel and Alex Guillen Garcia and Sam Xu and Victoria MönchJuan Haladjian and Zi-Yi Dou and Matthias Paulik and Adolfo Lopez Mendez and Zhen Li and Hong-You Chen and Chao Jia and Dhaval Doshi and Zhengdong Zhang and Raunak Manjani and Aaron Franklin and Zhile Ren and David Chen and Artsiom Peshko and Nandhitha Raghuram and Hans Hao and Jiulong Shan and Kavya Nerella and Ramsey Tantawi and Vivek Kumar and Saiwen Wang and Brycen Wershing and Bhuwan Dhingra and Dhruti Shah and Ob Adaranijo and Xin Zheng and Tait Madsen and Hadas Kotek and Chang Liu and Yin Xia and Hanli Li and Suma Jayaram and Yanchao Sun and Ahmed Fakhry and Vasileios Saveris and Dustin Withers and Yanghao Li and Alp Aygar and Andres Romero Mier Y Teran and Kaiwei Huang and Mark Lee and Xiujun Li and Yuhong Li and Tyler Johnson and Jay Tang and Joseph Yitan Cheng and Futang Peng and Andrew Walkingshaw and Lucas Guibert and Abhishek Sharma and Cheng Shen and Piotr Maj and Yasutaka Tanaka and You-Cyuan Jhang and Vivian Ma and Tommi Vehvilainen and Kelvin Zou and Jeff Nichols and Matthew Lei and David Qiu and Yihao Qian and Gokul Santhanam and Wentao Wu and Yena Han and Dominik Moritz and Haijing Fu and Mingze Xu and Vivek Rathod and Jian Liu and Louis D'hauwe and Qin Ba and Haitian Sun and Haoran Yan and Philipp Dufter and Anh Nguyen and Yihao Feng and Emma Wang and Keyu He and Rahul Nair and Sanskruti Shah and Jiarui Lu and Patrick Sonnenberg and Jeremy Warner and Yuanzhi Li and Bowen Pan and Ziyi Zhong and Joe Zhou and Sam Davarnia and Olli Saarikivi and Irina Belousova and Rachel Burger and Shang-Chen Wu and Di Feng and Bas Straathof and James Chou and Yuanyang Zhang and Marco Zuliani and Eduardo Jimenez and Abhishek Sundararajan and Xianzhi Du and Chang Lan and Nilesh Shahdadpuri and Peter Grasch and Sergiu Sima and Josh Newnham and Varsha Paidi and Jianyu Wang and Kaelen Haag and Alex Braunstein and Daniele Molinari and Richard Wei and Brenda Yang and Nicholas Lusskin and Joanna Arreaza-Taylor and Meng Cao and Nicholas Seidl and Simon Wang and Jiaming Hu and Yiping Ma and Mengyu Li and Kieran Liu and Hang Su and Sachin Ravi and Chong Wang and Xin Wang and Kevin Smith and Haoxuan You and Binazir Karimzadeh and Rui Li and Jinhao Lei and Wei Fang and Alec Doane and Sam Wiseman and Ismael Fernandez and Jane Li and Andrew Hansen and Javier Movellan and Christopher Neubauer and Hanzhi Zhou and Chris Chaney and Nazir Kamaldin and Valentin Wolf and Fernando Bermúdez-Medina and Joris Pelemans and Peter Fu and Howard Xing and Xiang Kong and Wayne Shan and Gabriel Jacoby-Cooper and Dongcai Shen and Tom Gunter and Guillaume Seguin and Fangping Shi and Shiyu Li and Yang Xu and Areeba Kamal and Dan Masi and Saptarshi Guha and Qi Zhu and Jenna Thibodeau and Changyuan Zhang and Rebecca Callahan and Charles Maalouf and Wilson Tsao and Boyue Li and Qingqing Cao and Naomy Sabo and Cheng Leong and Yi Wang and Anupama Mann Anupama and Colorado Reed and Kenneth Jung and Zhifeng Chen and Mohana Prasad Sathya Moorthy and Yifei He and Erik Hornberger and Devi Krishna and Senyu Tong and Michael and Lee and David Haldimann and Yang Zhao and Bowen Zhang and Chang Gao and Chris Bartels and Sushma Rao and Nathalie Tran and Simon Lehnerer and Co Giang and Patrick Dong and Junting Pan and Biyao Wang and Dongxu Li and Mehrdad Farajtabar and Dongseong Hwang and Grace Duanmu and Eshan Verma and Sujeeth Reddy and Qi Shan and Hongbin Gao and Nan Du and Pragnya Sridhar and Forrest Huang and Yingbo Wang and Nikhil Bhendawade and Diane Zhu and Sai Aitharaju and Fred Hohman and Lauren Gardiner and Chung-Cheng Chiu and Yinfei Yang and Alper Kokmen and Frank Chu and Ke Ye and Kaan Elgin and Oron Levy and John Park and Donald Zhang and Eldon Schoop and Nina Wenzel and Michael Booker and Hyunjik Kim and Chinguun Erdenebileg and Nan Dun and Eric Liang Yang and Priyal Chhatrapati and Vishaal Mahtani and Haiming Gang and Kohen Chia and Deepa Seshadri and Donghan Yu and Yan Meng and Kelsey Peterson and Zhen Yang and Yongqiang Wang and Carina Peng and Doug Kang and Anuva Agarwal and Albert Antony and Juan Lao Tebar and Albin Madappally Jose and Regan Poston and Andy De Wang and Gerard Casamayor and Elmira Amirloo and Violet Yao and Wojciech Kryscinski and Kun Duan and Lezhi L},
journal= {arXiv preprint arXiv:2507.13575},
year = {2025}
}