English

Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

Computation and Language 2026-07-01 v1

Abstract

Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model's English reasoning ability to target languages. However, existing transfer approaches typically rely on distilled target-language reasoning traces from stronger LRMs or online supervision from external judge models, which are costly and difficult to scale. In this paper, we propose PCS (Progressive Code-Switching), a more efficient transfer framework that requires only lightweight translation without any stronger model for distillation or judging. PCS first constructs code-switched reasoning traces by translating a subset of English reasoning steps into the target language, and uses them to initialize the model's code-switching ability via supervised fine-tuning. It then applies reinforcement learning with a step-level language consistency curriculum, progressively raising the target-language ratio until the model reasons entirely in the target language. This progressive design provides a smooth transfer path that avoids the instability and performance degradation commonly observed when directly enforcing target-language reasoning. Experiments on multiple benchmarks and five typologically diverse languages show that PCS substantially narrows the performance gap between target-language and English reasoning, yielding more language-consistent reasoning while maintaining competitive accuracy.

Cite

@article{arxiv.2607.00485,
  title  = {Efficient Multilingual Reasoning Transfer via Progressive Code-Switching},
  author = {Zhijun Wang and Junxiao Liu and Hao Zhou and Hao-Ran Wei and Baosong Yang and Shujian Huang},
  journal= {arXiv preprint arXiv:2607.00485},
  year   = {2026}
}