English
Related papers

Related papers: Introducing LongCat-Flash-Thinking: A Technical Re…

200 papers

Reasoning in large language models (LLMs) tends to produce substantially longer token generation sequences than simpler language modeling tasks. This extended generation length reflects the multi-step, compositional nature of reasoning and…

Computation and Language · Computer Science 2025-04-24 Yash Akhauri , Anthony Fei , Chi-Chih Chang , Ahmed F. AbouElhamayed , Yueying Li , Mohamed S. Abdelfattah

The emergence of large reasoning models (LRMs) has transformed Natural Language Processing by excelling in complex tasks such as mathematical problem-solving and code generation. These models leverage chain-of-thought (CoT) processes,…

Computation and Language · Computer Science 2025-05-19 Wenrui Cai , Chengyu Wang , Junbing Yan , Jun Huang , Xiangzhong Fang

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

We introduce MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model. MiniMax-M1 is powered by a hybrid Mixture-of-Experts (MoE) architecture combined with a lightning attention mechanism. The model is…

Computation and Language · Computer Science 2025-06-17 MiniMax , : , Aili Chen , Aonian Li , Bangwei Gong , Binyang Jiang , Bo Fei , Bo Yang , Boji Shan , Changqing Yu , Chao Wang , Cheng Zhu , Chengjun Xiao , Chengyu Du , Chi Zhang , Chu Qiao , Chunhao Zhang , Chunhui Du , Congchao Guo , Da Chen , Deming Ding , Dianjun Sun , Dong Li , Enwei Jiao , Haigang Zhou , Haimo Zhang , Han Ding , Haohai Sun , Haoyu Feng , Huaiguang Cai , Haichao Zhu , Jian Sun , Jiaqi Zhuang , Jiaren Cai , Jiayuan Song , Jin Zhu , Jingyang Li , Jinhao Tian , Jinli Liu , Junhao Xu , Junjie Yan , Junteng Liu , Junxian He , Kaiyi Feng , Ke Yang , Kecheng Xiao , Le Han , Leyang Wang , Lianfei Yu , Liheng Feng , Lin Li , Lin Zheng , Linge Du , Lingyu Yang , Lunbin Zeng , Minghui Yu , Mingliang Tao , Mingyuan Chi , Mozhi Zhang , Mujie Lin , Nan Hu , Nongyu Di , Peng Gao , Pengfei Li , Pengyu Zhao , Qibing Ren , Qidi Xu , Qile Li , Qin Wang , Rong Tian , Ruitao Leng , Shaoxiang Chen , Shaoyu Chen , Shengmin Shi , Shitong Weng , Shuchang Guan , Shuqi Yu , Sichen Li , Songquan Zhu , Tengfei Li , Tianchi Cai , Tianrun Liang , Weiyu Cheng , Weize Kong , Wenkai Li , Xiancai Chen , Xiangjun Song , Xiao Luo , Xiao Su , Xiaobo Li , Xiaodong Han , Xinzhu Hou , Xuan Lu , Xun Zou , Xuyang Shen , Yan Gong , Yan Ma , Yang Wang , Yiqi Shi , Yiran Zhong , Yonghong Duan , Yongxiang Fu , Yongyi Hu , Yu Gao , Yuanxiang Fan , Yufeng Yang , Yuhao Li , Yulin Hu , Yunan Huang , Yunji Li , Yunzhi Xu , Yuxin Mao , Yuxuan Shi , Yuze Wenren , Zehan Li , Zelin Li , Zhanxu Tian , Zhengmao Zhu , Zhenhua Fan , Zhenzhen Wu , Zhichao Xu , Zhihang Yu , Zhiheng Lyu , Zhuo Jiang , Zibo Gao , Zijia Wu , Zijian Song , Zijun Sun

Although large language model (LLM) based multi-agent systems (MAS) show their capability to solve complex tasks and achieve higher performance over single agent systems, they lead to huge computational overheads because of heavy…

Multiagent Systems · Computer Science 2026-05-29 Ziyang Ma , Dingyi Zhang , Sichu Liang , Jiajia Chu , Pengfei Xia , Hui Zang , Deyu Zhou

Chain-of-Thought (CoT) reasoning enhances the decision-making capabilities of vision-language-action models in autonomous driving, but its autoregressive nature introduces significant inference latency, making it impractical for real-time…

Robotics · Computer Science 2026-02-04 Yi Gu , Yan Wang , Yuxiao Chen , Yurong You , Wenjie Luo , Yue Wang , Wenhao Ding , Boyi Li , Heng Yang , Boris Ivanovic , Marco Pavone

Reinforcement learning (RL) has become a critical paradigm for LLM post-training, yet the rollout phase -- accounting for 50--80% of total step time -- is bottlenecked by skewed generation: long-tailed trajectories indispensable for model…

This technical report presents Ring-Lite-Distill, a lightweight reasoning model derived from our open-source Mixture-of-Experts (MoE) Large Language Models (LLMs) Ling-Lite. This study demonstrates that through meticulous high-quality data…

Recent frontier models employ long chain-of-thought reasoning to explore solution spaces in context and achieve stonger performance. While many works study distillation to build smaller yet capable models, most focus on English and little…

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Reasoning models have demonstrated remarkable progress in solving complex and logic-intensive tasks by generating extended Chain-of-Thoughts (CoTs) prior to arriving at a final answer. Yet, the emergence of this "slow-thinking" paradigm,…

Computation and Language · Computer Science 2025-09-30 Sicheng Feng , Gongfan Fang , Xinyin Ma , Xinchao Wang

Accurate short-term mobile traffic prediction is important for proactive resource allocation and low-latency network management in fifth generation (5G) and sixth generation (6G). While large language models (LLMs) can perform in-context…

Networking and Internet Architecture · Computer Science 2026-05-12 MohammadMahdi Ghadaksaz , Mohammad Farzanullah , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting, which elicits step-by-step problem solving, but often at the cost of excessive verbosity in intermediate…

Computation and Language · Computer Science 2025-10-27 Simon A. Aytes , Jinheon Baek , Sung Ju Hwang

While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising capabilities in end to end autonomous driving. However, recent efforts to integrate CoT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuechen Luo , Fang Li , Shaoqing Xu , Zhiyi Lai , Lei Yang , Qimao Chen , Ziang Luo , Zixun Xie , Shengyin Jiang , Jiaxin Liu , Long Chen , Bing Wang , Zhi-xin Yang

Current long chain-of-thought (long-CoT) models excel at mathematical reasoning but rely on slow and error-prone natural language traces. Tool-augmented agents address arithmetic via code execution, but often falter on complex logical…

Computation and Language · Computer Science 2025-09-03 Weihua Du , Pranjal Aggarwal , Sean Welleck , Yiming Yang

Solving mathematical problems using computer-verifiable languages like Lean has significantly impacted the mathematical and computer science communities. State-of-the-art methods utilize a single Large Language Model (LLM) to generate…

Computation and Language · Computer Science 2025-05-28 Ruida Wang , Rui Pan , Yuxin Li , Jipeng Zhang , Yizhen Jia , Shizhe Diao , Renjie Pi , Junjie Hu , Tong Zhang

Large Reasoning Models (LRMs) have shown promising accuracy improvements on complex problem-solving tasks. While these models have attained high accuracy by leveraging additional computation at test time, they need to generate long…

Computation and Language · Computer Science 2025-12-16 Coleman Hooper , Sebastian Zhao , Luca Manolache , Sehoon Kim , Michael W. Mahoney , Yakun Sophia Shao , Kurt Keutzer , Amir Gholami

The Chain-of-Thought (CoT) paradigm has emerged as a critical approach for enhancing the reasoning capabilities of large language models (LLMs). However, despite their widespread adoption and success, CoT methods often exhibit instability…

Artificial Intelligence · Computer Science 2024-09-06 Yu Wang , Shiwan Zhao , Zhihu Wang , Heyuan Huang , Ming Fan , Yubo Zhang , Zhixing Wang , Haijun Wang , Ting Liu

Explicit chain-of-thought (CoT) reasoning substantially improves the reasoning ability of large language models (LLMs), but incurs high inference cost due to lengthy autoregressive traces. Existing latent reasoning methods offer a promising…

Computation and Language · Computer Science 2026-05-26 Hui Xie , Jie Liu , Ziyue Qiao , Joaquin Vanschore

Large language models (LLMs) have shown impressive emergent abilities in a wide range of tasks, but the associated expensive API cost greatly limits the real application. Previous works like chain-of-thought (CoT) and tree-of-thoughts (ToT)…

Computation and Language · Computer Science 2024-08-27 Yu Shang , Yu Li , Fengli Xu , Yong Li