English
Related papers

Related papers: LongCat-Flash-Thinking-2601 Technical Report

200 papers

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

Machine Learning · Computer Science 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao

A practical approach to activate long chain-of-thoughts reasoning ability in pre-trained large language models is to perform supervised fine-tuning on instruction datasets synthesized by strong Large Reasoning Models such as DeepSeek-R1,…

Computation and Language · Computer Science 2025-12-24 Cehao Yang , Xueyuan Lin , Xiaojun Wu , Chengjin Xu , Xuhui Jiang , Honghao Liu , Hui Xiong , Jian Guo

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…

As a model-agnostic approach to long context modeling, multi-agent systems can process inputs longer than a large language model's context window without retraining or architectural modifications. However, their performance often heavily…

Machine Learning · Computer Science 2025-09-29 Taejong Joo , Shu Ishida , Ivan Sosnovik , Bryan Lim , Sahand Rezaei-Shoshtari , Adam Gaier , Robert Giaquinto

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

Artificial Intelligence · Computer Science 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

Traditional agentic workflows rely on external prompts to manage interactions with tools and the environment, which limits the autonomy of reasoning models. We position \emph{Large Agent Models (LAMs)} that internalize the generation of…

Artificial Intelligence · Computer Science 2025-03-11 Yuxiang Zhang , Yuqi Yang , Jiangming Shu , Xinyan Wen , Jitao Sang

The current remote sensing image analysis task is increasingly evolving from traditional object recognition to complex intelligence reasoning, which places higher requirements on the model's reasoning ability and the flexibility of tool…

Artificial Intelligence · Computer Science 2025-12-04 Chujie Wang , Zhiyuan Luo , Ruiqi Liu , Can Ran , Shenghua Fan , Xi Chen , Chu He

Recently, models such as OpenAI-o1 and DeepSeek-R1 have demonstrated remarkable performance on complex reasoning tasks through Long Chain-of-Thought (Long-CoT) reasoning. Although distilling this capability into student models significantly…

Computation and Language · Computer Science 2025-05-26 Yao Xu , Mingyu Xu , Fangyu Lei , Wangtao Sun , Xiangrong Zeng , Bingning Wang , Guang Liu , Shizhu He , Jun Zhao , Kang Liu

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks when equipped with external tools. However, current frameworks predominantly rely on sequential processing, leading to inefficient execution…

We present Ring-lite, a Mixture-of-Experts (MoE)-based large language model optimized via reinforcement learning (RL) to achieve efficient and robust reasoning capabilities. Built upon the publicly available Ling-lite model, a 16.8 billion…

Mixture of Experts (MoE) models with conditional execution of sparsely activated layers have enabled training models with a much larger number of parameters. As a result, these models have achieved significantly better quality on various…

Computation and Language · Computer Science 2022-11-21 Young Jin Kim , Rawn Henry , Raffy Fahim , Hany Hassan Awadalla

Frontier AI models and multi-agent systems have led to significant improvements in mathematical reasoning. However, for problems requiring extended, long-horizon reasoning, existing systems continue to suffer from fundamental reliability…

Multiagent Systems · Computer Science 2026-05-20 Jiaao Wu , Xian Zhang , Hanzhang Liu , Sophia Zhang , Fan Yang , Yinpeng Dong

Recent studies have shown that long chain-of-thought (CoT) reasoning can significantly enhance the performance of large language models (LLMs) on complex tasks. However, this benefit is yet to be demonstrated in the domain of video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yuanxin Liu , Kun Ouyang , Haoning Wu , Yi Liu , Lin Sui , Xinhao Li , Yan Zhong , Y. Charles , Xinyu Zhou , Xu Sun

Recent advances in multimodal LLMs and systems that use tools for long-video QA point to the promise of reasoning over hour-long episodes. However, many methods still compress content into lossy summaries or rely on limited toolsets,…

Artificial Intelligence · Computer Science 2025-12-24 Runtao Liu , Ziyi Liu , Jiaqi Tang , Yue Ma , Renjie Pi , Jipeng Zhang , Qifeng Chen

Complex reasoning in tool-augmented agent frameworks is inherently long-horizon, causing reasoning traces and transient tool artifacts to accumulate and strain the bounded working context of large language models. Without explicit memory…

Artificial Intelligence · Computer Science 2026-01-14 Hongjin Qian , Zhao Cao , Zheng Liu

Large Language Models (LLMs) excel at reasoning and planning when trained on chainof-thought (CoT) data, where the step-by-step thought process is explicitly outlined by text tokens. However, this results in lengthy inputs where many words…

Computation and Language · Computer Science 2025-09-03 DiJia Su , Hanlin Zhu , Yingchen Xu , Jiantao Jiao , Yuandong Tian , Qinqing Zheng

Effective human-AI collaboration on complex reasoning tasks requires that users understand and interact with the model's process, not just receive an output. However, the monolithic text from methods like Chain-of-Thought (CoT) prevents…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Yueqian Lin , Zhengmian Hu , Jayakumar Subramanian , Qinsi Wang , Nikos Vlassis , Hai "Helen" Li , Yiran Chen

With the growing adoption of large language model agents in persistent real-world roles, they naturally encounter continuous streams of tasks. A key limitation, however, is their failure to learn from the accumulated interaction history,…

Multi-agent systems built on large language models have shown strong performance on complex reasoning tasks, yet most work focuses on agent roles and orchestration while treating inter-agent communication as a fixed interface. Latent…

Artificial Intelligence · Computer Science 2026-04-24 Ye Yu , Heming Liu , Haibo Jin , Xiaopeng Yuan , Peng Kuang , Haohan Wang

Large language models (LLMs) have shown significant general language understanding abilities. However, there has been a scarcity of attempts to assess the logical reasoning capacities of these LLMs, an essential facet of natural language…

Computation and Language · Computer Science 2025-04-22 Hanmeng liu , Zhiyang Teng , Ruoxi Ning , Yiran Ding , Xiulai Li , Xiaozhang Liu , Yue Zhang