English
Related papers

Related papers: LASAR: Latent Adaptive Semantic Aligned Reasoning …

200 papers

Scaling inference-time computation has substantially improved the reasoning capabilities of language models. However, existing methods have significant limitations: serialized chain-of-thought approaches generate overly long outputs,…

Artificial Intelligence · Computer Science 2025-08-19 Jiayi Pan , Xiuyu Li , Long Lian , Charlie Snell , Yifei Zhou , Adam Yala , Trevor Darrell , Kurt Keutzer , Alane Suhr

Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks. Reasoning with LLMs is central to solving multi-step problems and complex decision-making. To support efficient reasoning, recent studies…

Computation and Language · Computer Science 2025-09-03 Jindong Li , Yali Fu , Li Fan , Jiahong Liu , Yao Shu , Chengwei Qin , Menglin Yang , Irwin King , Rex Ying

Chain-of-Thought (CoT) prompting has improved the reasoning performance of large language models (LLMs), but it remains unclear why it works and whether it is the unique mechanism for triggering reasoning in large language models. In this…

Computation and Language · Computer Science 2026-01-14 Zhenghao He , Guangzhi Xiong , Bohan Liu , Sanchit Sinha , Aidong Zhang

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

Machine Learning · Computer Science 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

Current state-of-the-art paradigms predominantly treat Text-to-Motion (T2M) generation as a direct translation problem, mapping symbolic language directly to continuous poses. While effective for simple actions, this System 1 approach faces…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yijie Qian , Juncheng Wang , Yuxiang Feng , Chao Xu , Wang Lu , Yang Liu , Baigui Sun , Yiqiang Chen , Yong Liu , Shujun Wang

Large reasoning models (LRMs) achieve strong performance on mathematical reasoning tasks, often attributed to their capability to generate explicit chain-of-thought (CoT) explanations. However, recent work shows that LRMs often arrive at…

Computation and Language · Computer Science 2026-04-20 Yihong Liu , Raoyuan Zhao , Hinrich Schütze , Michael A. Hedderich

Large Reasoning Models (LRMs) have revolutionized complex problem-solving, yet they exhibit a pervasive "overthinking", generating unnecessarily long reasoning chains. While current solutions improve token efficiency, they often sacrifice…

Artificial Intelligence · Computer Science 2026-04-10 Weiyang Huang , Xuefeng Bai , Kehai Chen , Xinyang Chen , Yibin Chen , Weili Guan , Min Zhang

Multimodal Large Language Models (MLLMs) have achieved remarkable performance by integrating powerful language backbones with large-scale visual encoders. Among these, latent Chain-of-Thought (CoT) methods enable implicit reasoning in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhang , Danyang Li , Yuxuan Li , Xin Zhang , Tianyu Xie , Mingming Cheng , Xiang Li

Large Audio Language Models (LALMs), powered by the chain-of-thought (CoT) paradigm, have shown remarkable reasoning capabilities. Intuitively, different problems often require varying depths of reasoning. While some methods can determine…

Machine Learning · Computer Science 2025-11-20 Zhichao Sheng , Shilin Zhou , Chen Gong , Zhenghua Li

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

Computation and Language · Computer Science 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their…

Artificial Intelligence · Computer Science 2026-01-27 Huajian Zhang , Mingyue Cheng , Yucong Luo , Xiaoyu Tao

Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajectories often exceed what the underlying problems require,…

Machine Learning · Computer Science 2026-05-12 Songtao Wei , Yi Li , Zhikai Li , Xu Hu , Yuede Ji , Guanpeng Li , Feng Chen , Carl Yang , Zhichun Guo , Bingzhe Li

Large Reasoning Language Models (LRLMs or LRMs) demonstrate remarkable capabilities in complex reasoning tasks, but suffer from significant computational inefficiencies due to overthinking phenomena. Existing efficient reasoning methods…

Artificial Intelligence · Computer Science 2025-10-13 Dongqi Zheng

Although Speech Large Language Models have achieved notable progress, a substantial modality reasoning gap remains: their reasoning performance on speech inputs is markedly weaker than on text. This gap could be associated with…

Computation and Language · Computer Science 2026-04-21 Chaoren Wang , Heng Lu , Xueyao Zhang , Shujie Liu , Yan Lu , Jinyu Li , Zhizheng Wu

Current large-language models (LLMs) typically adopt a fixed reasoning strategy, either simple or complex, for all questions, regardless of their difficulty. This neglect of variation in task and reasoning process complexity leads to an…

Computation and Language · Computer Science 2025-05-27 Yi Wang , Junxiao Liu , Shimao Zhang , Jiajun Chen , Shujian Huang

Automatic speech recognition (ASR) systems based on large language models (LLMs) achieve superior performance by leveraging pretrained LLMs as decoders, but their token-by-token generation mechanism leads to inference latency that grows…

Sound · Computer Science 2026-01-27 Wenjie Tian , Bingshen Mu , Guobin Ma , Xuelong Geng , Zhixian Zhao , Lei Xie

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance,…

Multimedia · Computer Science 2025-09-03 Qianrui Zhou , Hua Xu , Yifan Wang , Xinzhi Dong , Hanlei Zhang

Large language models (LLMs) often struggle to perform multi-target reasoning in long-context scenarios where relevant information is scattered across extensive documents. To address this challenge, we introduce NeuroSymbolic Augmented…

Computation and Language · Computer Science 2025-06-04 Sina Bagheri Nezhad , Ameeta Agrawal

Recent advancements in large language models (LLMs) have catalyzed the rise of reasoning-intensive inference paradigms, where models perform explicit step-by-step reasoning before generating final answers. While such approaches improve…

Artificial Intelligence · Computer Science 2026-04-28 Zichuan Fu , Xian Wu , Guojing Li , Yejing Wang , Yijun Chen , Zihao Zhao , Yixuan Luo , Hanyu Yan , Yefeng Zheng , Xiangyu Zhao

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui