English
Related papers

Related papers: Dual Engines of Thoughts: A Depth-Breadth Integrat…

200 papers

Large reasoning models have demonstrated strong problem-solving abilities, yet real-world tasks often require external tools and long-horizon interactions. Existing agent frameworks typically follow predefined workflows, which limit…

Artificial Intelligence · Computer Science 2026-02-06 Xiaoxi Li , Wenxiang Jiao , Jiarui Jin , Guanting Dong , Jiajie Jin , Yinuo Wang , Hao Wang , Yutao Zhu , Ji-Rong Wen , Yuan Lu , Zhicheng Dou

Deep research requires reasoning over web evidence to answer open-ended questions, and it is a core capability for AI agents. Yet many deep research agents still rely on implicit, unstructured search behavior that causes redundant…

Artificial Intelligence · Computer Science 2026-04-29 Boer Zhang , Mingyan Wu , Dongzhuoran Zhou , Yuqicheng Zhu , Wendong Fan , Puzhen Zhang , Zifeng Ding , Guohao Li , Yuan He

Human-like chatbots necessitate the use of commonsense reasoning in order to effectively comprehend and respond to implicit information present within conversations. Achieving such coherence and informativeness in responses, however, is a…

Computation and Language · Computer Science 2023-10-24 Hyungjoo Chae , Yongho Song , Kai Tzu-iunn Ong , Taeyoon Kwon , Minjin Kim , Youngjae Yu , Dongha Lee , Dongyeop Kang , Jinyoung Yeo

When performing reasoning tasks with user-specific requirements, such as strict output formats, large language models (LLMs) often prioritize reasoning over adherence to detailed instructions. Fine-tuning LLMs on supervised datasets to…

Computation and Language · Computer Science 2025-10-21 Yiqi Li , Yusheng Liao , Zhe Chen , Yanfeng Wang , Yu Wang

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for multimodal large language models on video understanding tasks. However, its necessity and advantages over direct answering remain underexplored. In this paper, we first…

Large reasoning models (LRMs) like OpenAI-o1 have shown impressive capabilities in natural language reasoning. However, these models frequently demonstrate inefficiencies or inaccuracies when tackling complex mathematical operations. While…

Computation and Language · Computer Science 2025-10-24 Chengpeng Li , Zhengyang Tang , Ziniu Li , Mingfeng Xue , Keqin Bao , Tian Ding , Ruoyu Sun , Benyou Wang , Xiang Wang , Junyang Lin , Dayiheng Liu

K2-Think is a reasoning system that achieves state-of-the-art performance with a 32B parameter model, matching or surpassing much larger models like GPT-OSS 120B and DeepSeek v3.1. Built on the Qwen2.5 base model, our system shows that…

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

Machine Learning · Computer Science 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Large language models (LLMs) have demonstrated emergent capabilities across diverse reasoning tasks via popular Chains-of-Thought (COT) prompting. However, such a simple and fast COT approach often encounters limitations in dealing with…

Computation and Language · Computer Science 2024-07-02 Jiabao Pan , Yan Zhang , Chen Zhang , Zuozhu Liu , Hongwei Wang , Haizhou Li

Chain-of-Thought (CoT) prompting has significantly enhanced the mathematical reasoning capabilities of Large Language Models. We find existing fine-tuning datasets frequently suffer from the "answer right but reasoning wrong" probelm, where…

Artificial Intelligence · Computer Science 2026-01-13 Zihang Li , Yuhang Wang , Yikun Zong , Wenhan Yu , Xiaokun Yuan , Runhan Jiang , Zirui Liu , Tong Yang , Arthur Jiang

We introduce the Diffusion Chain of Lateral Thought (DCoLT), a reasoning framework for diffusion language models. DCoLT treats each intermediate step in the reverse diffusion process as a latent "thinking" action and optimizes the entire…

Computation and Language · Computer Science 2025-11-03 Zemin Huang , Zhiyang Chen , Zijun Wang , Tiancheng Li , Guo-Jun Qi

Chain-of-thought (CoT) reasoning has been proposed as a transparency mechanism for large language models in safety-critical deployments, yet its effectiveness depends on faithfulness (whether models accurately verbalize the factors that…

Computation and Language · Computer Science 2026-03-25 Richard J. Young

World models have emerged as a pivotal component in robot manipulation planning, enabling agents to predict future environmental states and reason about the consequences of actions before execution. While video-generation models are…

Robotics · Computer Science 2025-12-10 Wenjiang Xu , Cindy Wang , Rui Fang , Mingkang Zhang , Lusong Li , Jing Xu , Jiayuan Gu , Zecui Zeng , Rui Chen

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-of-Thought or Tree of Thoughts (ToT). The key idea and primary advantage…

Recently, long-thought reasoning models achieve strong performance on complex reasoning tasks, but often incur substantial inference overhead, making efficiency a critical concern. Our empirical analysis reveals that the benefit of using…

Artificial Intelligence · Computer Science 2025-05-22 Haotian Luo , Haiying He , Yibo Wang , Jinluan Yang , Rui Liu , Naiqiang Tan , Xiaochun Cao , Dacheng Tao , Li Shen

The integration of extensive, dynamic knowledge into Large Language Models (LLMs) remains a significant challenge due to the inherent entanglement of factual data and reasoning patterns. Existing solutions, ranging from non-parametric…

Computation and Language · Computer Science 2026-02-11 Wenxuan Xie , Yujia Wang , Xin Tan , Chaochao Lu , Xia Hu , Xuhong Wang

High-quality chain-of-thought has demonstrated strong potential for unlocking the reasoning capabilities of large language models. However, current paradigms typically treat the reasoning process as an indivisible sequence, lacking an…

Artificial Intelligence · Computer Science 2026-01-15 Yan Liu , Feng Zhang , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Han Liu , Yangdong Deng

While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising capabilities in end to end autonomous driving. However, recent efforts to integrate CoT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuechen Luo , Fang Li , Shaoqing Xu , Zhiyi Lai , Lei Yang , Qimao Chen , Ziang Luo , Zixun Xie , Shengyin Jiang , Jiaxin Liu , Long Chen , Bing Wang , Zhi-xin Yang

Open-ended question answering requires models to find appropriate evidence to form wellreasoned, comprehensive and helpful answers. In practical applications, models also need to engage in extended discussions on potential scenarios closely…

Computation and Language · Computer Science 2024-12-17 Mingxu Tao , Dongyan Zhao , Yansong Feng