English
Related papers

Related papers: THOR: Tool-Integrated Hierarchical Optimization vi…

200 papers

Large Language Models (LLMs) can significantly improve their reasoning capabilities by interacting with external tools, a paradigm known as Tool-Integrated Reasoning (TIR). However, extending TIR to multi-turn scenarios using Reinforcement…

Machine Learning · Computer Science 2025-09-04 Zhenghai Xue , Longtao Zheng , Qian Liu , Yingru Li , Xiaosen Zheng , Zejun Ma , Bo An

Complex tasks involving tool integration pose significant challenges for Large Language Models (LLMs), leading to the emergence of multi-agent workflows as a promising solution. Reflection has emerged as an effective strategy for correcting…

Artificial Intelligence · Computer Science 2025-06-06 Zikang Guo , Benfeng Xu , Xiaorui Wang , Zhendong Mao

Large Language Models (LLMs) have emerged as powerful tools for generating coherent text, understanding context, and performing reasoning tasks. However, they struggle with temporal reasoning, which requires processing time-related…

Machine Learning · Computer Science 2025-06-02 Adrián Bazaga , Rexhina Blloshmi , Bill Byrne , Adrià de Gispert

Large language models (LLMs) have shown great potential in the medical domain. However, existing models still fall short when faced with complex medical diagnosis task in the real world. This is mainly because they lack sufficient reasoning…

Artificial Intelligence · Computer Science 2025-08-06 Qi Peng , Jialin Cui , Jiayuan Xie , Yi Cai , Qing Li

By augmenting Large Language Models (LLMs) with external tools, their capacity to solve complex problems has been significantly enhanced. However, despite ongoing advancements in the parsing capabilities of LLMs, incorporating all available…

Computation and Language · Computer Science 2025-11-24 Hang Gao , Yongfeng Zhang

Recent advancements in Chain-of-Thought prompting have facilitated significant breakthroughs for Large Language Models (LLMs) in complex reasoning tasks. Current research enhances the reasoning performance of LLMs by sampling multiple…

Computation and Language · Computer Science 2024-05-22 Zhangyue Yin , Qiushi Sun , Qipeng Guo , Zhiyuan Zeng , Xiaonan Li , Tianxiang Sun , Cheng Chang , Qinyuan Cheng , Ding Wang , Xiaofeng Mou , Xipeng Qiu , XuanJing Huang

Large Language Models (LLMs) equipped with external tools have demonstrated enhanced performance on complex reasoning tasks. The widespread adoption of this tool-augmented reasoning is hindered by the scarcity of domain-specific tools. For…

Computation and Language · Computer Science 2025-10-10 Murong Yue , Zhiwei Liu , Liangwei Yang , Jianguo Zhang , Zuxin Liu , Haolin Chen , Ziyu Yao , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

Computation and Language · Computer Science 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

The internalization of chain-of-thought processes into hidden states has emerged as a highly efficient paradigm for scaling test-time compute. However, existing activation steering methods rely on static control vectors that fail to adapt…

Machine Learning · Computer Science 2026-02-06 Zhenning Shi , Yijia Zhu , Junhan Shi , Xun Zhang , Lei Wang , Congcong Miao

Tool-Integrated Reasoning (TIR) empowers large language models (LLMs) to tackle complex tasks by interleaving reasoning steps with external tool interactions. However, existing reinforcement learning methods typically rely on outcome- or…

Computation and Language · Computer Science 2026-01-16 Changle Qu , Sunhao Dai , Hengyi Cai , Jun Xu , Shuaiqiang Wang , Dawei Yin

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Retrieval-augmented generation (RAG) has become a fundamental paradigm for addressing the challenges faced by large language models in handling real-time information and domain-specific problems. Traditional RAG systems primarily rely on…

Computation and Language · Computer Science 2025-09-11 YiHan Jiao , ZheHao Tan , Dan Yang , DuoLin Sun , Jie Feng , Yue Shen , Jian Wang , Peng Wei

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Current Large Language Models (LLMs) exhibit limited ability to understand table structures and to apply precise numerical reasoning, which is crucial for tasks such as table question answering (TQA) and table-based fact verification (TFV).…

Computation and Language · Computer Science 2025-07-11 Xinyuan Lu , Liangming Pan , Yubo Ma , Preslav Nakov , Min-Yen Kan

In theorem proving, the task of selecting useful premises from a large library to unlock the proof of a given conjecture is crucially important. This presents a challenge for all theorem provers, especially the ones based on language…

Artificial Intelligence · Computer Science 2022-05-24 Albert Q. Jiang , Wenda Li , Szymon Tworkowski , Konrad Czechowski , Tomasz Odrzygóźdź , Piotr Miłoś , Yuhuai Wu , Mateja Jamnik

Enhancing reasoning capabilities remains a central focus in the LLM reasearch community. A promising direction involves requiring models to simulate code execution step-by-step to derive outputs for given inputs. However, as code is often…

Computation and Language · Computer Science 2025-07-15 Keqin Bao , Nuo Chen , Xiaoyuan Li , Binyuan Hui , Bowen Yu , Fuli Feng , Xiangnan He , Dayiheng Liu

Large language models (LLMs) demonstrate significant reasoning capabilities, particularly through long chain-of-thought (CoT) processes, which can be elicited by reinforcement learning (RL). However, prolonged CoT reasoning presents…

Computation and Language · Computer Science 2025-12-29 Haoyuan Wu , Xueyi Chen , Rui Ming , Jilong Gao , Shoubo Hu , Zhuolun He , Bei Yu

Code generation, the task of creating executable programs from natural language requirements, has recently seen tremendous advances through Chain-of-Thought (CoT) reasoning, which enables Large Language Models (LLMs) to develop high-level…

Software Engineering · Computer Science 2025-10-21 Shuzheng Gao , Chaozheng Wang , Cuiyun Gao , Michael R. Lyu

We investigate the capabilities and scalability of Large Language Models (LLMs) in optimization modeling, a domain requiring structured reasoning and precise formulation. To this end, we introduce OPT-ENGINE, an extensible benchmark…

Computation and Language · Computer Science 2026-05-15 Yitian Chen , Cheng Cheng , Yinan Sun , Zi Ling , Dongdong Ge

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo