English
Related papers

Related papers: Autonomous Tree-search Ability of Large Language M…

200 papers

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

Computation and Language · Computer Science 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can…

Computation and Language · Computer Science 2025-02-10 Tongxuan Liu , Wenjiang Xu , Weizhe Huang , Yuting Zeng , Jiaxing Wang , Xingyu Wang , Hailong Yang , Jing Li

Large language models (LLMs) exhibit remarkable problem-solving abilities, but struggle with complex tasks due to static internal knowledge. Retrieval-Augmented Generation (RAG) enhances access to external information, yet remains limited…

Reinforcement learning (RL) with tree search has demonstrated superior performance in traditional reasoning tasks. Compared to conventional independent chain sampling strategies with outcome supervision, tree search enables better…

Machine Learning · Computer Science 2025-06-16 Zhenyu Hou , Ziniu Hu , Yujiang Li , Rui Lu , Jie Tang , Yuxiao Dong

While Large Language Models (LLMs) have achieved remarkable success in a wide range of applications, their performance often degrades in complex reasoning tasks. In this work, we introduce SELT (Self-Evaluation LLM Tree Search), a novel…

Computation and Language · Computer Science 2025-06-10 Mengsong Wu , Di Zhang , Yuqiang Li , Dongzhan Zhou , Wenliang Chen

While researchers have made significant progress in enabling large language models (LLMs) to perform multi-step planning, LLMs struggle to ensure that those plans align with high-level user intent and satisfy symbolic constraints,…

Machine Learning · Computer Science 2026-05-14 Kamel Alrashedy , Vriksha Srihari , Zulfiqar Zaidi , Ridam Srivastava , Pradyumna Tambwekar , Matthew Gombolay

Robotic assembly tasks remain an open challenge due to their long horizon nature and complex part relations. Behavior trees (BTs) are increasingly used in robot task planning for their modularity and flexibility, but creating them manually…

Robotics · Computer Science 2025-06-19 Jicong Ao , Fan Wu , Yansong Wu , Abdalla Swikir , Sami Haddadin

Large Language Models (LLM) are increasingly being explored for problem-solving tasks. However, their strategic planning capability is often viewed with skepticism. Recent studies have incorporated the Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-02-05 Bingzheng Gan , Yufan Zhao , Tianyi Zhang , Jing Huang , Yusu Li , Shu Xian Teo , Changwang Zhang , Wei Shi

Large language models (LLMs) have shown limitations in tasks requiring complex logical reasoning and multi-step problem-solving. To address these challenges, researchers have employed carefully designed prompts and flowcharts, simulating…

Computation and Language · Computer Science 2024-12-06 Changcheng Li , Xiangyu Wang , Qiuju Chen , Xiren Zhou , Huanhuan Chen

Recent advances in Large Language Models (LLMs) have shown promise in automating discourse annotation for conversations. While manually designing tree annotation schemes significantly improves annotation quality for humans and models, their…

Computation and Language · Computer Science 2025-06-04 Kseniia Petukhova , Ekaterina Kochmar

Large Language Models (LLMs) offer promising capabilities for tackling complex reasoning tasks, including optimization problems. However, existing methods either rely on prompt engineering, which leads to poor generalization across problem…

Machine Learning · Computer Science 2025-10-23 Dong Li , Xujiang Zhao , Linlin Yu , Yanchi Liu , Wei Cheng , Zhengzhang Chen , Zhong Chen , Feng Chen , Chen Zhao , Haifeng Chen

Large Language Models (LLMs) have demonstrated the strong potential to assist both clinicians and the general public with their extensive medical knowledge. However, their application in healthcare is constrained due to concerns about the…

Computation and Language · Computer Science 2024-08-09 Thomas Pouplin , Hao Sun , Samuel Holt , Mihaela van der Schaar

Mathematical Word Problems (MWPs) are among the most challenging tasks in natural language processing because they require both linguistic understanding and multi-step numerical reasoning. While Chain-of-Thought (CoT) prompting has shown…

Computation and Language · Computer Science 2025-12-08 Aurprita Mahmood , Sabrin alam , Neloy kumer Sagor , Md. Abdul Hadi , Md. Sehab Al Islam , Minhajul Islam

Prompting language models (LMs) is the main interface for applying them to new tasks. However, for smaller LMs, prompting provides low accuracy compared to gradient-based finetuning. Tree Prompting is an approach to prompting which builds a…

Computation and Language · Computer Science 2023-10-24 John X. Morris , Chandan Singh , Alexander M. Rush , Jianfeng Gao , Yuntian Deng

Despite recent advances in large language models, open-source models often struggle to consistently perform well on complex reasoning tasks. Existing ensemble methods, whether applied at the token or output levels, fail to address these…

Computation and Language · Computer Science 2024-12-23 Sungjin Park , Xiao Liu , Yeyun Gong , Edward Choi

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex reasoning tasks, particularly when augmented with search mechanisms that enable systematic exploration of external knowledge bases. The field has evolved from…

Computation and Language · Computer Science 2026-01-27 Yanming Liu , Xinyue Peng , Zixuan Yan , Yanxin Shen , Wenjie Xu , Yuefeng Huang , Xinyi Wang , Jiannan Cao , Jianwei Yin , Xuhong Zhang

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

We investigate the potential of large language models (LLMs) to serve as efficient simulators for agentic search tasks in reinforcement learning (RL), thereby reducing dependence on costly interactions with external search engines. To this…

Large Language Models (LLMs) often falter at complex planning tasks that require exploration and self-correction, as their linear reasoning process struggles to recover from early mistakes. While search algorithms like Monte Carlo Tree…

Artificial Intelligence · Computer Science 2025-12-30 Yifan Zhang , Giridhar Ganapavarapu , Srideepika Jayaraman , Bhavna Agrawal , Dhaval Patel , Achille Fokoue