English
Related papers

Related papers: LLM-First Search: Self-Guided Exploration of the S…

200 papers

This study explores how to enhance the reasoning capabilities of large language models (LLMs) in knowledge base question answering (KBQA) by leveraging Monte Carlo Tree Search (MCTS). Semantic parsing-based KBQA methods are particularly…

Computation and Language · Computer Science 2025-02-20 Guanming Xiong , Haochen Li , Wen Zhao

Existing Large Reasoning Models (LRMs) have shown the potential of reinforcement learning (RL) to enhance the complex reasoning capabilities of Large Language Models~(LLMs). While they achieve remarkable performance on challenging tasks…

Artificial Intelligence · Computer Science 2025-03-19 Huatong Song , Jinhao Jiang , Yingqian Min , Jie Chen , Zhipeng Chen , Wayne Xin Zhao , Lei Fang , Ji-Rong Wen

Despite their outstanding capabilities, large language models (LLMs) are prone to hallucination and producing factually incorrect information. This challenge has spurred efforts in attributed text generation, which prompts LLMs to generate…

Computation and Language · Computer Science 2025-06-23 Junyi Li , Hwee Tou Ng

Large Language Models (LLMs) have shown great potential in the biomedical domain with the advancement of retrieval-augmented generation (RAG). However, existing retrieval-augmented approaches face challenges in addressing diverse queries…

Computation and Language · Computer Science 2024-10-17 Minda Hu , Licheng Zong , Hongru Wang , Jingyan Zhou , Jingjing Li , Yichen Gao , Kam-Fai Wong , Yu Li , Irwin King

Recent studies explored integrating state-space search algorithms with Language Models (LM) to perform look-ahead on the token generation process, the ''Tree-of-Thoughts'' (ToT), generated by LMs, thereby improving performance on…

Machine Learning · Computer Science 2026-01-08 Sumedh Pendurkar , Guni Sharon

Large Language Models (LLMs) harness extensive data from the Internet, storing a broad spectrum of prior knowledge. While LLMs have proven beneficial as decision-making aids, their reliability is hampered by limitations in reasoning,…

Artificial Intelligence · Computer Science 2024-03-12 Hongyi Guo , Zhihan Liu , Yufeng Zhang , Zhaoran Wang

Recent research suggests that tree search algorithms (e.g. Monte Carlo Tree Search) can dramatically boost LLM performance on complex mathematical reasoning tasks. However, they often require more than 10 times the computational resources…

Computation and Language · Computer Science 2024-07-02 Ante Wang , Linfeng Song , Ye Tian , Baolin Peng , Dian Yu , Haitao Mi , Jinsong Su , Dong Yu

Tree-search-based reasoning methods have significantly enhanced the reasoning capability of large language models (LLMs) by facilitating the exploration of multiple intermediate reasoning steps, i.e., thoughts. However, these methods suffer…

Computation and Language · Computer Science 2025-05-27 Zhihai Wang , Jie Wang , Jilai Pan , Xilin Xia , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Feng Wu

Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities, yet their standard generation process -- auto-regressive token prediction -- is inherently myopic and prone to cascading errors. To address this, the…

Artificial Intelligence · Computer Science 2026-05-28 Guni Sharon

Existing large language models (LLMs) driven search agents typically rely on prompt engineering to decouple the user queries into search plans, limiting their effectiveness in complex scenarios requiring reasoning. Furthermore, they suffer…

Information Retrieval · Computer Science 2025-05-27 Jinzheng Li , Sibo Ju , Yanzhou Su , Hongguang Li , Yiqing Shen

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

We investigate the potential of large language models (LLMs) to serve as efficient simulators for agentic search tasks in reinforcement learning (RL), thereby reducing dependence on costly interactions with external search engines. To this…

Large language models (LLMs) have demonstrated impressive capability in reasoning and planning when integrated with tree-search-based prompting methods. However, since these methods ignore the previous search experiences, they often make…

Computation and Language · Computer Science 2024-07-19 Wenyang Hui , Kewei Tu

Recent research has highlighted that Large Language Models (LLMs), even when trained to generate extended long reasoning steps, still face significant challenges on hard reasoning problems. However, much of the existing literature relies on…

Artificial Intelligence · Computer Science 2025-05-29 Fanzeng Xia , Yidong Luo , Tinko Sebastian Bartels , Yaqi Xu , Tongxin Li

Although Large Language Models (LLMs) achieve remarkable performance across various tasks, they often struggle with complex reasoning tasks, such as answering mathematical questions. Recent efforts to address this issue have primarily…

Machine Learning · Computer Science 2024-06-27 Jikun Kang , Xin Zhe Li , Xi Chen , Amirreza Kazemi , Qianyi Sun , Boxing Chen , Dong Li , Xu He , Quan He , Feng Wen , Jianye Hao , Jun Yao

While language models (LMs) have shown potential across a range of decision-making tasks, their reliance on simple acting processes limits their broad deployment as autonomous agents. In this paper, we introduce Language Agent Tree Search…

Artificial Intelligence · Computer Science 2024-06-07 Andy Zhou , Kai Yan , Michal Shlapentokh-Rothman , Haohan Wang , Yu-Xiong Wang

Recent advances demonstrate that increasing inference-time computation can significantly boost the reasoning capabilities of large language models (LLMs). Although repeated sampling (i.e., generating multiple candidate outputs) is a highly…

Artificial Intelligence · Computer Science 2025-11-10 Yuichi Inoue , Kou Misaki , Yuki Imajuku , So Kuroki , Taishi Nakamura , Takuya Akiba

Large language Model (LLM)-assisted algorithm discovery is an iterative, black-box optimization process over programs to approximatively solve a target task, where an LLM proposes candidate programs and an external evaluator provides task…

Machine Learning · Computer Science 2026-02-04 Timothee Leleu , Sudeera Gunathilaka , Federico Ghimenti , Surya Ganguli

Large language models (LLMs) often struggle with complex reasoning tasks due to their limitations in addressing the vast reasoning space and inherent ambiguities of natural language. We propose the Mixture-of-Search-Agents (MoSA) paradigm,…

Artificial Intelligence · Computer Science 2025-02-27 Sen Yang , Yafu Li , Wai Lam , Yu Cheng

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

Information Retrieval · Computer Science 2025-06-11 Wentao Shi , Yiqing Shen