English
Related papers

Related papers: Improving LLM Agent Planning with In-Context Learn…

200 papers

Large Language Models (LLMs) have achieved considerable performance across various agentic planning tasks. However, traditional agent planning approaches adopt a "flood irrigation" methodology that indiscriminately injects gold…

Computation and Language · Computer Science 2025-05-30 Shuofei Qiao , Zhisong Qiu , Baochang Ren , Xiaobin Wang , Xiangyuan Ru , Ningyu Zhang , Xiang Chen , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

Addressing the disparity between forecasts and actual results can enable individuals to expand their thought processes and stimulate self-reflection, thus promoting accurate planning. In this research, we present **PreAct**, an agent…

Computation and Language · Computer Science 2024-12-06 Dayuan Fu , Jianzhao Huang , Siyuan Lu , Guanting Dong , Yejie Wang , Keqing He , Weiran Xu

Autonomous agents powered by large language models (LLMs) have the potential to enhance human capabilities, assisting with digital tasks from sending emails to performing data analysis. The abilities of existing LLMs at such tasks are often…

Machine Learning · Computer Science 2025-01-22 Hongjin Su , Ruoxi Sun , Jinsung Yoon , Pengcheng Yin , Tao Yu , Sercan Ö. Arık

Reinforcement learning (RL) with outcome-based rewards has achieved significant success in training large language model (LLM) agents for complex reasoning tasks. However, in active reasoning where agents need to strategically ask questions…

Artificial Intelligence · Computer Science 2026-03-13 Deyu Zou , Yongqiang Chen , Fan Feng , Mufei Li , Pan Li , Yu Gong , James Cheng

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

Artificial Intelligence · Computer Science 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

LLM-based web agents show immense promise for information seeking, yet their effectiveness on long-horizon tasks is hindered by a fundamental trade-off in context management. Prevailing ReAct-based agents suffer from context saturation as…

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

Effective decision-making in complex systems requires synthesizing diverse perspectives to address multifaceted challenges under uncertainty. This study introduces an agentic Large Language Models (LLMs) framework for simulating decision…

Artificial Intelligence · Computer Science 2026-03-20 Antoine Dolant , Praveen Kumar

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding responses with retrieved information. As an emerging paradigm, Agentic RAG further enhances this process by introducing autonomous LLM agents into the…

Information Retrieval · Computer Science 2025-05-26 Yunjia Xi , Jianghao Lin , Menghui Zhu , Yongzhao Xiao , Zhuoying Ou , Jiaqi Liu , Tong Wan , Bo Chen , Weiwen Liu , Yasheng Wang , Ruiming Tang , Weinan Zhang , Yong Yu

Large language models (LLMs) are increasingly used to support creative tasks such as research idea generation. While recent work has shown that structured dialogues between LLMs can improve the novelty and feasibility of generated ideas,…

Computation and Language · Computer Science 2025-07-14 Keisuke Ueda , Wataru Hirota , Takuto Asakura , Takahiro Omi , Kosuke Takahashi , Kosuke Arima , Tatsuya Ishigaki

Large Language Models (LLMs) have advanced artificial intelligence by enabling human-like text generation and natural language understanding. However, their reliance on static training data limits their ability to respond to dynamic,…

Artificial Intelligence · Computer Science 2026-04-02 Aditi Singh , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei , Athanasios V. Vasilakos

The past years have seen Large Language Models (LLMs) strive not only as generative models but also as agents solving textual sequential decision-making tasks. When facing complex environments where their zero-shot abilities are…

Machine Learning · Computer Science 2026-01-30 Loris Gaven , Clement Romac , Thomas Carta , Sylvain Lamprier , Olivier Sigaud , Pierre-Yves Oudeyer

Agentic search requires large language models (LLMs) to perform multi-step search to solve complex information-seeking tasks, imposing unique challenges on their reasoning capabilities. However, what constitutes effective reasoning for…

Artificial Intelligence · Computer Science 2026-01-19 Jiahe Jin , Abhijay Paladugu , Chenyan Xiong

Agent-based modeling (ABM) offers powerful insights into complex systems, but its practical utility has been limited by computational constraints and simplistic agent behaviors, especially when simulating large populations. Recent…

Multiagent Systems · Computer Science 2024-11-12 Ayush Chopra , Shashank Kumar , Nurullah Giray-Kuru , Ramesh Raskar , Arnau Quera-Bofarull

Large language models (LLMs) demonstrate impressive performance on a wide variety of tasks, but they often struggle with tasks that require multi-step reasoning or goal-directed planning. Both cognitive neuroscience and reinforcement…

Artificial Intelligence · Computer Science 2025-10-16 Taylor Webb , Shanka Subhra Mondal , Ida Momennejad

Training agents to act competently in complex 3D environments from high-dimensional visual information is challenging. Reinforcement learning is conventionally used to train such agents, but requires a carefully designed reward function,…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Yuhan Cao , Dave Bignell , Amos Storkey , Sam Devlin , Tabish Rashid

Test-time scaling (TTS) enhances the performance of large language models (LLMs) by allocating additional compute resources during inference. However, existing research primarily investigates TTS in single-stage tasks; while many real-world…

Artificial Intelligence · Computer Science 2025-10-23 Fali Wang , Hui Liu , Zhenwei Dai , Jingying Zeng , Zhiwei Zhang , Zongyu Wu , Chen Luo , Zhen Li , Xianfeng Tang , Qi He , Suhang Wang

Large language models (LLMs) have recently gained much attention in building autonomous agents. However, the performance of current LLM-based web agents in long-horizon tasks is far from optimal, often yielding errors such as repeatedly…

Computation and Language · Computer Science 2025-04-01 Hyungjoo Chae , Namyoung Kim , Kai Tzu-iunn Ong , Minju Gwak , Gwanwoo Song , Jihoon Kim , Sunghwan Kim , Dongha Lee , Jinyoung Yeo

Large language models (LLMs) have been successfully adapted for interactive decision-making tasks like web navigation. While achieving decent performance, previous methods implicitly assume a forward-only execution mode for the model, where…

Computation and Language · Computer Science 2024-02-22 Kaixin Ma , Hongming Zhang , Hongwei Wang , Xiaoman Pan , Wenhao Yu , Dong Yu

With the rapid development of Large Language Models (LLMs), LLM-based agents have been widely adopted in various fields, becoming essential for autonomous decision-making and interactive tasks. However, current work typically relies on…

Artificial Intelligence · Computer Science 2026-02-25 Shangheng Du , Jiabao Zhao , Jinxin Shi , Zhentao Xie , Xin Jiang , Yanhong Bai , Liang He