English
Related papers

Related papers: Agents Explore but Agents Ignore: LLMs Lack Enviro…

200 papers

Tool-calling is essential for Large Language Model (LLM) agents to complete real-world tasks. While most existing benchmarks assume simple, perfectly documented tools, real-world tools (e.g., general "search" APIs) are often opaque, lacking…

Computation and Language · Computer Science 2026-02-18 Skyler Hallinan , Thejas Venkatesh , Xiang Ren , Sai Praneeth Karimireddy , Ashwin Paranjape , Yuhao Zhang , Jack Hessel

Reinforcement learning (RL) has enabled the training of large language model (LLM) agents to interact with the environment and to solve multi-turn long-horizon tasks. However, the RL-trained agents often struggle in tasks that require…

Machine Learning · Computer Science 2026-03-10 Yulun Jiang , Liangze Jiang , Damien Teney , Michael Moor , Maria Brbic

Large language model (LLM) agents are increasingly used to interact with and execute tasks in dynamic environments. However, a critical yet overlooked limitation of these agents is that they, by default, assume a stationary context, failing…

Computation and Language · Computer Science 2026-04-17 Yize Cheng , Arshia Soltani Moakhar , Chenrui Fan , Parsa Hosseini , Kazem Faghih , Zahra Sodagar , Wenxiao Wang , Soheil Feizi

Large Language Models (LLMs) agents augmented with domain tools promise to autonomously execute complex tasks requiring human-level intelligence, such as customer service and digital assistance. However, their practical deployment is often…

Multiagent Systems · Computer Science 2025-08-28 Kevin Song , Anand Jayarajan , Yaoyao Ding , Qidong Su , Zhanda Zhu , Sihang Liu , Gennady Pekhimenko

Observational studies can yield clinically actionable evidence at scale, but executing them on real-world databases is open-ended and requires coherent decisions across cohort construction, analysis, and reporting. Prior evaluations of LLM…

Artificial Intelligence · Computer Science 2026-03-25 Dubai Li , Yuxiang He , Yan Hu , Yu Tian , Jingsong Li

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

As scientific research becomes increasingly complex, innovative tools are needed to manage vast data, facilitate interdisciplinary collaboration, and accelerate discovery. Large language models (LLMs) are now evolving into LLM-based…

Artificial Intelligence · Computer Science 2026-02-03 Shuo Ren , Can Xie , Pu Jian , Zhenjiang Ren , Chunlin Leng , Jiajun Zhang

Large Language Models (LLMs) are increasingly capable but often require significant guidance or extensive interaction history to perform effectively in complex, interactive environments. Existing methods may struggle with adapting to new…

Machine Learning · Computer Science 2025-06-12 Samuel Holt , Max Ruiz Luyten , Thomas Pouplin , Mihaela van der Schaar

Most agents today ``self-evolve'' by following rewards and rules defined by humans. However, this process remains fundamentally dependent on external supervision; without human guidance, the evolution stops. In this work, we train agents to…

Artificial Intelligence · Computer Science 2026-04-21 Qifan Zhang , Dongyang Ma , Tianqing Fang , Jia Li , Jing Tang , Nuo Chen , Haitao Mi , Yan Wang

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and tool use. However, the fundamental cognitive faculties essential for problem solving, including perception, reasoning, and memory, remain the stable…

Artificial Intelligence · Computer Science 2026-05-12 Xiaozhe Li , Jixuan Chen , Xinyu Fang , Shengyuan Ding , Haodong Duan , Qingwen Liu , Kai Chen

Web-based participatory urban sensing has emerged as a vital approach for modern urban management by leveraging mobile individuals as distributed sensors. However, existing urban sensing systems struggle with limited generalization across…

Artificial Intelligence · Computer Science 2025-10-27 Xusen Guo , Mingxing Peng , Xixuan Hao , Xingchen Zou , Qiongyan Wang , Sijie Ruan , Yuxuan Liang

AI agents that leverage Large Language Models (LLMs) are increasingly becoming core building blocks of modern software systems. A wide range of frameworks is now available to support the specification of such applications. These frameworks…

Artificial Intelligence · Computer Science 2025-11-04 Fabiana Fournier , Lior Limonad , Yuval David

Large Language Model (LLM)-based agents are increasingly used as autonomous subordinates that carry out tasks for users. This raises the question of whether they may also engage in deception, similar to how individuals in human…

Large Language Models (LLMs) have extended their impact beyond Natural Language Processing, substantially fostering the development of interdisciplinary research. Recently, various LLM-based agents have been developed to assist scientific…

The rise of large language models (LLMs) has sparked a surge of interest in agents, leading to the rapid growth of agent frameworks. Agent frameworks are software toolkits and libraries that provide standardized components, abstractions,…

Software Engineering · Computer Science 2025-12-02 Yanlin Wang , Xinyi Xu , Jiachi Chen , Tingting Bi , Wenchao Gu , Zibin Zheng

Large Language Model (LLM) agents show great promise for complex, multi-turn tool-use tasks, but their development is often hampered by the extreme scarcity of high-quality training data. Supervised fine-tuning (SFT) on synthetic data leads…

Artificial Intelligence · Computer Science 2026-02-02 Siyuan Lu , Zechuan Wang , Hongxuan Zhang , Qintong Wu , Leilei Gan , Chenyi Zhuang , Jinjie Gu , Tao Lin

With the remarkable advancements of large language models (LLMs), LLM-based agents have become a research hotspot in human-computer interaction. However, there is a scarcity of benchmarks available for LLM-based mobile agents. Benchmarking…

Artificial Intelligence · Computer Science 2024-07-02 Shihan Deng , Weikai Xu , Hongda Sun , Wei Liu , Tao Tan , Jianfeng Liu , Ang Li , Jian Luan , Bin Wang , Rui Yan , Shuo Shang

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. This study introduces the LLM-Coordination Benchmark,…

Computation and Language · Computer Science 2025-04-30 Saaket Agashe , Yue Fan , Anthony Reyna , Xin Eric Wang

LLM agents achieve 85-96% success on tasks where instructions fully specify the action, but drop to 29-53% when action feasibility depends on environmental state that the instruction does not mention. We argue that this gap reflects a…

Computation and Language · Computer Science 2026-05-29 Zixuan Wang , Dingming Li , Hongxing Li , Yanrui Miao , Shuo Chen , Yuchen Yan , Wenqi Zhang , Yongliang Shen , Weiming Lu , Jun Xiao , Yueting Zhuang