English
Related papers

Related papers: Automated Skill Discovery for Language Agents thro…

200 papers

Large language models are increasingly deployed as autonomous agents that must plan, act, and recover from mistakes through long-horizon interaction with environments that provide rich feedback. However, prevailing outcome-driven…

Artificial Intelligence · Computer Science 2026-03-18 Rui Ge , Yichao Fu , Yuyang Qian , Junda Su , Yiming Zhao , Peng Zhao , Hao Zhang

Large language model (LLM) agents have demonstrated strong capabilities across diverse domains, yet automated agent design remains a significant challenge. Current automated agent design approaches are often constrained by limited search…

Computation and Language · Computer Science 2025-11-21 Yu Li , Lehui Li , Zhihao Wu , Qingmin Liao , Jianye Hao , Kun Shao , Fengli Xu , Yong Li

Large language model agents often fail to accumulate knowledge from experience, treating each task as an independent challenge. Recent methods extract experience as flattened textual knowledge, which cannot capture procedural logic of…

Artificial Intelligence · Computer Science 2026-02-02 Libin Qiu , Zhirong Gao , Junfu Chen , Yuhang Ye , Weizhi Huang , Xiaobo Xue , Wenkai Qiu , Shuo Tang

Recent research on instructable agents has used memory-augmented Large Language Models (LLMs) as task planners, a technique that retrieves language-program examples relevant to the input instruction and uses them as in-context examples in…

Artificial Intelligence · Computer Science 2024-05-01 Gabriel Sarch , Sahil Somani , Raghav Kapoor , Michael J. Tarr , Katerina Fragkiadaki

Recently, there has been an emergence of employing LLM-powered agents as believable human proxies, based on their remarkable decision-making capability. However, existing studies mainly focus on simulating human dialogue. Human non-verbal…

Information Retrieval · Computer Science 2023-10-16 Junjie Zhang , Yupeng Hou , Ruobing Xie , Wenqi Sun , Julian McAuley , Wayne Xin Zhao , Leyu Lin , Ji-Rong Wen

Eliciting information to reduce uncertainty about a latent entity is a critical task in many application domains, e.g., assessing individual student learning outcomes, diagnosing underlying diseases, or learning user preferences. Though…

Computation and Language · Computer Science 2025-07-10 Jimmy Wang , Thomas Zollo , Richard Zemel , Hongseok Namkoong

Statistical model discovery is a challenging search over a vast space of models subject to domain-specific constraints. Efficiently searching over this space requires expertise in modeling and the problem domain. Motivated by the domain…

Machine Learning · Computer Science 2024-06-25 Michael Y. Li , Emily B. Fox , Noah D. Goodman

Exploration is a crucial skill for in-context reinforcement learning in unknown environments. However, it remains unclear if large language models can effectively explore a partially hidden state space. This work isolates exploration as the…

Machine Learning · Computer Science 2025-08-26 Tim Grams , Patrick Betz , Sascha Marton , Stefan Lüdtke , Christian Bartelt

Embodied Instruction Following (EIF) is a crucial task in embodied learning, requiring agents to interact with their environment through egocentric observations to fulfill natural language instructions. Recent advancements have seen a surge…

Artificial Intelligence · Computer Science 2024-03-06 Haochen Shi , Zhiyuan Sun , Xingdi Yuan , Marc-Alexandre Côté , Bang Liu

A persistent skill library allows language model agents to reuse successful strategies across tasks. Maintaining such a library requires three coupled capabilities. The agent selects a relevant skill, utilizes it during execution, and…

Artificial Intelligence · Computer Science 2026-05-13 Yaorui Shi , Yuxin Chen , Zhengxi Lu , Yuchun Miao , Shugui Liu , Qi GU , Xunliang Cai , Xiang Wang , An Zhang

Reinforcement learning (RL) is the dominant paradigm for sharpening strategic tool use capabilities of LLMs on long-horizon, sparsely-rewarded agent tasks, yet it faces a fundamental challenge of exploration-exploitation trade-off. Existing…

Exploring rich environments and evaluating one's actions without prior knowledge is immensely challenging. In this paper, we propose Motif, a general method to interface such prior knowledge from a Large Language Model (LLM) with an agent.…

Artificial Intelligence · Computer Science 2023-10-03 Martin Klissarov , Pierluca D'Oro , Shagun Sodhani , Roberta Raileanu , Pierre-Luc Bacon , Pascal Vincent , Amy Zhang , Mikael Henaff

In the information era, how learners find, evaluate, and effectively use information has become a challenging issue, especially with the added complexity of large language models (LLMs) that have further confused learners in their…

Information Retrieval · Computer Science 2025-01-07 Yiming Luo , Patrick Cheong-Iao Pang , Shanton Chang

The advent of large language models (LLMs) has transformed information access and reasoning through open-ended natural language interaction. However, LLMs remain limited by static knowledge, factual hallucinations, and the inability to…

Artificial Intelligence · Computer Science 2025-10-29 Minhua Lin , Zongyu Wu , Zhichao Xu , Hui Liu , Xianfeng Tang , Qi He , Charu Aggarwal , Hui Liu , Xiang Zhang , Suhang Wang

Can emergent language models faithfully model the intelligence of decision-making agents? Though modern language models exhibit already some reasoning ability, and theoretically can potentially express any probable distribution over tokens,…

Machine Learning · Computer Science 2024-06-27 Wenhao Lu , Xufeng Zhao , Josua Spisak , Jae Hee Lee , Stefan Wermter

Agents powered by large language models (LLMs) have demonstrated strong planning and decision-making capabilities in complex embodied environments. However, such agents often suffer from inefficiencies in multi-turn interactions, frequently…

Computation and Language · Computer Science 2025-09-23 Qingyu Lu , Liang Ding , Siyi Cao , Xuebo Liu , Kanjian Zhang , Jinxia Zhang , Dacheng Tao

In dynamic open-world environments, autonomous agents often encounter novelties that hinder their ability to find plans to achieve their goals. Specifically, traditional symbolic planners fail to generate plans when the robot's planning…

Robotics · Computer Science 2026-03-13 Hong Lu , Pierrick Lorang , Timothy R. Duggan , Jivko Sinapov , Matthias Scheutz

Current interactive systems with natural language interfaces lack the ability to understand a complex information-seeking request which expresses several implicit constraints at once, and there is no prior information about user preferences…

Reinforcement learning systems rely on environment interfaces that specify observations and reward functions, yet constructing these interfaces for new tasks often requires substantial manual effort. While recent work has automated reward…

Machine Learning · Computer Science 2026-05-06 Akshat Singh Jaswal , Ashish Baghel , Paras Chopra

Large language model agents are becoming increasingly capable at web-centric tasks such as information retrieval, complex reasoning. These emerging capabilities have given rise to surge research interests in developing LLM agent for…

Computation and Language · Computer Science 2026-04-02 Yu Li , Lehui Li , Lin Chen , Qingmin Liao , Fengli Xu , Yong Li