English
Related papers

Related papers: ASH: Agents that Self-Hone via Embodied Learning

200 papers

Large language models (LLMs) often have a fixed knowledge cutoff, limiting their accuracy on emerging information. We present ALAS (Autonomous Learning Agent System), a modular pipeline that continuously updates an LLM's knowledge with…

Computation and Language · Computer Science 2025-08-25 Dhruv Atreja

Current approaches to embodied AI tend to learn policies from expert demonstrations. However, without a mechanism to evaluate the quality of demonstrated actions, they are limited to learning from optimal behaviour, or they risk replicating…

Computation and Language · Computer Science 2025-10-14 Sabrina McCallum , Amit Parekh , Alessandro Suglia

We introduce DeepNash, an autonomous agent capable of learning to play the imperfect information game Stratego from scratch, up to a human expert level. Stratego is one of the few iconic board games that Artificial Intelligence (AI) has not…

Humans can perform complex tasks with long-term objectives by planning, reasoning, and forecasting outcomes of actions. For embodied agents to achieve similar capabilities, they must gain knowledge of the environment transferable to novel…

Machine Learning · Computer Science 2024-10-01 Shu Ishida

Action chunking emerged as a pivotal technique in imitation learning, enabling policies to predict cohesive action sequences rather than single actions. Recently, this approach has expanded to reinforcement learning (RL), enhancing…

Machine Learning · Computer Science 2026-05-12 Yongjae Shin , Jongseong Chae , Seongmin Kim , Jongeui Park , Youngchul Sung

We investigate the visual cross-embodiment imitation setting, in which agents learn policies from videos of other agents (such as humans) demonstrating the same task, but with stark differences in their embodiments -- shape, actions,…

Robotics · Computer Science 2021-12-14 Kevin Zakka , Andy Zeng , Pete Florence , Jonathan Tompson , Jeannette Bohg , Debidatta Dwibedi

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

Artificial Intelligence · Computer Science 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Long-horizon agentic reasoning requires large language models to act over long interaction histories containing thoughts, tool calls, observations, and partial conclusions. The challenge is not merely that these histories grow long, but…

Artificial Intelligence · Computer Science 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Ziliang Zhao , Jiejun Tan , Zheng Liu , Zhicheng Dou

We present AVID, the first large-scale benchmark for audio-visual inconsistency understanding in videos. While omni-modal large language models excel at temporally aligned tasks such as captioning and question answering, they struggle to…

Multimedia · Computer Science 2026-04-16 Zixuan Chen , Depeng Wang , Hao Lin , Li Luo , Ke Xu , Ya Guo , Huijia Zhu , Tanfeng Sun , Xinghao Jiang

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

The incredible feats of athleticism demonstrated by humans are made possible in part by a vast repertoire of general-purpose motor skills, acquired through years of practice and experience. These skills not only enable humans to perform…

Graphics · Computer Science 2022-05-06 Xue Bin Peng , Yunrong Guo , Lina Halper , Sergey Levine , Sanja Fidler

In learning an embodied agent executing daily tasks via language directives, the literature largely assumes that the agent learns all training data at the beginning. We argue that such a learning scenario is less realistic since a robotic…

Artificial Intelligence · Computer Science 2024-03-14 Byeonghwi Kim , Minhyuk Seo , Jonghyun Choi

The ability to simulate the effects of future actions on the world is a crucial ability of intelligent embodied agents, enabling agents to anticipate the effects of their actions and make plans accordingly. While a large body of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Siyuan Zhou , Yilun Du , Yuncong Yang , Lei Han , Peihao Chen , Dit-Yan Yeung , Chuang Gan

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

The statelessness of foundation models bottlenecks agentic systems' ability to continually learn, a core capability for long-horizon reasoning and adaptation. To address this limitation, agentic systems commonly incorporate memory modules…

Artificial Intelligence · Computer Science 2026-02-10 Yiming Xiong , Shengran Hu , Jeff Clune

A growing body of research suggests that embodied gameplay, prevalent not just in human cultures but across a variety of animal species including turtles and ravens, is critical in developing the neural flexibility for creative problem…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Luca Weihs , Aniruddha Kembhavi , Kiana Ehsani , Sarah M Pratt , Winson Han , Alvaro Herrasti , Eric Kolve , Dustin Schwenk , Roozbeh Mottaghi , Ali Farhadi

Large language model (LLM) agents currently depend on predefined tools or early-stage tool generation, limiting their adaptability and scalability to complex scientific tasks. We introduce CASCADE, a self-evolving agentic framework…

Artificial Intelligence · Computer Science 2026-01-29 Xu Huang , Junwu Chen , Yuxing Fei , Zhuohan Li , Philippe Schwaller , Gerbrand Ceder

Large Language Models have demonstrated remarkable capabilities across diverse domains, yet significant challenges persist when deploying them as AI agents for real-world long-horizon tasks. Existing LLM agents suffer from a critical…

Computation and Language · Computer Science 2025-10-10 Cheng Yang , Xuemeng Yang , Licheng Wen , Daocheng Fu , Jianbiao Mei , Rong Wu , Pinlong Cai , Yufan Shen , Nianchen Deng , Botian Shi , Yu Qiao , Haifeng Li

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they…

Artificial Intelligence · Computer Science 2026-03-24 Pantea Karimi , Kimia Noorbakhsh , Mohammad Alizadeh , Hari Balakrishnan

The rapid evolution of agentic AI marks a new phase in artificial intelligence, where Large Language Models (LLMs) no longer merely respond but act, reason, and adapt. This survey traces the paradigm shift in building agentic AI: from…

Artificial Intelligence · Computer Science 2025-10-28 Jitao Sang , Jinlin Xiao , Jiarun Han , Jilin Chen , Xiaoyi Chen , Shuyu Wei , Yongjie Sun , Yuhang Wang