English
Related papers

Related papers: ASH: Agents that Self-Hone via Embodied Learning

200 papers

Agentic Artificial Intelligence (AI) represents a paradigm shift from reactive systems to proactive, autonomous decision making frameworks. Existing AI-based educational systems remain fragmented and lack multi-level integration across…

Multiagent Systems · Computer Science 2026-04-21 Arya Mary K J , Deepthy K Bhaskar , Sinu T S , Binu V P

Foundation models have shown impressive adaptation and scalability in supervised and self-supervised learning problems, but so far these successes have not fully translated to reinforcement learning (RL). In this work, we demonstrate that…

Embodied Everyday Task is a popular task in the embodied AI community, requiring agents to make a sequence of actions based on natural language instructions and visual observations. Traditional learning-based approaches face two challenges.…

Robotics · Computer Science 2024-09-18 Weiye Xu , Min Wang , Wengang Zhou , Houqiang Li

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

Large Language Models (LLMs) act as powerful reasoning engines but struggle with "symbol grounding" in embodied environments, particularly when information is asymmetrically distributed. We investigate the Privileged Information Bias (or…

Artificial Intelligence · Computer Science 2025-12-19 Shaun Baek , Sam Liu , Joseph Ukpong

Language-guided autonomous driving requires bridging a large abstraction gap between high-level natural-language instructions and low-level vehicle control. End-to-end approaches that use a single multimodal large language model (MLLM) to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zaibin Zhang , Talas Fu , Shiyu Tang , Yuanhang Zhang , Yifan Wang , Lijun Wang , Huchuan Lu

Human-AI collaboration requires agents that can adapt to diverse partner behaviors and skill levels while remaining robust to unseen partners. Existing methods often collapse to a single dominant behavior or learn poorly aligned skills,…

Artificial Intelligence · Computer Science 2026-05-26 Adnan Ahmad , Bahareh Nakisa , Mohammad Naim Rastgoo

Coordinating navigation and manipulation with robust performance is essential for embodied AI in complex indoor environments. However, as tasks extend over long horizons, existing methods often struggle due to catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jingjing Qian , Zeyuan He , Chen Shi , Lei Xiao , Li Jiang

Building embodied AI systems that can follow arbitrary language instructions in any 3D environment is a key challenge for creating general AI. Accomplishing this goal requires learning to ground language in perception and embodied actions,…

Robotics · Computer Science 2024-10-14 SIMA Team , Maria Abi Raad , Arun Ahuja , Catarina Barros , Frederic Besse , Andrew Bolt , Adrian Bolton , Bethanie Brownfield , Gavin Buttimore , Max Cant , Sarah Chakera , Stephanie C. Y. Chan , Jeff Clune , Adrian Collister , Vikki Copeman , Alex Cullum , Ishita Dasgupta , Dario de Cesare , Julia Di Trapani , Yani Donchev , Emma Dunleavy , Martin Engelcke , Ryan Faulkner , Frankie Garcia , Charles Gbadamosi , Zhitao Gong , Lucy Gonzales , Kshitij Gupta , Karol Gregor , Arne Olav Hallingstad , Tim Harley , Sam Haves , Felix Hill , Ed Hirst , Drew A. Hudson , Jony Hudson , Steph Hughes-Fitt , Danilo J. Rezende , Mimi Jasarevic , Laura Kampis , Rosemary Ke , Thomas Keck , Junkyung Kim , Oscar Knagg , Kavya Kopparapu , Rory Lawton , Andrew Lampinen , Shane Legg , Alexander Lerchner , Marjorie Limont , Yulan Liu , Maria Loks-Thompson , Joseph Marino , Kathryn Martin Cussons , Loic Matthey , Siobhan Mcloughlin , Piermaria Mendolicchio , Hamza Merzic , Anna Mitenkova , Alexandre Moufarek , Valeria Oliveira , Yanko Oliveira , Hannah Openshaw , Renke Pan , Aneesh Pappu , Alex Platonov , Ollie Purkiss , David Reichert , John Reid , Pierre Harvey Richemond , Tyson Roberts , Giles Ruscoe , Jaume Sanchez Elias , Tasha Sandars , Daniel P. Sawyer , Tim Scholtes , Guy Simmons , Daniel Slater , Hubert Soyer , Heiko Strathmann , Peter Stys , Allison C. Tam , Denis Teplyashin , Tayfun Terzi , Davide Vercelli , Bojan Vujatovic , Marcus Wainwright , Jane X. Wang , Zhengdong Wang , Daan Wierstra , Duncan Williams , Nathaniel Wong , Sarah York , Nick Young

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

Machine Learning · Computer Science 2025-06-03 Junyan Liu , Lillian J. Ratliff

Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This…

Machine Learning · Computer Science 2026-03-24 Xixi Wu , Qianguo Sun , Ruiyang Zhang , Chao Song , Junlong Wu , Yiyan Qi , Hong Cheng

Autonomous agents have made great strides in specialist domains like Atari games and Go. However, they typically learn tabula rasa in isolated environments with limited and manually conceived objectives, thus failing to generalize across a…

Machine Learning · Computer Science 2022-11-23 Linxi Fan , Guanzhi Wang , Yunfan Jiang , Ajay Mandlekar , Yuncong Yang , Haoyi Zhu , Andrew Tang , De-An Huang , Yuke Zhu , Anima Anandkumar

Achieving human-AI alignment in complex multi-agent games is crucial for creating trustworthy AI agents that enhance gameplay. We propose a method to evaluate this alignment using an interpretable task-sets framework, focusing on high-level…

Artificial Intelligence · Computer Science 2024-06-21 Sugandha Sharma , Guy Davidson , Khimya Khetarpal , Anssi Kanervisto , Udit Arora , Katja Hofmann , Ida Momennejad

Multimodal large language model (MLLM)-based embodied agents have shown strong potential for solving complex tasks in physical environments. However, personalized assistance requires more than following generic instruction or recognizing…

Artificial Intelligence · Computer Science 2026-05-27 Jeongeun Lee , Chanyoung Park , Dongha Lee

In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents learn solely from…

Robotics · Computer Science 2024-06-04 Andrej Orsula

Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only,…

Machine Learning · Computer Science 2020-02-24 David Venuto , Jhelum Chakravorty , Leonard Boussioux , Junhao Wang , Gavin McCracken , Doina Precup

Reinforcement learning for embodied agents is a challenging problem. The accumulated reward to be optimized is often a very rugged function, and gradient methods are impaired by many local optimizers. We demonstrate, in an experimental…

Artificial Intelligence · Computer Science 2016-06-01 Guido Montufar , Keyan Ghazi-Zahedi , Nihat Ay

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Autonomous AI agents deployed on platforms such as OpenClaw face prompt injection, memory poisoning, supply-chain attacks, and social engineering, yet existing defences address only the platform perimeter, leaving the agent's own threat…

Cryptography and Security · Computer Science 2026-04-28 Jiaqi Li , Yang Zhao , Bin Sun , Yang Yu , Jian Chang , Lidong Zhai

Long-Horizon (LH) tasks in Human-Scene Interaction (HSI) are complex multi-step tasks that require continuous planning, sequential decision-making, and extended execution across domains to achieve the final goal. However, existing methods…

Robotics · Computer Science 2026-04-23 Yutong Shen , Hangxu Liu , Lei Zhang , Penghui Liu , Yinqi Liu , Liuxiang Yang , Tongtong Feng