English
Related papers

Related papers: Training Cross-Morphology Embodied AI Agents: From…

200 papers

A central challenge in multi-agent reinforcement learning is enabling agents to adapt to previously unseen teammates in a zero-shot fashion. Prior work in zero-shot coordination often follows a two-stage process, first generating a diverse…

Multiagent Systems · Computer Science 2026-02-16 Andrew Ni , Simon Stepputtis , Stefanos Nikolaidis , Michael Lewis , Katia P. Sycara , Woojun Kim

The reasoning capabilities of embodied agents introduce a critical, under-explored inferential privacy challenge, where the risk of an agent generate sensitive conclusions from ambient data. This capability creates a fundamental tension…

Human-Computer Interaction · Computer Science 2025-09-24 Shuning Zhang , Hong Jia , Simin Li , Ting Dang , Yongquan `Owen' Hu , Xin Yi , Hewu Li

We develop a learning-based algorithm for the distributed formation control of networked multi-agent systems governed by unknown, nonlinear dynamics. Most existing algorithms either assume certain parametric forms for the unknown dynamic…

Systems and Control · Electrical Eng. & Systems 2022-01-13 Christos K. Verginis , Zhe Xu , Ufuk Topcu

The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Luca Weihs , Jordi Salvador , Klemen Kotar , Unnat Jain , Kuo-Hao Zeng , Roozbeh Mottaghi , Aniruddha Kembhavi

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

This paper addresses the challenge of enabling a single robot to effectively assist multiple humans in decision-making for task planning domains. We introduce a comprehensive framework designed to enhance overall team performance by…

Robotics · Computer Science 2023-10-17 Abhinav Dahiya , Stephen L. Smith

We propose the first framework to learn control policies for vision-based human-to-robot handovers, a critical task for human-robot interaction. While research in Embodied AI has made significant progress in training robot agents in…

Robotics · Computer Science 2023-03-31 Sammy Christen , Wei Yang , Claudia Pérez-D'Arpino , Otmar Hilliges , Dieter Fox , Yu-Wei Chao

The Centralized Training with Decentralized Execution (CTDE) paradigm has gained significant attention in multi-agent reinforcement learning (MARL) and is the foundation of many recent algorithms. However, decentralized policies operate…

Multiagent Systems · Computer Science 2025-08-19 Zhuofan Xu , Benedikt Bollig , Matthias Függer , Thomas Nowak , Vincent Le Dréau

Embodied AI models often employ off the shelf vision backbones like CLIP to encode their visual observations. Although such general purpose representations encode rich syntactic and semantic information about the scene, much of this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ainaz Eftekhar , Kuo-Hao Zeng , Jiafei Duan , Ali Farhadi , Ani Kembhavi , Ranjay Krishna

A common assumption when training embodied agents is that the impact of taking an action is stable; for instance, executing the "move ahead" action will always move the agent forward by a fixed distance, perhaps with some small amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Kuo-Hao Zeng , Luca Weihs , Roozbeh Mottaghi , Ali Farhadi

Autonomous and learning systems based on Deep Reinforcement Learning have firmly established themselves as a foundation for approaches to creating resilient and efficient Cyber-Physical Energy Systems. However, most current approaches…

Artificial Intelligence · Computer Science 2024-04-03 Eric MSP Veith , Torben Logemann , Aleksandr Berezin , Arlena Wellßow , Stephan Balduin

Language model (LM)-based embodied agents are increasingly deployed in real-world settings. Yet, their adaptability remains limited in dynamic environments, where constructing accurate and flexible world models is crucial for effective…

Artificial Intelligence · Computer Science 2026-02-02 Jinwoo Jang , Minjong Yoo , Sihyung Yoon , Honguk Woo

Optimizing the morphologies and the controllers that adapt to various tasks is a critical issue in the field of robot design, aka. embodied intelligence. Previous works typically model it as a joint optimization problem and use search-based…

Robotics · Computer Science 2024-03-29 Yishuai Cai , Shaowu Yang , Minglong Li , Xinglin Chen , Yunxin Mao , Xiaodong Yi , Wenjing Yang

This paper studies the fast adaptive beamforming for the multiuser multiple-input single-output downlink. Existing deep learning-based approaches assume that training and testing channels follow the same distribution which causes task…

Information Theory · Computer Science 2021-09-21 Juping Zhang , Yi Yuan , Gan Zheng , Ioannis Krikidis , Kai-Kit Wong

Reinforcement Learning methods are capable of solving complex problems, but resulting policies might perform poorly in environments that are even slightly different. In robotics especially, training and deployment conditions often vary and…

Machine Learning · Computer Science 2018-09-17 Isac Arnekvist , Danica Kragic , Johannes A. Stork

Recent advances in multi-agent reinforcement learning (MARL) are enabling impressive coordination in heterogeneous multi-robot teams. However, existing approaches often overlook the challenge of generalizing learned policies to teams of new…

Robotics · Computer Science 2024-01-25 Pierce Howell , Max Rudolph , Reza Torbati , Kevin Fu , Harish Ravichandar

Collective Adaptive Intelligence (CAI) represent a transformative approach in embodied AI, wherein numerous autonomous agents collaborate, adapt, and self-organize to navigate complex, dynamic environments. By enabling systems to…

Artificial Intelligence · Computer Science 2025-07-02 Fan Wang , Shaoshan Liu

Cross-Domain Recommendation (CDR) stands as a pivotal technology addressing issues of data sparsity and cold start by transferring general knowledge from the source to the target domain. However, existing CDR models suffer limitations in…

Information Retrieval · Computer Science 2023-10-23 Bowen Hao , Chaoqun Yang , Lei Guo , Junliang Yu , Hongzhi Yin

Cooperative multi-robot tasks can benefit from heterogeneity in the robots' physical and behavioral traits. In spite of this, traditional Multi-Agent Reinforcement Learning (MARL) frameworks lack the ability to explicitly accommodate policy…

Robotics · Computer Science 2023-01-19 Matteo Bettini , Ajay Shankar , Amanda Prorok

Human-Machine Teaming (HMT) is revolutionizing collaboration across domains such as defense, healthcare, and autonomous systems by integrating AI-driven decision-making, trust calibration, and adaptive teaming. This survey presents a…