English
Related papers

Related papers: MIMIC-D: Multi-modal Imitation for MultI-agent Coo…

200 papers

Due to the complex interactions between agents, learning multi-agent control policy often requires a prohibited amount of data. This paper aims to enable multi-agent systems to effectively utilize past memories to adapt to novel…

Robotics · Computer Science 2025-01-28 So Kuroki , Mai Nishimura , Tadashi Kozuno

Generative model-based imitation learning methods have recently achieved strong results in learning high-complexity motor skills from human demonstrations. However, imitation learning of interactive policies that coordinate with humans in…

Robotics · Computer Science 2025-11-18 Max M. Sun , Todd Murphey

Imitation Learning (IL) techniques aim to replicate human behaviors in specific tasks. While IL has gained prominence due to its effectiveness and efficiency, traditional methods often focus on datasets collected from experts to produce a…

Machine Learning · Computer Science 2025-04-28 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier , Ludovic Denoyer

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has access to data from…

There has been substantial progress in humanoid robots, with new skills continuously being taught, ranging from navigation to manipulation. While these abilities may seem impressive, the teaching methods often remain inefficient. To enhance…

Robotics · Computer Science 2025-01-29 Josua Spisak , Matthias Kerzel , Stefan Wermter

Accurately simulating diverse behaviors of heterogeneous agents in various scenarios is fundamental to autonomous driving simulation. This task is challenging due to the multi-modality of behavior distribution, the high-dimensionality of…

Robotics · Computer Science 2024-10-27 Baotian He , Yibing Li

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

Learning long-horizon robotic manipulation requires jointly achieving expressive behavior modeling, real-time inference, and stable execution, which remains challenging for existing generative policies. Diffusion-based approaches offer…

Robotics · Computer Science 2026-05-19 Wu Songwei , Jiang Zhiduo , Sun Wandong , Xie Guanghu , Zhao Rui , Liu Hong , Liu Yang

High-speed, low-latency obstacle avoidance that is insensitive to sensor noise is essential for enabling multiple decentralized robots to function reliably in cluttered and dynamic environments. While other distributed multi-agent collision…

Artificial Intelligence · Computer Science 2017-07-07 Pinxin Long , Wenxi Liu , Jia Pan

As human-robot collaboration is becoming more widespread, there is a need for a more natural way of communicating with the robot. This includes combining data from several modalities together with the context of the situation and background…

Human-Computer Interaction · Computer Science 2024-04-03 Petr Vanc , Radoslav Skoviera , Karla Stepanova

Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to…

Robotics · Computer Science 2017-11-27 Karol Hausman , Yevgen Chebotar , Stefan Schaal , Gaurav Sukhatme , Joseph Lim

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Jiaming Liu , Hao Chen , Pengju An , Zhuoyang Liu , Renrui Zhang , Chenyang Gu , Xiaoqi Li , Ziyu Guo , Sixiang Chen , Mengzhen Liu , Chengkai Hou , Mengdi Zhao , KC alex Zhou , Pheng-Ann Heng , Shanghang Zhang

Generating diverse and realistic human motion that can physically interact with an environment remains a challenging research area in character animation. Meanwhile, diffusion-based methods, as proposed by the robotics community, have…

Graphics · Computer Science 2024-12-06 Takara E. Truong , Michael Piseno , Zhaoming Xie , C. Karen Liu

Robots in the real world need to perceive and move to goals in complex environments without collisions. Avoiding collisions is especially difficult when relying on sensor perception and when goals are among clutter. Diffusion policies and…

Robotics · Computer Science 2025-05-22 Mohit Sharma , Adam Fishman , Vikash Kumar , Chris Paxton , Oliver Kroemer

Imitation learning (IL) aims to learn a policy from expert demonstrations and has been applied to various applications. By learning from the expert policy, IL methods do not require environmental interactions or reward signals. However,…

Robotics · Computer Science 2025-10-17 Shang-Fu Chen , Co Yong , Shao-Hua Sun

Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However,…

Robotics · Computer Science 2021-01-21 Ayumu Sasagawa , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

The networked nature of multi-robot systems presents challenges in the context of multi-agent reinforcement learning. Centralized control policies do not scale with increasing numbers of robots, whereas independent control policies do not…

Robotics · Computer Science 2025-06-24 Eduardo Sebastian , Thai Duong , Nikolay Atanasov , Eduardo Montijano , Carlos Sagues

With the rapid development of imaging sensor technology in the field of remote sensing, multi-modal remote sensing data fusion has emerged as a crucial research direction for land cover classification tasks. While diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 DaiXun Li , Weiying Xie , ZiXuan Wang , YiBing Lu , Yunsong Li , Leyuan Fang

We present DisCo, a distributed algorithm for contact-rich, multi-robot tasks. DisCo is a distributed contact-implicit trajectory optimization algorithm, which allows a group of robots to optimize a time sequence of forces to objects and to…

Robotics · Computer Science 2024-10-31 Ola Shorinwa , Matthew Devlin , Elliot W. Hawkes , Mac Schwager

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn