English
Related papers

Related papers: Delay-Aware Diffusion Policy: Bridging the Observa…

200 papers

We introduce Diffusion Augmented Agents (DAAG), a novel framework that leverages large language models, vision language models, and diffusion models to improve sample efficiency and transfer learning in reinforcement learning for embodied…

Machine Learning · Computer Science 2024-07-31 Norman Di Palo , Leonard Hasenclever , Jan Humplik , Arunkumar Byravan

End-to-end learning is emerging as a powerful paradigm for robotic manipulation, but its effectiveness is limited by data scarcity and the heterogeneity of action spaces across robot embodiments. In particular, diverse action spaces across…

Robotics · Computer Science 2026-03-23 Erik Bauer , Elvis Nava , Robert K. Katzschmann

The robotic assembly task poses a key challenge in building generalist robots due to the intrinsic complexity of part interactions and the sensitivity to noise perturbations in contact-rich settings. The assembly agent is typically designed…

Robotics · Computer Science 2025-09-24 Ziyi Xu , Haohong Lin , Shiqi Liu , Ding Zhao

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

Optical flow models trained on high-quality data often degrade severely when confronted with real-world corruptions such as blur, noise, and compression artifacts. To overcome this limitation, we formulate Degradation-Aware Optical Flow, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jaewon Min , Jaeeun Lee , Yeji Choi , Paul Hyunbin Cho , Jin Hyeon Kim , Tae-Young Lee , Jongsik Ahn , Hwayeong Lee , Seonghyun Park , Seungryong Kim

In this tutorial paper, a comprehensive survey is given on several major systematic approaches in dealing with delay-aware control problems, namely the equivalent rate constraint approach, the Lyapunov stability drift approach and the…

Performance · Computer Science 2016-11-17 Ying Cui , Vincent K. N. Lau , Rui Wang , Huang Huang , Shunqing Zhang

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

Diffusion models excel at sampling from complex, unnormalized distributions. In this work, we extend Maximum Entropy Reinforcement Learning (ME-RL) to diffusion processes, enabling sampling from the optimal policy trajectory distribution.…

Machine Learning · Computer Science 2026-05-28 Sebastian Sanokowski , Kaustubh Patil

Inferring object motion representations from observations enhances the performance of robotic manipulation tasks. This paper introduces a new paradigm for robot imitation learning that generates action sequences by reasoning about object…

Robotics · Computer Science 2025-04-15 Yue Su , Xinyu Zhan , Hongjie Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

Equivariant diffusion policies (EDPs) combine the generative expressivity of diffusion models with the strong generalization and sample efficiency afforded by geometric symmetries. While steering these policies with reinforcement learning…

Machine Learning · Computer Science 2025-12-15 Minwoo Park , Junwoo Chang , Jongeun Choi , Roberto Horowitz

Prioritized Experience Replay (PER) enables the model to learn more about relatively important samples by artificially changing their accessed frequencies. However, this non-uniform sampling method shifts the state-action distribution that…

Machine Learning · Computer Science 2023-11-27 Zhuoying Chen , Huiping Li , Zhaoxu Wang

Diffusion policies are conditional diffusion models that learn robot action distributions conditioned on the robot and environment state. They have recently shown to outperform both deterministic and alternative action distribution learning…

Robotics · Computer Science 2024-07-26 Tsung-Wei Ke , Nikolaos Gkanatsios , Katerina Fragkiadaki

Watch-time prediction is a central regression task in short-video recommender systems, where labels are highly long-tailed and residual errors vary systematically across observed watch-time regions. In practice, a model may appear globally…

Information Retrieval · Computer Science 2026-05-19 Yiqing Yang , Xinlong Zhao , Zhao Liu , Xiao Lv , Ruiming Tang , Han Li , Kun Gai

Scenarios requiring humans to choose from multiple seemingly optimal actions are commonplace, however standard imitation learning often fails to capture this behavior. Instead, an over-reliance on replicating expert actions induces…

Robotics · Computer Science 2022-11-08 Hanbit Oh , Hikaru Sasaki , Brendan Michael , Takamitsu Matsubara

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

Bimanual manipulation is crucial in robotics, enabling complex tasks in industrial automation and household services. However, it poses significant challenges due to the high-dimensional action space and intricate coordination requirements.…

Diffusion policy has demonstrated promising performance in the field of robotic manipulation. However, its effectiveness has been primarily limited in short-horizon tasks, and its performance significantly degrades in the presence of image…

Robotics · Computer Science 2025-07-08 Kefeng Huang , Tingguang Li , Yuzhen Liu , Zhe Zhang , Jiankun Wang , Lei Han

Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy…

Machine Learning · Computer Science 2023-12-13 Bingzheng Wang , Guoqiang Wu , Teng Pang , Yan Zhang , Yilong Yin

We hypothesize that a key bottleneck in generalizable robot manipulation is not solely data scale or policy capacity, but a structural mismatch between current visual backbones and the physical requirements of closed-loop control. While…

Robotics · Computer Science 2026-02-13 Yu Deng , Yufeng Jin , Xiaogang Jia , Jiahong Xue , Gerhard Neumann , Georgia Chalvatzaki

The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots…

Robotics · Computer Science 2021-11-03 Brendan Tidd , Akansel Cosgun , Jurgen Leitner , Nicolas Hudson