English
Related papers

Related papers: Diff-DAgger: Uncertainty Estimation with Diffusion…

200 papers

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. A key challenge in LfD research is that users tend to provide…

Machine Learning · Computer Science 2022-02-16 Sravan Jayanthi , Letian Chen , Matthew Gombolay

Reinforcement learning has been proven to be highly effective in handling complex control tasks. Traditional methods typically use unimodal distributions, such as Gaussian distributions, to model the output of value distributions. However,…

Machine Learning · Computer Science 2025-07-14 Tong Liu , Yinuo Wang , Xujie Song , Wenjun Zou , Liangfa Chen , Likun Wang , Bin Shuai , Jingliang Duan , Shengbo Eben Li

Recent developments in offline reinforcement learning have uncovered the immense potential of diffusion modeling, which excels at representing heterogeneous behavior policies. However, sampling from diffusion policies is considerably slow…

Machine Learning · Computer Science 2024-03-18 Huayu Chen , Cheng Lu , Zhengyi Wang , Hang Su , Jun Zhu

Diffusion models have demonstrated highly-expressive generative capabilities in vision and NLP. Recent studies in reinforcement learning (RL) have shown that diffusion models are also powerful in modeling complex policies or trajectories in…

Machine Learning · Computer Science 2023-10-11 Haoran He , Chenjia Bai , Kang Xu , Zhuoran Yang , Weinan Zhang , Dong Wang , Bin Zhao , Xuelong Li

Diffusion models have been extensively leveraged for learning robot skills from demonstrations. These policies are conditioned on several observational modalities such as proprioception, vision and tactile. However, observational modalities…

Robotics · Computer Science 2025-09-23 Omkar Patil , Prabin Rath , Kartikay Pangaonkar , Eric Rosen , Nakul Gopalan

This paper presents DNAct, a language-conditioned multi-task policy framework that integrates neural rendering pre-training and diffusion training to enforce multi-modality learning in action sequence spaces. To learn a generalizable…

Robotics · Computer Science 2024-03-11 Ge Yan , Yueh-Hua Wu , Xiaolong Wang

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in realworld applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing…

Machine Learning · Computer Science 2025-01-09 Tianyang Duan , Zongyuan Zhang , Zheng Lin , Yue Gao , Ling Xiong , Yong Cui , Hongbin Liang , Xianhao Chen , Heming Cui , Dong Huang

Solving storage problem: where objects must be accurately placed into containers with precise orientations and positions, presents a distinct challenge that extends beyond traditional rearrangement tasks. These challenges are primarily due…

Robotics · Computer Science 2024-09-04 Haonan Chang , Kowndinya Boyalakuntla , Yuhan Liu , Xinyu Zhang , Liam Schramm , Abdeslam Boularias

Diffusion policies excel at visuomotor control but often fail catastrophically under severe out-of-distribution (OOD) disturbances, such as unexpected object displacements or visual corruptions. To address this vulnerability, we introduce…

Robotics · Computer Science 2026-03-24 Ziou Hu , Xiangtong Yao , Yuan Meng , Zhenshan Bing , Alois Knoll

Unmanned Aerial Vehicles (UAVs) are increasingly adopted in modern communication networks. However, challenges in decision-making and digital modeling continue to impede their rapid advancement. Reinforcement Learning (RL) algorithms face…

Machine Learning · Computer Science 2025-01-13 Yousef Emami , Hao Zhou , Luis Almeida , Kai Li

In this paper, We Apply Reinforcement learning (RL) techniques to train a realistic biomechanical model to work with different people and on different walking environments. We benchmarking 3 RL algorithms: Deep Deterministic Policy Gradient…

Artificial Intelligence · Computer Science 2019-01-16 Montaser Mohammedalamen , Waleed D. Khamies , Benjamin Rosman

Recent advancements in reinforcement learning (RL) have led to remarkable achievements in robot locomotion capabilities. However, the complexity and ``black-box'' nature of neural network-based RL policies hinder their interpretability and…

Robotics · Computer Science 2024-03-22 Fernando Acero , Zhibin Li

In the field of Robot Learning, the complex mapping between high-dimensional observations such as RGB images and low-level robotic actions, two inherently very different spaces, constitutes a complex learning problem, especially with…

Robotics · Computer Science 2024-05-29 Vitalis Vosylius , Younggyo Seo , Jafar Uruç , Stephen James

Robotic tasks are typically specified by a tuple of factors, such as the object to be grasped, the obstacles to be avoided, the color of the target, and so on. Collecting expert demonstrations for every combination of factor values grows…

Machine Learning · Computer Science 2026-05-22 Sayan Mitra , Ege Yuceel , Noah Giles , Abhishek Pai

Fine-tuning diffusion policies with reinforcement learning (RL) presents significant challenges. The long denoising sequence for each action prediction impedes effective reward propagation. Moreover, standard RL methods require millions of…

Nature evolves creatures with a high complexity of morphological and behavioral intelligence, meanwhile computational methods lag in approaching that diversity and efficacy. Co-optimization of artificial creatures' morphology and control in…

One of the bottlenecks in robotic intelligence is the instability of neural network models, which, unlike control models, lack a well-defined convergence domain and stability. This leads to risks when applying intelligence in the physical…

Robotics · Computer Science 2025-03-20 Zihao Liu , Xing Liu , Yizhai Zhang , Zhengxiong Liu , Panfeng Huang

Reinforcement learning (RL) has been extensively employed in a wide range of decision-making problems, such as games and robotics. Recently, diffusion policies have shown strong potential in modeling multi-modal behaviors, enabling more…

Machine Learning · Computer Science 2026-03-06 Ben Liu , Shunpeng Yang , Hua Chen

Bed-making is a universal home task that can be challenging for senior citizens due to reaching motions. Automating bed-making has multiple technical challenges such as perception in an unstructured environments, deformable object…

Robotics · Computer Science 2017-11-08 Michael Laskey , Chris Powers , Ruta Joshi , Arshan Poursohi , Ken Goldberg