中文
相关论文

相关论文: Conditioning Matters: Training Diffusion Policies …

200 篇论文

We present Diffuse-CLoC, a guided diffusion framework for physics-based look-ahead control that enables intuitive, steerable, and physically realistic motion generation. While existing kinematics motion generation with diffusion models…

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

机器学习 · 计算机科学 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

Camouflaged Object Detection (COD) is a challenging task in computer vision due to the high similarity between camouflaged objects and their surroundings. Existing COD methods primarily employ semantic segmentation, which suffers from…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Zhongxi Chen , Ke Sun , Xianming Lin , Rongrong Ji

Sequence modeling approaches have shown promising results in robot imitation learning. Recently, diffusion models have been adopted for behavioral cloning in a sequence modeling fashion, benefiting from their exceptional capabilities in…

机器人学 · 计算机科学 2024-01-12 Xiang Li , Varun Belagali , Jinghuan Shang , Michael S. Ryoo

Vision-Language-Action (VLA) models have shown promise in robot manipulation but often struggle to generalize to new instructions or complex multi-task scenarios. We identify a critical pathology in current training paradigms where…

人工智能 · 计算机科学 2026-05-14 Shijie Lian , Bin Yu , Xiaopeng Lin , Laurence T. Yang , Zhaolong Shen , Changti Wu , Yuzhuo Miao , Cong Huang , Kai Chen

Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but remains vulnerable to exposure bias and error accumulation, as early mistakes propagate irreversibly through autoregressive…

计算与语言 · 计算机科学 2026-04-21 Shidong Cao , Hongzhan Lin , Yuxuan Gu , Ziyang Luo , Jing Ma

Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing…

机器人学 · 计算机科学 2026-01-21 Weize Xie , Yi Ding , Ying He , Leilei Wang , Binwen Bai , Zheyi Zhao , Chenyang Wang , F. Richard Yu

Recent improvements in conditional generative modeling have made it possible to generate high-quality images from language descriptions alone. We investigate whether these methods can directly address the problem of sequential…

机器学习 · 计算机科学 2023-07-11 Anurag Ajay , Yilun Du , Abhi Gupta , Joshua Tenenbaum , Tommi Jaakkola , Pulkit Agrawal

Diffusion policies (DPs) achieve state-of-the-art performance on complex manipulation tasks by learning from large-scale demonstration datasets, often spanning multiple embodiments and environments. However, they cannot guarantee safe…

机器人学 · 计算机科学 2026-03-11 Ralf Römer , Julian Balletshofer , Jakob Thumm , Marco Pavone , Angela P. Schoellig , Matthias Althoff

Diffusion language models, as a promising alternative to traditional autoregressive (AR) models, enable faster generation and richer conditioning on bidirectional context. However, they suffer from a key discrepancy between training and…

机器学习 · 计算机科学 2025-09-26 Haoyu He , Katrin Renz , Yong Cao , Andreas Geiger

Robot chain-of-thought reasoning (CoT) -- wherein a model predicts helpful intermediate representations before choosing actions -- provides an effective method for improving the generalization and performance of robot policies, especially…

机器人学 · 计算机科学 2025-05-20 William Chen , Suneel Belkhale , Suvir Mirchandani , Oier Mees , Danny Driess , Karl Pertsch , Sergey Levine

In offline reinforcement learning, value overestimation caused by out-of-distribution (OOD) actions significantly limits policy performance. Recently, diffusion models have been leveraged for their strong distribution-matching capabilities,…

机器学习 · 计算机科学 2025-11-13 Yunchang Ma , Tenglong Liu , Yixing Lan , Xin Yin , Changxin Zhang , Xinglong Zhang , Xin Xu

Diffusion models have recently emerged as effective generative frameworks for trajectory optimization, capable of producing high-quality and diverse solutions. However, training these models in a purely data-driven manner without explicit…

机器人学 · 计算机科学 2025-04-02 Anjian Li , Ryne Beeson

Modeling multimodal human behavior has been a key barrier to increasing the level of interaction between human and robot, particularly for collaborative tasks. Our key insight is that an effective, learned robot policy used for human-robot…

机器人学 · 计算机科学 2023-11-14 Eley Ng , Ziang Liu , Monroe Kennedy

Learning from expert demonstrations is a promising approach for training robotic manipulation policies from limited data. However, imitation learning algorithms require a number of design choices ranging from the input modality, training…

机器人学 · 计算机科学 2024-09-12 Eugenio Chisari , Nick Heppert , Max Argus , Tim Welschehold , Thomas Brox , Abhinav Valada

On-policy reinforcement learning methods like GRPO suffer from mode collapse: they exhibit reduced solution diversity, concentrating probability mass on a single solution once discovered and ceasing exploration of alternative strategies. We…

Imitation learning for robotic manipulation often suffers from limited generalization and data scarcity, especially in complex, long-horizon tasks. In this work, we introduce a hierarchical framework that leverages code-generating…

机器人学 · 计算机科学 2025-09-30 Markus Peschl , Pietro Mazzaglia , Daniel Dijkman

Vision-Language-Action (VLA) models are emerging as a next-generation paradigm for robotics. We introduce dVLA, a diffusion-based VLA that leverages a multimodal chain-of-thought to unify visual perception, language reasoning, and robotic…

机器人学 · 计算机科学 2025-10-01 Junjie Wen , Minjie Zhu , Jiaming Liu , Zhiyuan Liu , Yicun Yang , Linfeng Zhang , Shanghang Zhang , Yichen Zhu , Yi Xu

This paper presents Diffusion Forcing, a new training paradigm where a diffusion model is trained to denoise a set of tokens with independent per-token noise levels. We apply Diffusion Forcing to sequence generative modeling by training a…

机器学习 · 计算机科学 2024-12-11 Boyuan Chen , Diego Marti Monso , Yilun Du , Max Simchowitz , Russ Tedrake , Vincent Sitzmann

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

机器学习 · 计算机科学 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou