English
Related papers

Related papers: Improving Diffusion Planners by Self-Supervised Ac…

200 papers

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

In this paper, we introduce a policy-gradient method for model-based reinforcement learning (RL) that exploits a type of stationary distributions commonly obtained from Markov decision processes (MDPs) in stochastic networks, queueing…

Machine Learning · Computer Science 2025-10-30 Céline Comte , Matthieu Jonckheere , Jaron Sanders , Albert Senen-Cerda

In recent years, predicting driver's focus of attention has been a very active area of research in the autonomous driving community. Unfortunately, existing state-of-the-art techniques achieve this by relying only on human gaze information,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Anwesan Pal , Sayan Mondal , Henrik I. Christensen

Diffusion-based planning has shown promising results in long-horizon, sparse-reward tasks by training trajectory diffusion models and conditioning the sampled trajectories using auxiliary guidance functions. However, due to their nature as…

Machine Learning · Computer Science 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

By framing reinforcement learning as a sequence modeling problem, recent work has enabled the use of generative models, such as diffusion models, for planning. While these models are effective in predicting long-horizon state trajectories…

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

Machine Learning · Computer Science 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

We describe a robust planning method for autonomous driving that mixes normal and adversarial agent predictions output by a diffusion model trained for motion prediction. We first train a diffusion model to learn an unbiased distribution of…

Robotics · Computer Science 2025-05-20 Albert Zhao , Stefano Soatto

Target tracking plays a crucial role in real-world scenarios, particularly in drug-trafficking interdiction, where the knowledge of an adversarial target's location is often limited. Improving autonomous tracking systems will enable…

Robotics · Computer Science 2024-01-15 Sean Ye , Manisha Natarajan , Zixuan Wu , Matthew Gombolay

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Learning-based planners generate natural human-like driving behaviors by learning to reason about nuanced interactions from data, overcoming the rigid behaviors that arise from rule-based planners. Nonetheless, data-driven approaches often…

Robotics · Computer Science 2025-06-02 Wenhao Ding , Sushant Veer , Yuxiao Chen , Yulong Cao , Chaowei Xiao , Marco Pavone

Data augmentation is a key element for training accurate models by reducing overfitting and improving generalization. For image classification, the most popular data augmentation techniques range from simple photometric and geometrical…

Machine Learning · Computer Science 2022-11-02 Avery Ma , Nikita Dvornik , Ran Zhang , Leila Pishdad , Konstantinos G. Derpanis , Afsaneh Fazly

A new paradigm to estimate the gradient of a black-box scalar function is introduced, considering it as a member of a set of admissible gradients that are computed using existing function samples. Results on gradient estimate accuracy,…

Optimization and Control · Mathematics 2025-08-28 Lorenzo Sabug , Fredy Ruiz , Lorenzo Fagiano

Diffusion models demonstrate superior performance in capturing complex distributions from large-scale datasets, providing a promising solution for quadrupedal locomotion control. However, the robustness of the diffusion planner is…

Real-world time-series datasets often violate the assumptions of standard supervised learning for forecasting -- their distributions evolve over time, rendering the conventional training and model selection procedures suboptimal. In this…

Machine Learning · Computer Science 2022-09-27 Sercan O. Arik , Nathanael C. Yoder , Tomas Pfister

Recent works have shown the promise of inference-time search over action samples for improving generative robot policies. In particular, optimizing cross-chunk coherence via bidirectional decoding has proven effective in boosting the…

Robotics · Computer Science 2025-08-19 Rhea Malhotra , Yuejiang Liu , Chelsea Finn

Research on unsupervised domain adaptation (UDA) for semantic segmentation of remote sensing images has been extensively conducted. However, research on how to achieve domain adaptation in practical scenarios where source domain data is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Wenjie Liu , Hongmin Liu , Lixin Zhang , Bin Fan

Recently, diffusion policy has shown impressive results in handling multi-modal tasks in robotic manipulation. However, it has fundamental limitations in out-of-distribution failures that persist due to compounding errors and its limited…

Robotics · Computer Science 2025-03-25 Sung-Wook Lee , Xuhui Kang , Yen-Ling Kuo

We present Semantic-Aware Guided Exploration, SAGE, a system for open-vocabulary exploration in unknown 3D indoor environments that preserves coverage-oriented behavior while allowing semantic cues to reprioritize frontier selection.…

Robotics · Computer Science 2026-05-25 Nitin Vegesna , Avideh Zakhor

This paper presents advanced techniques of training diffusion policies for offline reinforcement learning (RL). At the core is a mean-reverting stochastic differential equation (SDE) that transfers a complex action distribution into a…

Machine Learning · Computer Science 2025-01-09 Ruoqi Zhang , Ziwei Luo , Jens Sjölund , Thomas B. Schön , Per Mattsson

In robotics, diffusion models can capture multi-modal trajectories from demonstrations, making them a transformative approach in imitation learning. However, achieving optimal performance following this regiment requires a large-scale…