English
Related papers

Related papers: Diffusion Modulation via Environment Mechanism Mod…

200 papers

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

The conditional diffusion model (CDM) enhances the standard diffusion model by providing more control, improving the quality and relevance of the outputs, and making the model adaptable to a wider range of complex tasks. However, inaccurate…

Machine Learning · Computer Science 2024-08-07 Weifeng Xu , Xiang Zhu , Xiaoyong Li

Trajectory prediction is an essential component in autonomous driving, particularly for collision avoidance systems. Considering the inherent uncertainty of the task, numerous studies have utilized generative models to produce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chen Liu , Shibo He , Haoyu Liu , Jiming Chen

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

Computation and Language · Computer Science 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang

Machine learning methods have been shown to be effective for weather forecasting, based on the speed and accuracy compared to traditional numerical models. While early efforts primarily concentrated on deterministic predictions, the field…

Machine Learning · Computer Science 2025-04-11 Erik Larsson , Joel Oskarsson , Tomas Landelius , Fredrik Lindsten

Motion planning in dynamic urban environments requires balancing immediate safety with long-term goals. While diffusion models effectively capture multi-modal decision-making, existing approaches treat trajectories as monolithic entities,…

Robotics · Computer Science 2026-03-27 Xiang Li , Bikun Wang , John Zhang , Jianjun Wang

Diffusion probability models have shown significant promise in offline reinforcement learning by directly modeling trajectory sequences. However, existing approaches primarily focus on time-domain features while overlooking frequency-domain…

Machine Learning · Computer Science 2025-09-25 Yifu Luo , Yongzhe Chang , Xueqian Wang

In offline reinforcement learning (RL), the performance of the learned policy highly depends on the quality of offline datasets. However, in many cases, the offline dataset contains very limited optimal trajectories, which poses a challenge…

Machine Learning · Computer Science 2024-02-23 Guanghe Li , Yixiang Shan , Zhengbang Zhu , Ting Long , Weinan Zhang

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing system complexity,…

Machine Learning · Computer Science 2025-07-24 Yunyi Zhao , Wei Zhang , Cheng Xiang , Hongyang Du , Dusit Niyato , Shuhua Gao

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

Guidance in conditional diffusion generation is of great importance for sample quality and controllability. However, existing guidance schemes are to be desired. On one hand, mainstream methods such as classifier guidance and…

Machine Learning · Computer Science 2023-10-18 Jiajun Ma , Tianyang Hu , Wenjia Wang , Jiacheng Sun

This paper investigates energy guidance in generative modeling, where the target distribution is defined as $q(\mathbf x) \propto p(\mathbf x)\exp(-\beta \mathcal E(\mathbf x))$, with $p(\mathbf x)$ being the data distribution and $\mathcal…

Machine Learning · Computer Science 2025-03-10 Shiyuan Zhang , Weitong Zhang , Quanquan Gu

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

Machine Learning · Computer Science 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn

Learning rewards from expert videos offers an affordable and effective solution to specify the intended behaviors for reinforcement learning (RL) tasks. In this work, we propose Diffusion Reward, a novel framework that learns rewards from…

Machine Learning · Computer Science 2024-08-12 Tao Huang , Guangqi Jiang , Yanjie Ze , Huazhe Xu

Autonomous driving systems demand trajectory planners that not only model the inherent uncertainty of future motions but also respect complex temporal dependencies and underlying physical laws. While diffusion-based generative models excel…

Robotics · Computer Science 2026-02-03 Hang Zhou , Qiang Zhang , Peiran Liu , Yihao Qin , Zhaoxu Yan , Yiding Ji

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making tasks. Within this…

Machine Learning · Computer Science 2024-11-19 Feng Chen , Fuguang Han , Cong Guan , Lei Yuan , Zhilong Zhang , Yang Yu , Zongzhang Zhang

Trajectory generation for mobile robots in unstructured environments faces a critical dilemma: balancing kinematic smoothness for safe execution with terminal precision for fine-grained tasks. Existing generative planners often struggle…

Robotics · Computer Science 2026-03-03 Jinyang Zhao , Handong Zheng , Yanjiu Zhong , Qiang Zhang , Yu Kang , Shunyu Wu

The conditional diffusion model has been demonstrated as an efficient tool for learning robot policies, owing to its advancement to accurately model the conditional distribution of policies. The intricate nature of real-world scenarios,…

Robotics · Computer Science 2024-07-03 Wenhao Yu , Jie Peng , Huanyu Yang , Junrui Zhang , Yifan Duan , Jianmin Ji , Yanyong Zhang

Task planning for embodied AI has been one of the most challenging problems where the community does not meet a consensus in terms of formulation. In this paper, we aim to tackle this problem with a unified framework consisting of an…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Cheng-Fu Yang , Haoyang Xu , Te-Lin Wu , Xiaofeng Gao , Kai-Wei Chang , Feng Gao

Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing…

Robotics · Computer Science 2024-04-08 Jiaqi Liu , Peng Hang , Xiaocong Zhao , Jianqiang Wang , Jian Sun