English
Related papers

Related papers: Enhancing Decision Transformer with Diffusion-Base…

200 papers

This tutorial provides a comprehensive survey of methods for fine-tuning diffusion models to optimize downstream reward functions. While diffusion models are widely known to provide excellent generative modeling capability, practical…

Machine Learning · Computer Science 2024-07-19 Masatoshi Uehara , Yulai Zhao , Tommaso Biancalani , Sergey Levine

Learning-based planners generate natural human-like driving behaviors by learning to reason about nuanced interactions from data, overcoming the rigid behaviors that arise from rule-based planners. Nonetheless, data-driven approaches often…

Robotics · Computer Science 2025-06-02 Wenhao Ding , Sushant Veer , Yuxiao Chen , Yulong Cao , Chaowei Xiao , Marco Pavone

Offline safe reinforcement learning often requires policies to adapt at deployment time to safety budgets that vary across episodes or change within a single episode. While diffusion-based planners enable flexible trajectory generation,…

Machine Learning · Computer Science 2026-05-06 Rufeng Chen , Zhaofan Zhang , Zhejiang Yang , Hechang Chen , Sihong Xie

Diffusion-based generative models are emerging as powerful tools for long-horizon planning in reinforcement learning (RL), particularly with offline datasets. However, their performance is fundamentally limited by the quality and diversity…

Machine Learning · Computer Science 2025-10-14 Kyowoon Lee , Jaesik Choi

Diffusion-based trajectory planners can synthesize rich, multimodal action sequences for offline reinforcement learning, but their iterative denoising incurs substantial inference-time cost, making closed-loop planning slow under tight…

Robotics · Computer Science 2026-03-17 Gokul Puthumanaillam , Melkior Ornik

Today, the rapid growth of applications reliant on datacenters calls for new advancements to meet the increasing traffic and computational demands. Traffic traces from datacenters are essential for further development and optimization of…

Networking and Internet Architecture · Computer Science 2025-01-22 Chen Griner

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio

Model-free reinforcement learning algorithms such as Deep Deterministic Policy Gradient (DDPG) often require additional exploration strategies, especially if the actor is of deterministic nature. This work evaluates the use of model-based…

Machine Learning · Computer Science 2019-11-19 Kevin Sebastian Luck , Mel Vecerik , Simon Stepputtis , Heni Ben Amor , Jonathan Scholz

Dynamic resource allocation in O-RAN is critical for managing the conflicting QoS requirements of 6G network slices. Conventional reinforcement learning agents often fail in this domain, as their unimodal policy structures cannot model the…

Networking and Internet Architecture · Computer Science 2025-10-15 Salar Nouri , Mojdeh Karbalaeimotaleb , Vahid Shah-Mansouri , Tarik Taleb

Diffusion Transformers (DiT)-based video generation models with 3D full attention exhibit strong generative capabilities. Trajectory control represents a user-friendly task in the field of controllable video generation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Cheng Lei , Jiayu Zhang , Yue Ma , Xinyu Wang , Long Chen , Liang Tang , Yiqiang Yan , Fei Su , Zhicheng Zhao

Diffusion-based models demonstrate impressive generation capabilities. However, they also have a massive number of parameters, resulting in enormous model sizes, thus making them unsuitable for deployment on resource-constraint devices.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Avideep Mukherjee , Soumya Banerjee , Piyush Rai , Vinay P. Namboodiri

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

Machine Learning · Computer Science 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

Computation and Language · Computer Science 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang

Mission planning for a fleet of cooperative autonomous drones in applications that involve serving distributed target points, such as disaster response, environmental monitoring, and surveillance, is challenging, especially under partial…

Multiagent Systems · Computer Science 2025-04-14 Michael Elrod , Niloufar Mehrabi , Rahul Amin , Manveen Kaur , Long Cheng , Jim Martin , Abolfazl Razi

While data-driven trajectory prediction has enhanced the reliability of autonomous driving systems, it still struggles with rarely observed long-tail scenarios. Prior works addressed this by modifying model architectures, such as using…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Daehee Park , Monu Surana , Pranav Desai , Ashish Mehta , Reuben MV John , Kuk-Jin Yoon

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

Machine Learning · Computer Science 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

Deep neural network (DNN) based approaches hold significant potential for reinforcement learning (RL) and have already shown remarkable gains over state-of-art methods in a number of applications. The effectiveness of DNN methods can be…

Machine Learning · Statistics 2017-06-01 Henghui Zhu , Feng Nan , Ioannis Paschalidis , Venkatesh Saligrama

In recent years, extensive work has explored the application of the Transformer architecture to reinforcement learning problems. Among these, Decision Transformer (DT) has gained particular attention in the context of offline reinforcement…

Artificial Intelligence · Computer Science 2025-07-15 Yumi Omori , Zixuan Dong , Keith Ross

Remote sensing semantic segmentation must address both what the ground objects are within an image and where they are located. Consequently, segmentation models must ensure not only the semantic correctness of large-scale patches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Hao Wang , Keyan Hu , Xin Guo , Haifeng Li , Chao Tao

Recent works have shown the potential of diffusion models in computer vision and natural language processing. Apart from the classical supervised learning fields, diffusion models have also shown strong competitiveness in reinforcement…

Machine Learning · Computer Science 2023-06-09 Jifeng Hu , Yanchao Sun , Sili Huang , SiYuan Guo , Hechang Chen , Li Shen , Lichao Sun , Yi Chang , Dacheng Tao