English
Related papers

Related papers: ReflectDrive-2: Reinforcement-Learning-Aligned Sel…

200 papers

End-to-end learning has emerged as a transformative paradigm in autonomous driving. However, the inherently multimodal nature of driving behaviors and the generalization challenges in long-tail scenarios remain critical obstacles to robust…

Robotics · Computer Science 2025-05-27 Rui Zhao , Yuze Fan , Ziguo Chen , Fei Gao , Zhenhai Gao

Recent advances in diffusion models have revolutionized text-guided image editing, yet existing editing methods face critical challenges in hyperparameter identification. To get the reasonable editing performance, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Chau Pham , Quan Dao , Mahesh Bhosale , Yunjie Tian , Dimitris Metaxas , David Doermann

Recently, the diffusion model has emerged as a powerful generative technique for robotic policy learning, capable of modeling multi-mode action distributions. Leveraging its capability for end-to-end autonomous driving is a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Bencheng Liao , Shaoyu Chen , Haoran Yin , Bo Jiang , Cheng Wang , Sixu Yan , Xinbang Zhang , Xiangyu Li , Ying Zhang , Qian Zhang , Xinggang Wang

Achieving safe and stylized trajectory planning in complex real-world scenarios remains a critical challenge for autonomous driving systems. This paper proposes the SDD Planner, a diffusion-based framework designed to effectively reconcile…

Robotics · Computer Science 2026-03-13 Shuo Pei , Yong Wang , Yuanchen Zhu , Chen Sun , Qin Li , Yanan Zhao , Huachun Tan

End-to-end autonomous driving via Vision-Language-Action (VLA) models demands a precarious balance between high-fidelity trajectory planning and efficient inference. Existing paradigms typically fall short: autoregressive (AR) VLAs are…

Computation and Language · Computer Science 2026-05-26 Kewei Zhang , Jin Wang , Sensen Gao , Chengyue Wu , Yulong Cao , Songyang Han , Boris Ivanovic , Langechuan Liu , Marco Pavone , Song Han , Daquan Zhou , Enze Xie

Reinforcement learning with stochastic optimal control offers a promising framework for diffusion fine-tuning, where a pre-trained diffusion model is optimized to generate paths that lead to a reward-tilted distribution. While these…

Machine Learning · Computer Science 2025-09-30 Sophia Tang , Yuchen Zhu , Molei Tao , Pranam Chatterjee

Standard masked discrete diffusion models face limitations in reasoning tasks due to their inability to correct their own mistakes on the masking path. Since they rely on a fixed number of denoising steps, they are unable to adjust their…

Machine Learning · Computer Science 2026-03-26 Gregor Kornhardt , Jannis Chemseddine , Christian Wald , Gabriele Steidl

We introduce Reflectance Diffusion, a new neural text-to-texture model capable of generating high-fidelity SVBRDF maps from textual descriptions. Our method leverages a tandem neural approach, consisting of two modules, to accurately model…

Graphics · Computer Science 2026-01-21 Bowen Xue , Giuseppe Claudio Guarnera , Shuang Zhao , Zahra Montazeri

We present a novel pipeline, ReflectEvo, to demonstrate that small language models (SLMs) can enhance meta introspection through reflection learning. This process iteratively generates self-reflection for self-training, fostering a…

Artificial Intelligence · Computer Science 2025-05-23 Jiaqi Li , Xinyi Dong , Yang Liu , Zhizhuo Yang , Quansen Wang , Xiaobo Wang , SongChun Zhu , Zixia Jia , Zilong Zheng

Skills have been introduced to offline reinforcement learning (RL) as temporal abstractions to tackle complex, long-horizon tasks, promoting consistent behavior and enabling meaningful exploration. While skills in offline RL are…

Machine Learning · Computer Science 2025-03-27 RuiXi Qiao , Jie Cheng , Xingyuan Dai , Yonglin Tian , Yisheng Lv

Instructional video editing applies edits to an input video using only text prompts, enabling intuitive natural-language control. Despite rapid progress, most methods still require fixed-length inputs and substantial compute. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mohammadreza Salehi , Mehdi Noroozi , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Alberto Gil Ramos , Abhinav Mehrotra

The goal of diffusion generative models is to align the learned distribution with the real data distribution through gradient score matching. However, inherent limitations in training data quality, modeling strategies, and architectural…

Machine Learning · Computer Science 2025-04-25 Lichen Bai , Masashi Sugiyama , Zeke Xie

Discrete diffusion models have achieved success in tasks like image generation and masked language modeling but face limitations in controlled content editing. We introduce DICE (Discrete Inversion for Controllable Editing), the first…

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

Computation and Language · Computer Science 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang

Autoregressive language models decode left-to-right with irreversible commitments, limiting revision during multi-step reasoning. We propose \textbf{VDLM}, a modular variable diffusion language model that separates semantic planning from…

Computation and Language · Computer Science 2026-02-19 Shuhui Qu

Training autonomous agents with sparse rewards is a long-standing problem in online reinforcement learning (RL), due to low data efficiency. Prior work overcomes this challenge by extracting useful knowledge from offline data, often…

Machine Learning · Computer Science 2024-06-07 Qianlan Yang , Yu-Xiong Wang

Trajectory prediction is critical for autonomous driving, enabling safe and efficient planning in dense, dynamic traffic. Most existing methods optimize prediction accuracy under fixed-length observations. However, real-world driving often…

Robotics · Computer Science 2026-03-12 Hao Zhou , Lu Qi , Jason Li , Jie Zhang , Yi Liu , Xu Yang , Mingyu Fan , Fei Luo

Visual content generation has advanced from single-image to multi-image workflows, yet existing agents remain largely plan-driven and lack systematic reflection mechanisms to correct mid-trajectory visual errors. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Jinxiang Lai , Wenzhe Zhao , Zexin Lu , Hualei Zhang , Qinyu Yang , Rongwei Quan , Zhimin Li , Shuai Shao , Song Guo , Qinglin Lu

World Model-based Reinforcement Learning (WMRL) enables sample efficient policy learning by reducing the need for online interactions which can potentially be costly and unsafe, especially for autonomous driving. However, existing world…

Robotics · Computer Science 2025-03-11 Anant Garg , K Madhava Krishna

Recent advances in image editing models have shown remarkable progress. A common architectural design couples a multimodal large language model (MLLM) encoder with a diffusion decoder, as seen in systems such as Step1X-Edit and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Fukun Yin , Shiyu Liu , Yucheng Han , Zhibo Wang , Peng Xing , Rui Wang , Wei Cheng , Yingming Wang , Aojie Li , Zixin Yin , Pengtao Chen , Xiangyu Zhang , Daxin Jiang , Xianfang Zeng , Gang Yu