English
Related papers

Related papers: Direct Preference Optimization-Enhanced Multi-Guid…

200 papers

Utility preference robust optimization (PRO) has recently been proposed to deal with optimal decision making problems where the decision maker's (DM) preference over gains and losses is ambiguous. In this paper, we take a step further to…

Optimization and Control · Mathematics 2024-03-11 Jian Hu , Dali Zhang , Huifu Xu , Sainan Zhang

Diffusion policies are a powerful paradigm for robotic control, but fine-tuning them with human preferences is fundamentally challenged by the multi-step structure of the denoising process. To overcome this, we introduce a Unified Markov…

Robotics · Computer Science 2026-02-03 Amitesh Vatsa , Zhixian Xie , Wanxin Jin

With the rapid development of AIGC technology, significant progress has been made in diffusion model-based technologies for text-to-image (T2I) and text-to-video (T2V). In recent years, a few studies have introduced the strategy of Direct…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Lifan Jiang , Boxi Wu , Jiahui Zhang , Xiaotong Guan , Shuang Chen

The integration of Diffusion Models into Intelligent Transportation Systems (ITS) is a substantial improvement in the detection of accidents. We present a novel hybrid model integrating guidance classification with diffusion techniques. By…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Siva Sai , Saksham Gupta , Vinay Chamola , Rajkumar Buyya

In this paper we describe a learned method of traffic scene generation designed to simulate the output of the perception system of a self-driving car. In our "Scene Diffusion" system, inspired by latent diffusion, we use a novel combination…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Ethan Pronovost , Kai Wang , Nick Roy

To enhance controllability in text-to-image generation, ControlNet introduces image-based control signals, while ControlNet++ improves pixel-level cycle consistency between generated images and the input control signal. To avoid the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Zonglin Lyu , Ming Li , Xinxin Liu , Chen Chen

Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the…

Networking and Internet Architecture · Computer Science 2024-12-02 Xinyu Yuan , Yan Qiao , Zhenchun Wei , Zeyu Zhang , Minyue Li , Pei Zhao , Rongyao Hu , Wenjing Li

Diffusion-based planning, learning, and control methods present a promising branch of powerful and expressive decision-making solutions. Given the growing interest, such methods have undergone numerous refinements over the past years.…

Machine Learning · Computer Science 2025-02-19 Dom Huh , Prasant Mohapatra

Predict-then-Optimize (PTO) pipelines are widely employed in computing and networked systems, where Machine Learning (ML) models are used to predict critical contextual information for downstream decision-making tasks such as cloud LLM…

Machine Learning · Computer Science 2026-02-04 Jiaqi Wen , Lei Fan , Jianyi Yang

We propose Diffusion Noise Optimization (DNO), a new method that effectively leverages existing motion diffusion models as motion priors for a wide range of motion-related tasks. Instead of training a task-specific diffusion model for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Korrawe Karunratanakul , Konpat Preechakul , Emre Aksan , Thabo Beeler , Supasorn Suwajanakorn , Siyu Tang

Post-training alignment of diffusion models relies on simplified signals, such as scalar rewards or binary preferences. This limits alignment with complex human expertise, which is hierarchical and fine-grained. To address this, we first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Chenye Meng , Zejian Li , Zhongni Liu , Yize Li , Changle Xie , Kaixin Jia , Ling Yang , Huanghuang Deng , Shiying Ding , Shengyuan Zhang , Jiayi Li , Lingyun Sun

In this paper, we introduce a novel approach for autonomous driving trajectory generation by harnessing the complementary strengths of diffusion probabilistic models (a.k.a., diffusion models) and transformers. Our proposed framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chen Yang , Yangfan He , Aaron Xuxiang Tian , Dong Chen , Jianhui Wang , Tianyu Shi , Arsalan Heydarian , Pei Liu

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Tao Zhang , Cheng Da , Kun Ding , Huan Yang , Kun Jin , Yan Li , Tingting Gao , Di Zhang , Shiming Xiang , Chunhong Pan

Recent progress in text-conditioned human motion generation has been largely driven by diffusion models trained on large-scale human motion data. Building on this progress, recent methods attempt to transfer such models for character…

Mobile robot navigation in dynamic environments with pedestrian traffic is a key challenge in the development of autonomous mobile service robots. Recently, deep reinforcement learning-based methods have been actively studied and have…

Robotics · Computer Science 2026-05-19 Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

Bridging the gap between diffusion models and human preferences is crucial for their integration into practical generative workflows. While optimizing downstream reward models has emerged as a promising alignment strategy, concerns arise…

Machine Learning · Computer Science 2026-03-02 Ziyi Zhang , Sen Zhang , Yibing Zhan , Yong Luo , Yonggang Wen , Dacheng Tao

Optimizing complex and high-dimensional black-box functions is ubiquitous in science and engineering fields. Unfortunately, the online evaluation of these functions is restricted due to time and safety constraints in most cases. In offline…

Machine Learning · Computer Science 2024-07-03 Taeyoung Yun , Sujin Yun , Jaewoo Lee , Jinkyoo Park

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

Machine Learning · Computer Science 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

Achieving safe and stylized trajectory planning in complex real-world scenarios remains a critical challenge for autonomous driving systems. This paper proposes the SDD Planner, a diffusion-based framework designed to effectively reconcile…

Robotics · Computer Science 2026-03-13 Shuo Pei , Yong Wang , Yuanchen Zhu , Chen Sun , Qin Li , Yanan Zhao , Huachun Tan

Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. Such information is coined as guidance. For example, in text-to-image synthesis, text…

Machine Learning · Computer Science 2024-03-05 Yuchen Wu , Minshuo Chen , Zihao Li , Mengdi Wang , Yuting Wei