English
Related papers

Related papers: PIRF: Physics-Informed Reward Fine-Tuning for Diff…

200 papers

Diffusion models have shown remarkable progress in various generative tasks such as image and video generation. This paper studies the problem of leveraging pretrained diffusion models for performing discriminative tasks. Specifically, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Yinqi Li , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

Text-to-image diffusion models have recently emerged at the forefront of image generation, powered by very large-scale unsupervised or weakly supervised text-to-image training datasets. Due to their unsupervised training, controlling their…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Mihir Prabhudesai , Anirudh Goyal , Deepak Pathak , Katerina Fragkiadaki

Offline reinforcement learning (RL) methods harness previous experiences to derive an optimal policy, forming the foundation for pre-trained large-scale models (PLMs). When encountering tasks not seen before, PLMs often utilize several…

Machine Learning · Computer Science 2024-11-05 Shengchao Hu , Wanru Zhao , Weixiong Lin , Li Shen , Ya Zhang , Dacheng Tao

Discrete diffusion has emerged as a powerful framework for generative modeling in discrete domains, yet efficiently sampling from these models remains challenging. Existing sampling strategies often struggle to balance computation and…

Machine Learning · Computer Science 2025-11-12 Yixiu Zhao , Jiaxin Shi , Feng Chen , Shaul Druckmann , Lester Mackey , Scott Linderman

Sequential decision-making is desired to align with human intents and exhibit versatility across various tasks. Previous methods formulate it as a conditional generation process, utilizing return-conditioned diffusion models to directly…

Machine Learning · Computer Science 2024-10-11 Xudong Yu , Chenjia Bai , Haoran He , Changhong Wang , Xuelong Li

Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling. In this work, we extend these advances to weight space learning by leveraging…

Machine Learning · Computer Science 2025-10-17 Daniel Saragih , Deyu Cao , Tejas Balaji

Safe and effective motion planning is crucial for autonomous robots. Diffusion models excel at capturing complex agent interactions, a fundamental aspect of decision-making in dynamic environments. Recent studies have successfully applied…

Robotics · Computer Science 2025-07-18 Giwon Lee , Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

Diffusion models have emerged as powerful generative priors for solving PDE-constrained inverse problems. Compared to end-to-end approaches relying on massive paired datasets, explicitly decoupling the prior distribution of physical…

Numerical Analysis · Mathematics 2026-04-23 Haibo Liu , Guang Lin

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Diffusion MRI (dMRI) is an important neuroimaging technique with high acquisition costs. Deep learning approaches have been used to enhance dMRI and predict diffusion biomarkers through undersampled dMRI. To generate more comprehensive raw…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Juanhua Zhang , Ruodan Yan , Alessandro Perelli , Xi Chen , Chao Li

Restoring images afflicted by complex real-world degradations remains challenging, as conventional methods often fail to adapt to the unique mixture and severity of artifacts present. This stems from a reliance on indirect cues which poorly…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Xin Su , Chen Wu , Yu Zhang , Chen Lyu , Zhuoran Zheng

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

Inference-time controllable generation is essential for real-world applications of unconditional diffusion models. However, most existing techniques focus on individual samples, struggling in applications that require the sample population…

Machine Learning · Computer Science 2026-05-11 Hao Luan , See-Kiong Ng , Chun Kai Ling

In this work, we introduce PIPER: Primitive-Informed Preference-based Hierarchical reinforcement learning via Hindsight Relabeling, a novel approach that leverages preference-based learning to learn a reward model, and subsequently uses…

Machine Learning · Computer Science 2024-06-18 Utsav Singh , Wesley A. Suttle , Brian M. Sadler , Vinay P. Namboodiri , Amrit Singh Bedi

Diffusion alignment aims to optimize diffusion models for the downstream objective. While existing methods based on reinforcement learning or direct backpropagation achieve considerable success in maximizing rewards, they often suffer from…

Machine Learning · Computer Science 2026-03-09 Jaewoo Lee , Minsu Kim , Sanghyeok Choi , Inhyuck Song , Sujin Yun , Hyeongyu Kang , Woocheol Shin , Taeyoung Yun , Kiyoung Om , Jinkyoo Park

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

Reward models are crucial for aligning large language models (LLMs) with human values and intentions. Existing approaches follow either Generative (GRMs) or Discriminative (DRMs) paradigms, yet both suffer from limitations: GRMs typically…

Computation and Language · Computer Science 2026-03-03 Longze Chen , Lu Wang , Renke Shan , Ze Gong , Run Luo , Jiaming Li , Jing Luo , Qiyao Wang , Min Yang