English
Related papers

Related papers: Improving Diffusion-Based Generative Models via Ap…

200 papers

Diffusion Transformers (DiTs) achieve state-of-the-art performance in high-fidelity image and video generation but suffer from expensive inference due to their iterative denoising structure. While prior methods accelerate sampling by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Dong Liu , Yanxuan Yu , Ben Lengerich , Ying Nian Wu

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is rectified flows,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Sangyun Lee , Zinan Lin , Giulia Fanti

We propose Diffusion-Sharpening, a fine-tuning approach that enhances downstream alignment by optimizing sampling trajectories. Existing RL-based fine-tuning methods focus on single training timesteps and neglect trajectory-level alignment,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Ye Tian , Ling Yang , Xinchen Zhang , Yunhai Tong , Mengdi Wang , Bin Cui

We address the computational and theoretical limitations of current distributional alignment methods for source-free unsupervised domain adaptation (SFUDA) using source class-mean features. In particular, we focus on estimating…

Machine Learning · Computer Science 2026-04-30 Yiming Zhang , Sitong Liu , Alex Cloninger

Developing a face anti-spoofing model that meets the security requirements of clients worldwide is challenging due to the domain gap between training datasets and diverse end-user test data. Moreover, for security and privacy reasons, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhuowei Li , Tianchen Zhao , Xiang Xu , Zheng Zhang , Zhihua Li , Xuanbai Chen , Qin Zhang , Alessandro Bergamo , Anil K. Jain , Yifan Xing

Reward fine-tuning has become a common approach for aligning pretrained diffusion and flow models with human preferences in text-to-image generation. Among reward-gradient-based methods, Adjoint Matching (AM) provides a principled…

Machine Learning · Computer Science 2026-05-19 Jeongwoo Shin , Dongsoo Shin , Yuchen Zhu , Wei Guo , Yongxin Chen , Joonseok Lee , Jaewoong Choi , Jaemoo Choi

Neural language models are often trained with maximum likelihood estimation (MLE), where the next word is generated conditioned on the ground-truth word tokens. During testing, however, the model is instead conditioned on previously…

Computation and Language · Computer Science 2020-10-14 Guoyin Wang , Chunyuan Li , Jianqiao Li , Hao Fu , Yuh-Chen Lin , Liqun Chen , Yizhe Zhang , Chenyang Tao , Ruiyi Zhang , Wenlin Wang , Dinghan Shen , Qian Yang , Lawrence Carin

Diffusion models have demonstrated excellent potential for generating diverse images. However, their performance often suffers from slow generation due to iterative denoising. Knowledge distillation has been recently proposed as a remedy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Lingjie Liu , Josh Susskind

Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is…

Diffusion models have achieved remarkable progress in the field of image generation due to their outstanding capabilities. However, these models require substantial computing resources because of the multi-step denoising process during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haowei Zhu , Dehua Tang , Ji Liu , Mingjie Lu , Jintu Zheng , Jinzhang Peng , Dong Li , Yu Wang , Fan Jiang , Lu Tian , Spandan Tiwari , Ashish Sirasao , Jun-Hai Yong , Bin Wang , Emad Barsoum

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xin Gao , Jiyao Liu , Guanghao Li , Yueming Lyu , Jianxiong Gao , Weichen Yu , Ningsheng Xu , Liang Wang , Caifeng Shan , Ziwei Liu , Chenyang Si

Diffusion models excel at producing high-quality samples but naively require hundreds of iterations, prompting multiple attempts to distill the generation process into a faster network. However, many existing approaches suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Zhengyang Geng , Ashwini Pokle , J. Zico Kolter

Though diffusion models excel in image generation, their step-by-step denoising leads to slow generation speeds. Consistency training addresses this issue with single-step sampling but often produces lower-quality generations and requires…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Fei Kong , Jinhao Duan , Lichao Sun , Hao Cheng , Renjing Xu , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

Foundation models encode rich representations that can be adapted to downstream tasks by fine-tuning. However, fine-tuning a model on one data distribution often degrades performance under distribution shifts. Current approaches to robust…

Machine Learning · Computer Science 2024-03-15 Caroline Choi , Yoonho Lee , Annie Chen , Allan Zhou , Aditi Raghunathan , Chelsea Finn

Image editing in rectified flow models remains challenging due to the fundamental trade-off between reconstruction fidelity and editing flexibility. While inversion-based methods suffer from trajectory deviation, recent inversion-free…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Marian Lupascu , Mihai-Sorin Stupariu

In autonomous driving tasks, trajectory prediction in complex traffic environments requires adherence to real-world context conditions and behavior multimodalities. Existing methods predominantly rely on prior assumptions or generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiming Xu , Hao Cheng , Monika Sester

Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Hancheng Ye , Jiakang Yuan , Renqiu Xia , Xiangchao Yan , Tao Chen , Junchi Yan , Botian Shi , Bo Zhang

Diffusion and flow matching models generate samples by learning time-dependent vector fields whose integration transports noise to data, requiring tens to hundreds of network evaluations at inference. We instead learn the transport map…

Machine Learning · Computer Science 2026-04-09 Xiao Shou

Deep neural networks are susceptible to human imperceptible adversarial perturbations. One of the strongest defense mechanisms is \emph{Adversarial Training} (AT). In this paper, we aim to address two predominant problems in AT. First,…

Machine Learning · Computer Science 2023-08-21 Jianhui Sun , Sanchit Sinha , Aidong Zhang