English
Related papers

Related papers: Generalized Discrete Diffusion with Self-Correctio…

200 papers

Diffusion models have demonstrated remarkable progress in image generation quality, especially when guidance is used to control the generative process. However, guidance requires a large amount of image-annotation pairs for training and is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Vincent Tao Hu , David W Zhang , Yuki M. Asano , Gertjan J. Burghouts , Cees G. M. Snoek

Foundation models enable prompt-based classifiers for zero-shot and few-shot learning. Nonetheless, the conventional method of employing fixed prompts suffers from distributional shifts that negatively impact generalizability to unseen…

Machine Learning · Computer Science 2024-10-29 Yingjun Du , Gaowen Liu , Yuzhang Shang , Yuguang Yao , Ramana Kompella , Cees G. M. Snoek

A primary challenge when deploying speaker recognition systems in real-world applications is performance degradation caused by environmental mismatch. We propose a diffusion-based method that takes speaker embeddings extracted from a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 KiHyun Nam , Jungwoo Heo , Jee-weon Jung , Gangin Park , Chaeyoung Jung , Ha-Jin Yu , Joon Son Chung

Guidance provides a simple and effective framework for posterior sampling by steering the generation process towards the desired distribution. When modeling discrete data, existing approaches mostly focus on guidance with the first-order…

Machine Learning · Computer Science 2026-04-16 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

Recent advances in powerful pre-trained diffusion models encourage the development of methods to improve the sampling performance under well-trained diffusion models. This paper introduces Diffusion Rejection Sampling (DiffRS), which uses a…

Machine Learning · Computer Science 2024-05-29 Byeonghu Na , Yeongmin Kim , Minsang Park , Donghyeok Shin , Wanmo Kang , Il-Chul Moon

We propose a unified diffusion model-based correction and super-resolution method to enhance the fidelity and resolution of diverse low-quality data through a two-step pipeline. First, the correction step employs a novel enhanced stochastic…

Numerical Analysis · Mathematics 2025-05-15 Wuzhe Xu , Yulong Lu , Sifan Wang , Tong-Rui Liu

Flow matching has emerged as a promising framework for training generative models, demonstrating impressive empirical performance while offering relative ease of training compared to diffusion-based models. However, this method still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Quan Dao , Hao Phung , Trung Dao , Dimitris Metaxas , Anh Tran

Subject-driven image generation (SDIG) aims to manipulate specific subjects within images while adhering to textual instructions, a task crucial for advancing text-to-image diffusion models. SDIG requires reconciling the tension between…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Jibai Lin , Bo Ma , Yating Yang , Xi Zhou , Rong Ma , Turghun Osman , Ahtamjan Ahmat , Rui Dong , Lei Wang

Personalizing large-scale diffusion models poses serious privacy risks, especially when adapting to small, sensitive datasets. A common approach is to fine-tune the model using differentially private stochastic gradient descent (DP-SGD),…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Pura Peetathawatchai , Wei-Ning Chen , Berivan Isik , Sanmi Koyejo , Albert No

Low-dose computed tomography (CT) images suffer from noise and artifacts due to photon starvation and electronic noise. Recently, some works have attempted to use diffusion models to address the over-smoothness and training instability…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Qi Gao , Zilong Li , Junping Zhang , Yi Zhang , Hongming Shan

While diffusion models excel at generating continuous data such as images, adapting them to discrete tasks has relied on indirect approaches that either operate in continuous embedding spaces or use token masking mechanisms, both of which…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiao Li , Jiaqi Zhang , Shuxiang Zhang , Tianshui Chen , Liang Lin , Guangrun Wang

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

Diffusion models have shown remarkable promise for image restoration by leveraging powerful priors. Prominent methods typically frame the restoration problem within a Bayesian inference framework, which iteratively combines a denoising step…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Hongjie Wu , Mingqin Zhang , Linchao He , Ji-Zhe Zhou , Jiancheng Lv

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

While diffusion-based models have shown remarkable generative capabilities in static settings, their extension to continual learning (CL) scenarios remains fundamentally constrained by Generative Catastrophic Forgetting (GCF). We observe…

Machine Learning · Computer Science 2025-08-25 Jingren Liu , Shuning Xu , Yun Wang , Zhong Ji , Xiangyu Chen

Learning world models can teach an agent how the world works in an unsupervised manner. Even though it can be viewed as a special case of sequence modeling, progress for scaling world models on robotic applications such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Lunjun Zhang , Yuwen Xiong , Ze Yang , Sergio Casas , Rui Hu , Raquel Urtasun

We introduce Posterior Distillation Sampling (PDS), a novel optimization method for parametric image editing based on diffusion models. Existing optimization-based methods, which leverage the powerful 2D prior of diffusion models to handle…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juil Koo , Chanho Park , Minhyuk Sung

Recent deep metric learning (DML) methods typically leverage solely class labels to keep positive samples far away from negative ones. However, this type of method normally ignores the crucial knowledge hidden in the data (e.g., intra-class…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Zelong Zeng , Fan Yang , Hong Liu , Shin'ichi Satoh

Continuous diffusion models have demonstrated remarkable performance in data generation across various domains, yet their efficiency remains constrained by two critical limitations: (1) the local adjacency structure of the forward Markov…

Machine Learning · Statistics 2025-05-29 Xunpeng Huang , Yingyu Lin , Nikki Lijing Kuang , Hanze Dong , Difan Zou , Yian Ma , Tong Zhang

The performance of pre-trained masked diffusion models is often constrained by their sampling procedure, which makes decisions irreversible and struggles in low-step generation regimes. We introduce a novel sampling algorithm that works…