English
Related papers

Related papers: Optimal estimation of a factorizable density using…

200 papers

We provide theoretical convergence guarantees for score-based generative models (SGMs) such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of large-scale real-world generative models such as DALL$\cdot$E…

Machine Learning · Computer Science 2023-04-18 Sitan Chen , Sinho Chewi , Jerry Li , Yuanzhi Li , Adil Salim , Anru R. Zhang

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

This letter proposes a sparse diffusion steepest-descent algorithm for one bit compressed sensing in wireless sensor networks. The approach exploits the diffusion strategy from distributed learning in the one bit compressed sensing…

Machine Learning · Statistics 2016-01-05 Hadi Zayyani , Mehdi Korki , Farrokh Marvasti

Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. However, rather than merely generating designs that are natural, we often aim to optimize downstream reward functions while…

Scene flow estimation is an essential ingredient for a variety of real-world applications, especially for autonomous agents, such as self-driving cars and robots. While recent scene flow estimation approaches achieve a reasonable accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Yushan Zhang , Bastian Wandt , Maria Magnusson , Michael Felsberg

This paper proposes and analyzes a novel clustering algorithm that combines graph-based diffusion geometry with techniques based on density and mode estimation. The proposed method is suitable for data generated from mixtures of…

Machine Learning · Statistics 2019-01-01 Mauro Maggioni , James M. Murphy

Recently, diffusion distillation methods have compressed thousand-step teacher diffusion models into one-step student generators while preserving sample quality. Most existing approaches train the student model using a diffusive divergence…

Machine Learning · Computer Science 2025-08-29 Leyang Wang , Mingtian Zhang , Zijing Ou , David Barber

Diffusion-based algorithms have emerged as promising techniques for weight generation. However, existing solutions are limited by two challenges: generalizability and local target assignment. The former arises from the inherent lack of…

Machine Learning · Computer Science 2025-05-20 Yunchuan Guan , Yu Liu , Ke Zhou , Zhiqi Shen , Jenq-Neng Hwang , Lei Li

Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Justin Tebbe , Jawad Tayyub

With significant advancements in diffusion models, addressing the potential risks of dataset bias becomes increasingly important. Since generated outputs directly suffer from dataset bias, mitigating latent bias becomes a key factor in…

Machine Learning · Computer Science 2024-03-05 Yeongmin Kim , Byeonghu Na , Minsang Park , JoonHo Jang , Dongjun Kim , Wanmo Kang , Il-Chul Moon

Score-based models generate samples by mapping noise to data (and vice versa) via a high-dimensional diffusion process. We question whether it is necessary to run this entire process at high dimensionality and incur all the inconveniences…

Machine Learning · Computer Science 2023-02-28 Bowen Jing , Gabriele Corso , Renato Berlinghieri , Tommi Jaakkola

Recently, diffusion model have demonstrated impressive image generation performances, and have been extensively studied in various computer vision tasks. Unfortunately, training and evaluating diffusion models consume a lot of time and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Dohoon Ryu , Jong Chul Ye

This paper introduces a Factor Augmented Sparse Throughput (FAST) model that utilizes both latent factors and sparse idiosyncratic components for nonparametric regression. The FAST model bridges factor models on one end and sparse…

Statistics Theory · Mathematics 2023-11-28 Jianqing Fan , Yihong Gu

We derive a minimalist but powerful deterministic denoising-diffusion model. While denoising diffusion has shown great success in many domains, its underlying theory remains largely inaccessible to non-expert users. Indeed, an understanding…

Graphics · Computer Science 2023-05-08 Eric Heitz , Laurent Belcour , Thomas Chambon

We present a novel diffusion-based framework for synthesizing 2D vector fields from sparse, coherent inputs (i.e., streamlines) while maintaining physical plausibility. Our method employs a conditional denoising diffusion probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nguyen K. Phan , Ricardo Morales , Sebastian D. Espriella , Guoning Chen

We present a method to estimate dense depth by optimizing a sparse set of points such that their diffusion into a depth map minimizes a multi-view reprojection error from RGB supervision. We optimize point positions, depths, and weights…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Numair Khan , Min H. Kim , James Tompkin

Diffusion-based generative models are machine learning models that use diffusion processes to learn the probability distribution of high-dimensional data. In recent years, they have become extremely successful in generating multimedia…

Disordered Systems and Neural Networks · Physics 2025-02-12 Stefano Bae , Enzo Marinari , Federico Ricci-Tersenghi

It is well known that training a denoising score-based diffusion models requires tens of thousands of epochs and a substantial number of image data to train the model. In this paper, we propose to increase the efficiency in training…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Andrew S. Na , William Gao , Justin W. L. Wan

Score-based diffusion models are a class of generative models whose dynamics is described by stochastic differential equations that map noise into data. While recent works have started to lay down a theoretical foundation for these models,…

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, while methods based on…

Machine Learning · Statistics 2018-06-06 Hiroaki Sasaki , Aapo Hyvärinen