English
Related papers

Related papers: Measuring and Decomposing Mode Separation via the …

200 papers

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

Machine Learning · Computer Science 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

We introduce a guided stochastic sampling method that augments sampling from diffusion models with physics-based guidance derived from partial differential equation (PDE) residuals and observational constraints, ensuring generated samples…

Machine Learning · Computer Science 2026-05-28 Andrew Millard , Fredrik Lindsten , Zheng Zhao

Diffusion models have emerged as powerful generative priors for solving inverse imaging problems. However, their practical deployment is hindered by the substantial computational cost of slow, multi-step sampling. Although Consistency…

Image and Video Processing · Electrical Eng. & Systems 2025-12-04 Amirreza Tanevardi , Pooria Abbas Rad Moghadam , Seyed Mohammad Eshtehardian , Sajjad Amini , Babak Khalaj

We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate…

Methodology · Statistics 2025-09-04 P. Algikar , P. Sharma , M. Netto , L. Mili

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

Discrete diffusion models are increasingly competitive for language modeling, yet it remains unclear how their denoising objectives organize learning. Although these objectives target the full data distribution, we show that the exact…

Machine Learning · Computer Science 2026-05-15 Adrian Müller , Antoine Gonon , Zebang Shen , Ya-Ping Hsieh , Niao He

In machine learning, the performance of a classifier depends on both the classifier model and the separability/complexity of datasets. To quantitatively measure the separability of datasets, we create an intrinsic measure -- the…

Machine Learning · Computer Science 2021-09-14 Shuyue Guan , Murray Loew

Spatial-mode demultiplexing (SPADE) has recently been adopted to measure the separation in the transverse plane between two incoherent point-like sources. It has been argued that this approach may yield extraordinary performances in the…

Long DNA molecules can be mapped by cutting them with restriction enzymes inside a narrow channel. Once cut, the individual fragments thus produced move away from each other due to diffusion and entropic effects. We investigate how long it…

Soft Condensed Matter · Physics 2025-06-11 Hanyang. Wang , Gary W Slater

For a sound field observed on a sensor array, compressive sensing (CS) reconstructs the direction-of-arrival (DOA) of multiple sources using a sparsity constraint. The DOA estimation is posed as an underdetermined problem by expressing the…

Statistics Theory · Mathematics 2023-07-19 Peter Gerstoft , Angeliki Xenaki , Christoph F. Mecklenbräuker

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on…

Machine Learning · Computer Science 2025-10-08 Hedi Zisling , Ilan Naiman , Nimrod Berman , Supasorn Suwajanakorn , Omri Azencot

Data-dependent metrics are powerful tools for learning the underlying structure of high-dimensional data. This article develops and analyzes a data-dependent metric known as diffusion state distance (DSD), which compares points using a…

Machine Learning · Statistics 2020-03-10 Lenore Cowen , Kapil Devkota , Xiaozhe Hu , James M. Murphy , Kaiyi Wu

Sampling from unnormalized densities using diffusion models has emerged as a powerful paradigm. However, while recent approaches that use least-squares `matching' objectives have improved scalability, they often necessitate significant…

Machine Learning · Computer Science 2026-03-03 Denis Blessing , Lorenz Richter , Julius Berner , Egor Malitskiy , Gerhard Neumann

This work is concerned with numerically recovering multiple parameters simultaneously in the subdiffusion model from one single lateral measurement on a part of the boundary, while in an incompletely known medium. We prove that the boundary…

Numerical Analysis · Mathematics 2023-07-10 Siyu Cen , Bangti Jin , Yikan Liu , Zhi Zhou

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim

The robustness of image segmentation has been an important research topic in the past few years as segmentation models have reached production-level accuracy. However, like classification models, segmentation models can be vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Othmane Laousy , Alexandre Araujo , Guillaume Chassagnon , Marie-Pierre Revel , Siddharth Garg , Farshad Khorrami , Maria Vakalopoulou

We consider the problem of sampling from the posterior distribution of a $d$-dimensional coefficient vector $\boldsymbol{\theta}$, given linear observations $\boldsymbol{y} = \boldsymbol{X}\boldsymbol{\theta}+\boldsymbol{\varepsilon}$. In…

Methodology · Statistics 2024-07-01 Andrea Montanari , Yuchen Wu

The Distributional Principal Autoencoder (DPA) combines distributionally correct reconstruction with principal-component-like interpretability of the encodings. In this work, we provide exact theoretical guarantees on both fronts. First, we…

Machine Learning · Statistics 2026-05-14 Andrej Leban

We examine the problem of selecting a small set of linear measurements for reconstructing high-dimensional signals. Well-established methods for optimizing such measurements include principal component analysis (PCA), independent component…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ling-Qi Zhang , Zahra Kadkhodaie , Eero P. Simoncelli , David H. Brainard