English
Related papers

Related papers: Measuring and Decomposing Mode Separation via the …

200 papers

The concentration of measure phenomena were discovered as the mathematical background of statistical mechanics at the end of the XIX - beginning of the XX century and were then explored in mathematics of the XX-XXI centuries. At the…

Machine Learning · Computer Science 2018-03-20 A. N. Gorban , I. Y. Tyukin

Traditionally, systems governed by linear Partial Differential Equations (PDEs) are spatially discretized to exploit their algebraic structure and reduce the computational effort for controlling them. Due to beneficial insights of the PDEs,…

Systems and Control · Computer Science 2016-04-05 Saber Jafarizadeh

Spectroscopy infers the internal structure of physical systems by measuring their response to perturbations. We apply this principle to neural networks: perturbing the data distribution by upweighting a token $y$ in context $x$, we measure…

Machine Learning · Computer Science 2026-01-21 Andrew Gordon , Garrett Baker , George Wang , William Snell , Stan van Wingerden , Daniel Murfet

Discrete diffusion language models learn to reconstruct text from randomly masked inputs, yet under mild assumptions their denoiser already implements the exact Bayesian posterior over the original tokens. We prove that the expected…

Computation and Language · Computer Science 2025-07-15 Cooper Doyle

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

Machine Learning · Computer Science 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

We investigate the scattering and absorption of light by random ballistic aggregates of spherical monomers. We present a general measure for the porosity of an irregular particle. Three different classes of ballistic aggregates are…

Astrophysics · Physics 2009-11-13 Yue Shen , B. T. Draine , Eric T. Johnson

In this paper we provide new methodology for inference of the geometric features of a multivariate density in deconvolution. Our approach is based on multiscale tests to detect significant directional derivatives of the unknown density at…

Methodology · Statistics 2016-11-21 Konstantin Eckle , Nicolai Bissantz , Holger Dette

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

We propose a data-driven method to learn the time-dependent probability density of a multivariate stochastic process from sample paths, assuming that the initial probability density is known and can be evaluated. Our method uses a novel…

Machine Learning · Statistics 2025-06-19 Agnimitra Dasgupta , Javier Murgoitio-Esandi , Ali Fardisi , Assad A Oberai

In this work, we study an inverse problem of recovering a space-time dependent diffusion coefficient in the subdiffusion model from the distributed observation, where the mathematical model involves a Djrbashian-Caputo fractional derivative…

Numerical Analysis · Mathematics 2022-09-23 Bangti Jin , Zhi Zhou

While continuous diffusion has shown remarkable success in continuous domains such as image generation, its direct application to discrete data has underperformed compared to purely discrete formulations. This gap is counterintuitive, given…

Machine Learning · Computer Science 2025-10-30 Patrick Pynadath , Jiaxin Shi , Ruqi Zhang

How can we tell complex point clouds with different small scale characteristics apart, while disregarding global features? Can we find a suitable transformation of such data in a way that allows to discriminate between differences in this…

A method for estimating the Shannon differential entropy of multidimensional random variables using independent samples is described. The method is based on decomposing the distribution into a product of the marginal distributions and the…

Statistical Mechanics · Physics 2020-04-22 Gil Ariel , Yoram Louzoun

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

We propose a "decomposition method" to prove non-asymptotic bound for the convergence of empirical measures in various dual norms. The main point is to show that if one measures convergence in duality with sufficiently regular observables,…

Probability · Mathematics 2018-02-13 Benoît Kloeckner

Out-of-distribution (OOD) detection is critical for the safe deployment of machine learning systems in safety-sensitive domains. Diffusion models have recently emerged as powerful generative models, capable of capturing complex data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Shirin Shoushtari , Yi Wang , Xiao Shi , M. Salman Asif , Ulugbek S. Kamilov

We analyse a diffusion process whose invariant measure is the fractional polymer or Edwards measure for fractional Brownian motion in dimension $d\in\mathbb{N}$ with Hurst parameter $H\in(0,1)$ fulfilling $dH < 1$. We make use of a…

Probability · Mathematics 2017-03-31 Wolfgang Bock , Torben Fattler

High-resolution array detectors are widely used in single-particle tracking, but their performance is limited by excess noise from background light and dark current. As pixel resolution increases, the diminished signal per pixel exacerbates…

Quantum Physics · Physics 2025-12-16 Chao-Ning Hu , Jun Xin , Xiao-Ming Lu

This article focuses on covariance estimation for multi-study data. Popular approaches employ factor-analytic terms with shared and study-specific loadings that decompose the variance into (i) a shared low-rank component, (ii)…

Methodology · Statistics 2026-01-26 Lorenzo Mauri , Niccolò Anceschi , David B. Dunson