English
Related papers

Related papers: Technical Note on Relating Scores of Tilted Distri…

200 papers

In a large class of statistical inverse problems it is necessary to suppose that the transformation that is inverted is known. Although, in many applications, it is unrealistic to make this assumption, the problem is often insoluble without…

Statistics Theory · Mathematics 2008-12-18 Aurore Delaigle , Peter Hall , Alexander Meister

A rigid-motion scattering computes adaptive invariants along translations and rotations, with a deep convolutional network. Convolutions are calculated on the rigid-motion group, with wavelets defined on the translation and rotation…

Computer Vision and Pattern Recognition · Computer Science 2014-03-10 Laurent SIfre , Stéphane Mallat

We consider the robustness of score-based generative modeling to errors in the estimate of the score function. In particular, we show that Langevin dynamics is not robust to the L^2 errors (more generally L^p errors) in the estimate of the…

Machine Learning · Computer Science 2026-03-13 Daniel Yiming Cao , August Y. Chen , Karthik Sridharan , Yuchen Wu

The Central Limit Theorem states that, in the limit of a large number of terms, an appropriately scaled sum of independent random variables yields another random variable whose probability distribution tends to a stable distribution. The…

Data Analysis, Statistics and Probability · Physics 2024-04-08 Damián H. Zanette , Inés Samengo

This paper gives direct derivations of the differential equations and likelihood formulas of diffusion models assuming only knowledge of Gaussian distributions. A VAE analysis derives both forward and backward stochastic differential…

Machine Learning · Computer Science 2023-03-07 David McAllester

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems with a state-of-the-art performance for severely ill-posed problems by leveraging a powerful prior distribution learned from…

In this paper, we present a spatial rectifier to estimate surface normals of tilted images. Tilted images are of particular interest as more visual data are captured by arbitrarily oriented sensors such as body-/robot-mounted cameras.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Tien Do , Khiem Vuong , Stergios I. Roumeliotis , Hyun Soo Park

Diffusion models are state-of-the-art tools for various generative tasks. Yet training these models involves estimating high-dimensional score functions, which in principle suffers from the curse of dimensionality. It is therefore important…

Machine Learning · Computer Science 2025-09-30 Georg A. Gottwald , Shuigen Liu , Youssef Marzouk , Sebastian Reich , Xin T. Tong

Score-based models have achieved remarkable results in the generative modeling of many domains. By learning the gradient of smoothed data distribution, they can iteratively generate samples from complex distribution e.g. natural images.…

Artificial Intelligence · Computer Science 2024-03-27 Binxu Wang , John J. Vastola

This paper presents a one shot analysis of the lossy compression problem under average distortion constraints. We calculate the exact expected distortion of a random code. The result is given as an integral formula using a newly defined…

Information Theory · Computer Science 2020-05-18 Nir Elkayam , Meir Feder

We study the propagation of a ``pulled'' front with multiplicative noise that is created by a local perturbation of an unstable state. Unlike a front propagating into a metastable state, where a separation of time scales for sufficiently…

Condensed Matter · Physics 2009-10-31 Andrea Rocco , Ute Ebert , Wim van Saarloos

Score-based diffusion models have become a powerful framework for generative modeling, with score estimation as a central statistical bottleneck. Existing guarantees for score estimation largely focus on light-tailed targets or rely on…

Statistics Theory · Mathematics 2026-01-13 Yifeng Yu , Lu Yu

Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected…

Methodology · Statistics 2021-07-22 Zijian Guo , Domagoj Ćevid , Peter Bühlmann

We numerically investigate the impact of scale evolution on double parton distributions, which are needed to compute multiple hard scattering processes. Assuming correlations between longitudinal and transverse variables or between the…

High Energy Physics - Phenomenology · Physics 2015-06-18 Markus Diehl , Tomas Kasemets , Shane Keane

A class of probability distributions is characterized via equalities in law between two order statistics shifted by independent exponential variables. An explicit formula for the quintile function of the identified family of distributions…

Probability · Mathematics 2011-07-26 M. Ahsanullah , V. B. Nevzorov , George P. Yanev

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

Machine Learning · Computer Science 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

We study counterfactual distribution learning for high-dimensional outcomes whose counterfactual law may concentrate near lower-dimensional structure. Standard isotropic smoothing treats all ambient directions equally, leading to…

Methodology · Statistics 2026-05-26 Kwangho Kim

We construct a density estimator in the bivariate uniform deconvolution model. For this model we derive four inversion formulas to express the bivariate density that we want to estimate in terms of the bivariate density of the observations.…

Methodology · Statistics 2011-06-09 Martina Benešová , Bert van Es , Peter Tegelaar

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

Machine Learning · Computer Science 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

Score-based generative models (SGMs) have demonstrated remarkable synthesis quality. SGMs rely on a diffusion process that gradually perturbs the data towards a tractable distribution, while the generative model learns to denoise. The…

Machine Learning · Statistics 2022-03-28 Tim Dockhorn , Arash Vahdat , Karsten Kreis