English
Related papers

Related papers: Mean-Square Analysis of Discretized It\^o Diffusio…

200 papers

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

Statistics Theory · Mathematics 2019-06-26 Matthew J. Holland

In this paper the filtering of partially observed diffusions, with discrete-time observations, is considered. It is assumed that only biased approximations of the diffusion can be obtained, for choice of an accuracy parameter indexed by…

Computation · Statistics 2015-10-19 Ajay Jasra , Kengo Kamatani , Kody J. H. Law , Yan Zhou

Markov chains and diffusion processes are indispensable tools in machine learning and statistics that are used for inference, sampling, and modeling. With the growth of large-scale datasets, the computational cost associated with simulating…

Statistics Theory · Mathematics 2017-08-31 Jonathan H. Huggins , James Zou

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

Machine Learning · Computer Science 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

Gaussian smoothed sliced Wasserstein distance has been recently introduced for comparing probability distributions, while preserving privacy on the data. It has been shown that it provides performances similar to its non-smoothed…

Machine Learning · Computer Science 2024-04-26 Mokhtar Z. Alaya , Alain Rakotomamonjy , Maxime Berar , Gilles Gasso

Under general assumptions on the target distribution $p^\star$, we establish a sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores, with optimal dependence on time and dimension. As applications, we…

Statistics Theory · Mathematics 2026-04-08 Arthur Stéphanovitch

Diffusion models achieve state-of-the-art generation quality across many applications, but their ability to capture rare or extreme events in heavy-tailed distributions remains unclear. In this work, we show that traditional diffusion and…

Machine Learning · Computer Science 2024-10-30 Kushagra Pandey , Jaideep Pathak , Yilun Xu , Stephan Mandt , Michael Pritchard , Arash Vahdat , Morteza Mardani

A new statistical estimation method, Independent Approximates (IAs), is defined and proven to enable closed-form estimation of the parameters of heavy-tailed distributions. Given independent, identically distributed samples from a…

Methodology · Statistics 2025-11-25 Kenric P. Nelson

Learning the tail behavior of a distribution is a notoriously difficult problem. By definition, the number of samples from the tail is small, and deep generative models, such as normalizing flows, tend to concentrate on learning the body of…

Machine Learning · Computer Science 2022-06-28 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

We study the long-time behavior of the scaled walker (particle) position associated with decoupled continuous-time random walk which is characterized by superheavy-tailed distribution of waiting times and asymmetric heavy-tailed…

Statistical Mechanics · Physics 2013-02-19 S. I. Denisov , Yu. S. Bystrik , H. Kantz

Two ubiquitous aspects of large-scale data analysis are that the data often have heavy-tailed properties and that diffusion-based or spectral-based methods are often used to identify and extract structure of interest. Perhaps surprisingly,…

Machine Learning · Computer Science 2010-05-11 Michael W. Mahoney , Hariharan Narayanan

To what extent can particulate random media be characterised using direct wave backscattering from a single receiver/source? Here, in a two dimensional setting, we show using a machine learning approach that both the particle radius and…

Computational Physics · Physics 2018-08-15 Artur L. Gower , Robert M. Gower , Jonathan Deakin , William J. Parnell , I. David Abrahams

We establish finite sample bounds for the error of standard and waste-free SMC samplers. Our results cover estimates of both expectations and normalising constants of the target distributions. We consider first an arbitrary sequence of…

Computation · Statistics 2026-04-15 Yvann Le Fay , Nicolas Chopin , Matti Vihola

Let $(X_t)_{t \ge 0}$ be solution of a one-dimensional stochastic differential equation. Our aim is to study the convergence rate for the estimation of the invariant density in intermediate regime, assuming that a discrete observation of…

Statistics Theory · Mathematics 2024-03-04 Chiara Amorino , Arnaud Gloter

In this paper, we propose a semi-implicit Euler scheme to discretize the stochastic nonlinear Maxwell equations with multiplicative Ito noise, which is implicit in the drift term and explicit in the diffusion term of the equations, in order…

Numerical Analysis · Mathematics 2018-03-01 Chuchu Chen , Jialin Hong , Lihai Ji

This paper introduces a full discretization procedure to solve wave beam propagation in random media modeled by a paraxial wave equation or an It\^o-Schr\"odinger stochastic partial differential equation. This method bears similarities with…

Numerical Analysis · Mathematics 2025-03-04 Guillaume Bal , Anjali Nair

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

The asymptotic behaviour of empirical measures has plenty of studies. However, the research on conditional empirical measures is limited. Being the development of Wang \cite{eW1}, under the quadratic Wasserstein distance, we investigate the…

Probability · Mathematics 2022-04-29 Huaiqian Li , Bingyao Wu

Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required…

Numerical Analysis · Mathematics 2017-10-10 Abdul-Lateef Haji-Ali , Fabio Nobile , Raúl Tempone , Sören Wolfers