English
Related papers

Related papers: Error bounds for gradient density estimation compu…

200 papers

We study parameter estimation for univariate stochastic differential equations with locally Lipschitz drift and H\"older continuous multiplicative diffusion, a class commonly arising in several applications. Existing inference methods…

Methodology · Statistics 2026-05-19 Bowen Fang , Dario Spanò , Massimiliano Tamborrino

This paper introduces a novel approach to enhance the performance of the stochastic gradient descent (SGD) algorithm by incorporating a modified decay step size based on $\frac{1}{\sqrt{t}}$. The proposed step size integrates a logarithmic…

Machine Learning · Computer Science 2023-09-06 M. Soheil Shamaee , S. Fathi Hafshejani

In this paper we present a general mathematical construction that allows us to define a parametric class of $H$-sssi stochastic processes (self-similar with stationary increments), which have marginal probability density function that…

Probability · Mathematics 2007-11-06 Antonio Mura , Francesco Mainardi

We study the asymptotic behaviour of different statistics for time series exhibiting long memory and nonstationarity. For processes with memory parameter $d\in(-1/2,3/2)$, we derive the joint limiting distribution of discrete Fourier…

Statistics Theory · Mathematics 2026-05-28 Mohamedou Ould Haye , Anne Philippe

Derivative-free optimization (DFO) is vital in solving complex optimization problems where only noisy function evaluations are available through an oracle. Within this domain, DFO via finite difference (FD) approximation has emerged as a…

Machine Learning · Computer Science 2025-02-19 Wang Du-Yi , Liang Guo , Liu Guangwu , Zhang Kun

We study the iteration complexity of stochastic gradient descent (SGD) for minimizing the gradient norm of smooth, possibly nonconvex functions. We provide several results, implying that the $\mathcal{O}(\epsilon^{-4})$ upper bound of…

Machine Learning · Computer Science 2021-07-30 Yoel Drori , Ohad Shamir

We investigate the statistical and computational limits of latent Diffusion Transformers (DiTs) under the low-dimensional linear latent space assumption. Statistically, we study the universal approximation and sample complexity of the DiTs…

Machine Learning · Statistics 2024-11-01 Jerry Yao-Chieh Hu , Weimin Wu , Zhao Song , Han Liu

Stochastic Gradient Descent (SGD) is commonly modeled as a Langevin process, assuming that minibatch noise acts as Brownian motion. However, this approximation relies on a continuous-time limit and a sqrt(eta) noise scaling that does not…

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

With the aim of generalizing histogram statistics to higher dimensional cases, density estimation via discrepancy based sequential partition (DSP) has been proposed to learn an adaptive piecewise constant approximation defined on a binary…

Machine Learning · Statistics 2025-12-23 Zhengyang Lei , Lirong Qu , Sihong Shao , Yunfeng Xiong

We consider the expansion of wave packets governed by the free Schr\"odinger equation. This seemingly simple task plays an important role in simulations of various quantum experiments and in particular in the field of matter-wave…

Computational Physics · Physics 2023-03-17 Jan-Frederik Mennemann , Sebastian Erne , Igor Mazets , Norbert J. Mauser

Accurate approximation of a real-valued function depends on two aspects of the available data: the density of inputs within the domain of interest and the variation of the outputs over that domain. There are few methods for assessing…

Numerical Analysis · Mathematics 2024-11-11 Andrew Gillette , Eugene Kur

We develop a theoretical approach to compute the conditioned spectral density of $N \times N$ non-invariant random matrices in the limit $N \rightarrow \infty$. This large deviation observable, defined as the eigenvalue distribution…

Disordered Systems and Neural Networks · Physics 2018-08-15 Isaac Pérez Castillo , Fernando L. Metz

We provide attainable analytical tools to estimate the error of flow-based generative models under the Wasserstein metric and to establish the optimal sampling iteration complexity bound with respect to dimension as $O(\sqrt{d})$. We show…

Machine Learning · Computer Science 2025-12-09 Xiangjun Meng , Zhongjian Wang

This paper proposes a new notion of distributional Input-to-State Stability (dISS) for dynamic systems evolving in probability spaces over a domain. Unlike other norm-based ISS concepts, we rely on the Wasserstein metric, which captures…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Guillem Pascual , Sonia Martínez

In 2D acoustic and elastodynamic problems the spatial variability of a constitutive parameter such as the mass density makes it difficult to employ boundary integral and domain integral techniques to solve the forward and inverse wave…

Geophysics · Physics 2019-03-25 Armand Wirgin

It is well-known that the reparameterisation gradient estimator, which exhibits low variance in practice, is biased for non-differentiable models. This may compromise correctness of gradient-based optimisation methods such as stochastic…

Machine Learning · Computer Science 2024-02-21 Dominik Wagner , Basim Khajwal , C. -H. Luke Ong

A number of fundamental quantities in statistical signal processing and information theory can be expressed as integral functions of two probability density functions. Such quantities are called density functionals as they map density…

Information Theory · Computer Science 2018-02-14 Alan Wisler , Visar Berisha , Andreas Spanias , Alfred O. Hero

We present two analytical formulae for estimating the sensitivity -- namely, the gradient or Jacobian -- at given realizations of an arbitrary-dimensional random vector with respect to its distributional parameters. The first formula…

Machine Learning · Statistics 2025-08-14 Pi-Yueh Chuang , Ahmed Attia , Emil Constantinescu

We investigate estimating scalar oscillatory integrals by integrating by parts in directions based on $(x_1 \partial_{x_1} f(x) ,..., x_n \partial_{x_n}f(x))$, where $f(x)$ is the phase function. We prove a theorem which provides estimates…

Classical Analysis and ODEs · Mathematics 2024-10-08 Michael Greenblatt