English
Related papers

Related papers: Error bounds for gradient density estimation compu…

200 papers

We prove a novel result wherein the density function of the gradients---corresponding to density function of the derivatives in one dimension---of a thrice differentiable function S (obtained via a random variable transformation of a…

Machine Learning · Statistics 2013-02-05 Karthik S. Gurumoorthy , Anand Rangarajan , Arunava Banerjee

We prove that the density function of the gradient of a sufficiently smooth function $S : \Omega \subset \mathbb{R}^d \rightarrow \mathbb{R}$, obtained via a random variable transformation of a uniformly distributed random variable, is…

Machine Learning · Statistics 2017-05-30 Karthik S. Gurumoorthy , Anand Rangarajan , John Corring

The complex wave representation (CWR) converts unsigned 2D distance transforms into their corresponding wave functions. Here, the distance transform S(X) appears as the phase of the wave function \phi(X)---specifically,…

Machine Learning · Statistics 2013-02-06 Karthik S. Gurumoorthy , Anand Rangarajan

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

For a sample of absolutely bounded i.i.d. random variables with a continuous density the cumulative distribution function of the sample variance is represented by a univariate integral over a Fourier series. If the density is a polynomial…

Statistics Theory · Mathematics 2008-10-10 T. Royen

The spectral density operator $\hat{\rho}(\omega)=\delta(\omega-\hat{H})$ plays a central role in linear response theory as its expectation value, the dynamical response function, can be used to compute scattering cross-sections. In this…

Quantum Physics · Physics 2020-08-19 Alessandro Roggero

Given i.i.d samples from some unknown continuous density on hyper-rectangle $[0, 1]^d$, we attempt to learn a piecewise constant function that approximates this underlying density non-parametrically. Our density estimate is defined on a…

Machine Learning · Statistics 2015-09-24 Kun Yang , Hao Su , Wing Hung Wang

We consider the approximation of the stationary distribution of the finite inclusion process with the Poisson-Dirichlet distribution. Using Stein's method, we derive an explicit bound for the approximation error, which is of order 1/N in…

Probability · Mathematics 2025-12-18 Han L. Gan

We study stochastic zeroth order gradient and Hessian estimators for real-valued functions in $\mathbb{R}^n$. We show that, via taking finite difference along random orthogonal directions, the variance of the stochastic finite difference…

Machine Learning · Computer Science 2023-06-07 Yasong Feng , Tianyu Wang

We revisit the classical problem of finding an approximately stationary point of the average of $n$ smooth and possibly nonconvex functions. The optimal complexity of stochastic first-order methods in terms of the number of gradient…

Machine Learning · Computer Science 2022-06-07 Alexander Tyurin , Lukang Sun , Konstantin Burlachenko , Peter Richtárik

Sinusoidal parameter estimation is a fundamental task in applications from spectral analysis to time-series forecasting. Estimating the sinusoidal frequency parameter by gradient descent is, however, often impossible as the error function…

Signal Processing · Electrical Eng. & Systems 2022-11-21 Ben Hayes , Charalampos Saitis , György Fazekas

In this paper, we analyze the accuracy of gradient estimates obtained by linear interpolation when the underlying function is subject to bounded measurement noise. The total gradient error is decomposed into a deterministic component…

Numerical Analysis · Mathematics 2025-07-29 Alejandro G. Marchetti , Dominique Bonvin

We study the estimation of the invariant density of additive fractional stochastic differential equations with Hurst parameter $H \in (0,1)$. We first focus on continuous observations and develop a kernel-based estimator achieving faster…

Statistics Theory · Mathematics 2025-12-23 Chiara Amorino , Eulalia Nualart , Fabien Panloup , Julian Sieber

The specification of a covariance function is of paramount importance when employing Gaussian process models, but the requirement of positive definiteness severely limits those used in practice. Designing flexible stationary covariance…

Computation · Statistics 2024-05-01 Paul G. Beckman , Christopher J. Geoga

We investigate the stationary measure $\pi$ of SDEs driven by additive fractional noise with any Hurst parameter and establish that $\pi$ admits a smooth Lebesgue density obeying both Gaussian-type lower and upper bounds. The proofs are…

Probability · Mathematics 2023-06-09 Xue-Mei Li , Fabien Panloup , Julian Sieber

Stochastic Differential Equations (SDEs) serve as a powerful modeling tool in various scientific domains, including systems science, engineering, and ecological science. While the specific form of SDEs is typically known for a given…

Methodology · Statistics 2024-02-27 Xin Cai , Jingyu Yang , Zhibao Li , Hongqiao Wang , Miao Huang

We build and study a data-driven procedure for the estimation of the stationary density f of an additive fractional SDE. To this end, we also prove some new concentrations bounds for discrete observations of such dynamics in stationary…

Probability · Mathematics 2020-03-12 Karine Bertin , Nicolas Klutchnikoff , Fabien Panloup , Maylis Varvenne

In this paper we focus on the linear functionals defining an approximate version of the gradient of a function. These functionals are often used when dealing with optimization problems where the computation of the gradient of the objective…

Optimization and Control · Mathematics 2021-05-21 Marco Boresta , Tommaso Colombo , Alberto De Santis , Stefano Lucidi

Density ratio estimation (DRE) is a useful tool for quantifying discrepancies between probability distributions, but existing approaches often involve a trade-off between estimation quality and computational efficiency. Classical direct DRE…

Machine Learning · Statistics 2026-04-14 Wei Chen , Qibin Zhao , John Paisley , Junmei Yang , Delu Zeng

For a large Hermitian matrix $A\in \mathbb{C}^{N\times N}$, it is often the case that the only affordable operation is matrix-vector multiplication. In such case, randomized method is a powerful way to estimate the spectral density (or…

Numerical Analysis · Mathematics 2015-11-24 Lin Lin
‹ Prev 1 2 3 10 Next ›