English
Related papers

Related papers: Non-asymptotic performance analysis of importance …

200 papers

Diffusion models, which convert noise into new data instances by learning to reverse a Markov diffusion process, have become a cornerstone in contemporary generative modeling. While their practical power has now been widely recognized, the…

Machine Learning · Statistics 2024-03-08 Gen Li , Yuting Wei , Yuxin Chen , Yuejie Chi

A semilinear reaction-diffusion two-point boundary value problem, whose second-order derivative is multiplied by a small positive parameter $\eps^2$, is considered. It can have multiple solutions. An asymptotic expansion is constructed for…

Numerical Analysis · Mathematics 2013-03-20 Natalia Kopteva , Martin Stynes

We develop several statistical tests of the determinant of the diffusion coefficient of a stochastic differential equation, based on discrete observations on a time interval $[0,T]$ sampled with a time step $\Delta$. Our main contribution…

Statistics Theory · Mathematics 2024-03-22 Anna Melnykova , Patricia Reynaud-Bouret , Adeline Samson

Asymptotic expansions are derived as power series in a small coefficient entering a nonlinear multiplicative noise and a deterministic driving term in a nonlinear evolution equation. Detailed estimates on remainders are provided.

Probability · Mathematics 2013-12-10 Sergio Albeverio , Boubaker Smii

In this paper we present a generic framework for the asymptotic performance analysis of subspace-based parameter estimation schemes. It is based on earlier results on an explicit first-order expansion of the estimation error in the signal…

Performance · Computer Science 2012-09-17 Florian Roemer , Martin Haardt

Implicit samplers are algorithms for producing independent, weighted samples from multi-variate probability distributions. These are often applied in Bayesian data assimilation algorithms. We use Laplace asymptotic expansions to analyze two…

Numerical Analysis · Mathematics 2014-10-24 Jonathan Goodman , Kevin K. Lin , Matthias Morzfeld

We provide an asymptotic expansion of the value function of a multidimensional utility maximization problem from consumption with small non-linear price impact. In our model cross-impacts between assets are allowed. In the limit for small…

Analysis of PDEs · Mathematics 2020-06-25 Erhan Bayraktar , Thomas Caye , Ibrahim Ekren

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

We study maximum-likelihood-type estimation for diffusion processes when the coefficients are nonrandom and observation occurs in nonsynchronous manner. The problem of nonsynchronous observations is important when we consider the analysis…

Statistics Theory · Mathematics 2022-07-04 Teppei Ogihara

In this paper, by employing the asymptotic expansion method, we prove the existence and uniqueness of a smoothing solution for a time-dependent nonlinear singularly perturbed partial differential equation (PDE) with a small-scale parameter.…

Numerical Analysis · Mathematics 2022-10-11 Dmitrii Chaikovskii , Ye Zhang

Dynamical system models with delayed dynamics and small noise arise in a variety of applications in science and engineering. In many applications, stable equilibrium or periodic behavior is critical to a well functioning system. Sufficient…

Probability · Mathematics 2017-10-27 David Lipshutz

In this paper we extend our recent work on two-dimensional (2D) diffusive search-and-capture processes with multiple small targets (narrow capture problems) by considering an asymptotic expansion of the Laplace transformed probability flux…

Statistical Mechanics · Physics 2021-04-28 Paul C Bressloff

Via a simulation study we compare the finite sample performance of the deconvolution kernel density estimator in the supersmooth deconvolution problem to its asymptotic behaviour predicted by two asymptotic normality theorems. Our results…

Methodology · Statistics 2008-01-18 Bert van Es , Shota Gugushvili

The problem of parameter estimation by observations of inhomogeneous Poisson processes is considered. The method of moments estimator is studied and its stochastic expansion is obtained. This stochastic expansion is then used to obtain the…

Statistics Theory · Mathematics 2020-10-16 O. V. Chernoyarov , A. S. Dabye , F. N. Diop , Yu. A. Kutoyants

We develop a framework for non-asymptotic analysis of deterministic samplers used for diffusion generative modeling. Several recent works have analyzed stochastic samplers using tools like Girsanov's theorem and a chain rule variant of the…

Machine Learning · Computer Science 2023-03-07 Sitan Chen , Giannis Daras , Alexandros G. Dimakis

Second-order optimization methods exhibit fast convergence to critical points, however, in nonconvex optimization, these methods often require restrictive step-sizes to ensure a monotonically decreasing objective function. In the presence…

Optimization and Control · Mathematics 2024-10-11 Aayushya Agarwal , Larry Pileggi , Ronald Rohrer

We present a systematic study of moment evolution in multidimensional stochastic difference systems, focusing on characterizing systems whose low-order moments diverge in the neighborhood of a stable fixed point. We consider systems with a…

Mathematical Physics · Physics 2009-11-10 Dennis M. Wilkinson

The problem of parameter estimation by the observations of the two-state telegraph process in the presence of white Gaussian noise is considered. The properties of estimator of the method of moments are described in the asymptotics of large…

Statistics Theory · Mathematics 2015-09-10 Rafail Khasminskii , Yury Kutoyants

The second moment method is a linear acceleration technique which couples the transport equation to a diffusion equation with transport-dependent additive closures. The resulting low-order diffusion equation can be discretized independent…

Numerical Analysis · Mathematics 2024-09-18 Zachary K. Hardy , Jim E. Morel , Jan I. C. Vermaak