English
Related papers

Related papers: Unbiased Estimation of the Hessian for Partially O…

200 papers

We propose a Likelihood Matching approach for training diffusion models by first establishing an equivalence between the likelihood of the target data distribution and a likelihood along the sample path of the reverse diffusion. To…

Machine Learning · Statistics 2026-01-23 Lei Qian , Wu Su , Yanqi Huang , Song Xi Chen

We propose a novel method for drift estimation of multiscale diffusion processes when a sequence of discrete observations is given. For the Langevin dynamics in a two-scale potential, our approach relies on the eigenvalues and the…

Numerical Analysis · Mathematics 2022-04-15 Assyr Abdulle , Grigorios A. Pavliotis , Andrea Zanoni

We revisit the problem of estimating the parameters of a partially observed diffusion process, consisting of a hidden state process and an observed process, with a continuous time parameter. The estimation is to be done online, i.e. the…

Optimization and Control · Mathematics 2018-10-16 Simone Carlo Surace , Jean-Pascal Pfister

Diffusion models have become fundamental tools for modeling data distributions in machine learning. Despite their success, these models face challenges when generating data with extreme brightness values, as evidenced by limitations…

Machine Learning · Statistics 2026-04-10 Takuro Kutsuna

We consider a simple mean reverting diffusion process, with piecewise constant drift and diffusion coefficients, discontinuous at a fixed threshold. We discuss estimation of drift and diffusion parameters from discrete observations of the…

Statistics Theory · Mathematics 2024-03-12 Sara Mazzonetto , Paolo Pigato

For rare events described in terms of Markov processes, truly unbiased estimation of the rare event probability generally requires the avoidance of numerical approximations of the Markov process. Recent work in the exact and…

Statistics Theory · Mathematics 2021-11-08 James Hodgson , Adam M. Johansen , Murray Pollock

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

Machine Learning · Statistics 2025-02-10 Yifeng Yu , Lu Yu

We consider the problem of the estimation of the invariant distribution function of an ergodic diffusion process when the drift coefficient is unknown. The empirical distribution function is a natural estimator which is unbiased, uniformly…

Statistics Theory · Mathematics 2007-06-13 Ilia Negri

We present a method to infer the arbitrary space-dependent drift and diffusion of a nonlinear stochastic model driven by multiplicative fractional Gaussian noise from a single trajectory. Our method, fractional Onsager-Machlup optimisation…

Adaptation and Self-Organizing Systems · Physics 2023-11-07 Johannes A. Kassel , Benjamin Walter , Holger Kantz

We consider the problem of estimating a parameter associated to a Bayesian inverse problem. Treating the unknown initial condition as a nuisance parameter, typically one must resort to a numerical approximation of gradient of the…

Methodology · Statistics 2020-03-17 Ajay Jasra , Kody J. H. Law , Deng Lu

We consider the problem of static Bayesian inference for partially observed Levy-process models. We develop a methodology which allows one to infer static parameters and some states of the process, without a bias from the…

Computation · Statistics 2022-04-01 Hamza Ruzayqat , Ajay Jasra

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

Parameter estimation in diffusion processes from discrete observations up to a first-hitting time is clearly of practical relevance, but does not seem to have been studied so far. In neuroscience, many models for the membrane potential…

Probability · Mathematics 2014-03-06 Enrico Bibbona , Susanne Ditlevsen

Hypoelliptic diffusion processes can be used to model a variety of phenomena in applications ranging from molecular dynamics to audio signal analysis. We study parameter estimation for such processes in situations where we observe some…

Methodology · Statistics 2007-10-30 Y. Pokern , A. M. Stuart , P. Wiberg

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

In this work we study the diffusion of non-interacting overdamped particles, moving on unbiased disordered correlated potentials, subjected to Gaussian white noise. We obtain an exact expression for the diffusion coefficient which allows us…

Disordered Systems and Neural Networks · Physics 2015-03-19 Raul Salgado-Garcia , Cesar Maldonado

We provide a general method to analyze the asymptotic properties of a variety of estimators of continuous time diffusion processes when the data are not only discretely sampled in time but the time separating successive observations may…

Statistics Theory · Mathematics 2007-06-13 Yacine Ait-Sahalia , Per A. Mykland

We develop a general framework for generating estimators of a given quantity which are unbiased to a given order in the difference between the true value of the underlying quantity and the fiducial position in theory space around which we…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-22 Mathew S. Madhavacheril , Patrick McDonald , Neelima Sehgal , Anže Slosar

Diffusion models have found great success in generating high quality, natural samples of speech, but their potential for density estimation for speech has so far remained largely unexplored. In this work, we leverage an unconditional…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Danilo de Oliveira , Julius Richter , Jean-Marie Lemercier , Simon Welker , Timo Gerkmann

In this paper, a modification of the conventional approximations to the quasi-maximum likelihood method is introduced for the parameter estimation of diffusion processes from discrete observations. This is based on a convergent…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez