English
Related papers

Related papers: LAMN property for hidden processes: the case of in…

200 papers

We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA)…

Methodology · Statistics 2014-08-15 Tatiana Xifara , Chris Sherlock , Samuel Livingstone , Simon Byrne , Mark Girolami

This paper deals with nonparametric maximum likelihood estimation for Gaussian locally stationary processes. Our nonparametric MLE is constructed by minimizing a frequency domain likelihood over a class of functions. The asymptotic behavior…

Statistics Theory · Mathematics 2011-11-10 Rainer Dahlhaus , Wolfgang Polonik

This paper is a survey of recent contributions on estimation in stochastic differential equations with mixed-effects. These models involve N stochastic differential equations with common drift and diffusion functions but random parameters…

Statistics Theory · Mathematics 2020-09-17 Maud Delattre

Likelihood-free inference for simulator-based statistical models has recently attracted a surge of interest, both in the machine learning and statistics communities. The primary focus of these research fields has been to approximate the…

Methodology · Statistics 2022-05-27 Jukka Corander , Ulpu Remes , Ida Holopainen , Timo Koski

The exact estimation of latent variable models with big data is known to be challenging. The latents have to be integrated out numerically, and the dimension of the latent variables increases with the sample size. This paper develops a…

Econometrics · Economics 2023-06-27 Ruben Loaiza-Maya , Didier Nibbering , Dan Zhu

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

Diffusion models have emerged as powerful generative approaches for missing-data imputation, yet most existing methods operate directly in data space and degrade when training data are heavily incomplete. We investigate whether shifting…

Machine Learning · Computer Science 2026-05-28 Alberte Heering Estad , Ignacio Peis , Jes Frellsen

This paper provides a precise error analysis for the maximum likelihood estimate $\hat{a}_{\text{ML}}(u_1^n)$ of the parameter $a$ given samples $u_1^n = (u_1, \ldots, u_n)'$ drawn from a nonstationary Gauss-Markov process $U_i = a U_{i-1}…

Information Theory · Computer Science 2021-03-29 Peida Tian , Victoria Kostina

We investigate the asymptotic behavior, in the long time limit, of the random homology associated to realizations of stochastic diffusion processes on a compact Riemannian manifold. In particular a rigidity result is established: if the…

Probability · Mathematics 2024-06-26 Artem Galkin , Mauro Mariani

We consider the problem of learning two families of time-evolving random measures from indirect observations. In the first model, the signal is a Fleming--Viot diffusion, which is reversible with respect to the law of a Dirichlet process,…

Statistics Theory · Mathematics 2014-11-19 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

Hierarchical learning models, such as mixture models and Bayesian networks, are widely employed for unsupervised learning tasks, such as clustering analysis. They consist of observable and hidden variables, which represent the given data…

Machine Learning · Statistics 2018-01-08 Keisuke Yamazaki

Stochastic differential equations of Langevin-diffusion form have received significant attention, thanks to their foundational role in both Bayesian sampling algorithms and optimization in machine learning. In the latter, they serve as a…

Optimization and Control · Mathematics 2024-05-14 Fabio V. Difonzo , Vyacheslav Kungurtsev , Jakub Marecek

Suppose that $n$ statistical units are observed, each following the model $Y(x_j)=m(x_j)+ \epsilon(x_j),\, j=1,...,N,$ where $m$ is a regression function, $0 \leq x_1 <...<x_N \leq 1$ are observation times spaced according to a sampling…

Statistics Theory · Mathematics 2011-07-21 Karim Benhenni , David Degras

We present precise asymptotics of the odometer function for the internal Diffusion Limited Aggregation model. These results provide a better understanding of this function whose importance was demonstrated by Levine and Peres. We derive a…

Probability · Mathematics 2009-11-19 Cyrille Lucas

We establish the asymptotic distribution of likelihood ratio tests (LRTs) in settings where some of the nuisance parameters are unidentifiable under the null hypothesis, parameters of interest lie on the boundary of the parameter space, and…

Statistics Theory · Mathematics 2026-05-13 Karl Oskar Ekvall , Ola Hössjer , Matteo Bottai , J. M. Patrik Albin

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

We introduce the Locally Linear Latent Variable Model (LL-LVM), a probabilistic model for non-linear manifold discovery that describes a joint distribution over observations, their manifold coordinates and locally linear maps conditioned on…

Machine Learning · Statistics 2015-12-02 Mijung Park , Wittawat Jitkrittum , Ahmad Qamar , Zoltan Szabo , Lars Buesing , Maneesh Sahani

We present the first diffusion-based framework that can learn an unknown distribution using only highly-corrupted samples. This problem arises in scientific applications where access to uncorrupted samples is impossible or expensive to…

Machine Learning · Computer Science 2023-05-31 Giannis Daras , Kulin Shah , Yuval Dagan , Aravind Gollakota , Alexandros G. Dimakis , Adam Klivans

A general method is presented for deriving the limiting behavior of estimators that are defined as the values of parameters optimizing an empirical criterion function. The asymptotic behavior of such estimators is typically deduced from…

Statistics Theory · Mathematics 2008-12-18 Peter Radchenko

The paper studies the asymptotic behaviour of weighted functionals of long-range dependent data over increasing observation windows. Various important statistics, including sample means, high order moments, occupation measures can be given…

Statistics Theory · Mathematics 2019-05-27 Tareq Alodat , Andriy Olenko