English
Related papers

Related papers: Online Maximum Likelihood Estimation of the Parame…

200 papers

A streaming algorithm to compute the spectral proper orthogonal decomposition (SPOD) of stationary random processes is presented. As new data becomes available, an incremental update of the truncated eigenbasis of the estimated…

Fluid Dynamics · Physics 2019-01-14 Oliver T. Schmidt , Aaron Towne

Inference for streaming time-series is tightly coupled with the problem of Bayesian on-line state and parameter inference. In this paper we will introduce Dynamic Generalised Linear Models, the class of models often chosen to model…

Computation · Statistics 2016-09-01 Rui Vieira , Darren J. Wilkinson

Learning-augmented algorithms have received significant attention in recent years, particularly in the context of online optimization. Motivated by the high computational cost of generating predictions, a growing line of work studies the…

Data Structures and Algorithms · Computer Science 2026-05-27 Yongho Shin , Phanu Vajanopath

This paper focuses on designing a particle filter for randomly delayed measurements with an unknown latency probability. A generalized measurement model is adopted which includes measurements that are delayed randomly by an arbitrary but…

Signal Processing · Electrical Eng. & Systems 2018-03-22 Ranjeet Kumar Tiwari , Shovan Bhaumik , Paresh Date

A finite dimensional abstract approximation and convergence theory is developed for estimation of the distribution of random parameters in infinite dimensional discrete time linear systems with dynamics described by regularly dissipative…

Optimization and Control · Mathematics 2019-03-15 Melike Sirlanci , Susan E. Luczak , I. Gary Rosen

With the rapid development of data collection and aggregation technologies in many scientific disciplines, it is becoming increasingly ubiquitous to conduct large-scale or online regression to analyze real-world data and unveil real-world…

Methodology · Statistics 2021-03-22 Jinfeng Xu , Zhiliang Ying , Na Zhao

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi

The performance of ensemble-based data assimilation techniques that estimate the state of a dynamical system from partial observations depends crucially on the prescribed uncertainty of the model dynamics and of the observations. These are…

Computation · Statistics 2021-02-24 Tadeo Javier Cocucci , Manuel Pulido , Magdalena Lucini , Pierre Tandeo

Particle smoothing methods are used for inference of stochastic processes based on noisy observations. Typically, the estimation of the marginal posterior distribution given all observations is cumbersome and computational intensive. In…

Machine Learning · Computer Science 2017-05-24 H. -Ch. Ruiz , H. J. Kappen

An important issue in social network analysis refers to the development of algorithms for estimating optimal parameters of a social network model, using data available from the network itself. This entails solving an optimization problem.…

Statistics Theory · Mathematics 2018-09-18 Pietro Lenarda , Giorgio Gnecco , Massimo Riccaboni

This paper studies the complexity of the stochastic gradient algorithm for PCA when the data are observed in a streaming setting. We also propose an online approach for selecting the learning rate. Simulation experiments confirm the…

Statistics Theory · Mathematics 2018-04-04 Stephane Chretien , Christophe Guyeux , Zhen-Wai Olivier HO

We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation…

Statistics Theory · Mathematics 2017-12-05 Shogo H. Nakakita , Masayuki Uchida

This paper is concerned with online filtering of discretely observed nonlinear diffusion processes. Our approach is based on the fully adapted auxiliary particle filter, which involves Doob's $h$-transforms that are typically intractable.…

Machine Learning · Statistics 2023-05-31 Nicolas Chopin , Andras Fulop , Jeremy Heng , Alexandre H. Thiery

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm…

Artificial Intelligence · Computer Science 2025-03-26 Yunuo Zhang , Baiting Luo , Ayan Mukhopadhyay , Abhishek Dubey

This paper deals with estimating model parameters in graphical models. We reformulate it as an information geometric optimization problem and introduce a natural gradient descent strategy that incorporates additional meta parameters. We…

Machine Learning · Computer Science 2019-05-15 Eric Benhamou , Jamal Atif , Rida Laraki , David Saltiel

In this article we consider the development of unbiased estimators of the Hessian, of the log-likelihood function with respect to parameters, for partially observed diffusion processes. These processes arise in numerous applications, where…

Methodology · Statistics 2022-10-12 Neil K. Chada , Ajay Jasra , Fangyuan Yu

Single-particle traces of the diffusive motion of molecules, cells, or animals are by-now routinely measured, similar to stochastic records of stock prices or weather data. Deciphering the stochastic mechanism behind the recorded dynamics…

Statistical Mechanics · Physics 2023-09-14 Henrik Seckler , Janusz Szwabinski , Ralf Metzler

We consider the problem of statistical inference for the effective dynamics of multiscale diffusion processes with (at least) two widely separated characteristic time scales. More precisely, we seek to determine parameters in the effective…

Statistics Theory · Mathematics 2013-05-30 Sebastian Krumscheid , Grigorios A. Pavliotis , Serafim Kalliadasis

Network diffusion models are applicable to many socioeconomic interactions, yet network interaction is hard to observe or measure. Whenever the diffusion process is unobserved, the number of possible realizations of the latent matrix that…

Econometrics · Economics 2023-09-06 L. S. Sanna Stephan

We introduce a new online algorithm for expected log-likelihood maximization in situations where the objective function is multi-modal and/or has saddle points, that we term G-PFSO. The key element underpinning G-PFSO is a probability…

Machine Learning · Statistics 2022-07-07 Mathieu Gerber , Randal Douc