English
Related papers

Related papers: Quasi-likelihood-based EM algorithm for regime-swi…

200 papers

The estimation of signal parameters using quantized data is a recurrent problem in electrical engineering. As an example, this includes the estimation of a noisy constant value and of the parameters of a sinewave, that is, its amplitude,…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Antonio Moschitta , Johan Schoukens , Paolo Carbone

We study the construction of the theoretical foundation of model comparison for ergodic stochastic differential equation (SDE) models and an extension of the applicable scope of the conventional Bayesian information criterion. Different…

Statistics Theory · Mathematics 2020-04-28 Shoichi Eguchi , Yuma Uehara

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM…

Machine Learning · Statistics 2015-01-28 Zhaoran Wang , Quanquan Gu , Yang Ning , Han Liu

We propose an algorithm for approximating the solution of a strongly oscillating SDE, that is, a system in which some ergodic state variables evolve quickly with respect to the other variables. The algorithm profits from homogenization…

Probability · Mathematics 2015-03-19 Camilo Andrés García Trillos

Neural differential equations predict the derivative of a stochastic process. This allows irregular forecasting with arbitrary time-steps. However, the expressive temporal flexibility often comes with a high sensitivity to noise. In…

Machine Learning · Computer Science 2023-02-07 Stav Belogolovsky , Ido Greenberg , Danny Eitan , Shie Mannor

Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur…

Methodology · Statistics 2022-09-19 Yu Gu , Donglin Zeng , Gerardo Heiss , D. Y. Lin

Although stochastic approximation learning methods have been widely used in the machine learning literature for over 50 years, formal theoretical analyses of specific machine learning algorithms are less common because stochastic…

Machine Learning · Statistics 2017-04-21 Richard M. Golden

Quantum Error Mitigation (EM) is a collection of strategies to reduce errors on noisy intermediate scale quantum (NISQ) devices on which proper quantum error correction is not feasible. One of such strategies aimed at mitigating noise…

The numerical solution of stochastic partial differential equations (SPDE) presents challenges not encountered in the simulation of PDEs or SDEs. Indeed, the roughness of the noise in conjunction with nonlinearities in the drift typically…

Probability · Mathematics 2016-08-03 Nawaf Bou-Rabee

A general formalism is developed to construct a Markov chain model that converges to a one-dimensional map in the infinite population limit. Stochastic fluctuations are therefore internal to the system and not externally specified. For…

Statistical Mechanics · Physics 2014-09-15 Joseph D. Challenger , Duccio Fanelli , Alan J. McKane

This work aims at making a comprehensive contribution in the general area of parametric inference for discretely observed diffusion processes. Established approaches for likelihood-based estimation invoke a time-discretisation scheme for…

Methodology · Statistics 2024-01-30 Yuga Iguchi , Alexandros Beskos , Matthew M. Graham

This work aims to estimate the drift and diffusion functions in stochastic differential equations (SDEs) driven by a particular class of L\'evy processes with finite jump intensity, using neural networks. We propose a framework that…

Machine Learning · Statistics 2025-07-10 Jose-Hermenegildo Ramirez-Gonzalez , Ying Sun

We develop the method of stochastic modified equations (SME), in which stochastic gradient algorithms are approximated in the weak sense by continuous-time stochastic differential equations. We exploit the continuous formulation together…

Machine Learning · Computer Science 2017-06-21 Qianxiao Li , Cheng Tai , Weinan E

Models incorporating uncertain inputs, such as random forces or material parameters, have been of increasing interest in PDE-constrained optimization. In this paper, we focus on the efficient numerical minimization of a convex and smooth…

Optimization and Control · Mathematics 2021-06-18 Caroline Geiersbach , Winnifried Wollner

Stochastic approximation is a class of algorithms that update a vector iteratively, incrementally, and stochastically, including, e.g., stochastic gradient descent and temporal difference learning. One fundamental challenge in analyzing a…

Machine Learning · Computer Science 2025-11-06 Shuze Daniel Liu , Shuhang Chen , Shangtong Zhang

We consider the problem of parameter estimation for a stochastic McKean-Vlasov equation, and the associated system of weakly interacting particles. We study two cases: one in which we observe multiple independent trajectories of the…

Statistics Theory · Mathematics 2022-11-28 Louis Sharrock , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

We address the problem of simulation and parameter inference for chemical reaction networks described by the chemical Langevin equation, a stochastic differential equation (SDE) representation of the dynamics of the chemical species. This…

Methodology · Statistics 2025-08-18 Petar Jovanovski , Andrew Golightly , Umberto Picchini , Massimiliano Tamborrino

We discuss the possibility of applying some standard statistical methods (the least square method, the maximum likelihood method, the method of statistical moments for estimation of parameters) to deterministically chaotic low-dimensional…

Data Analysis, Statistics and Probability · Physics 2009-11-10 V. F. Pisarenko , D. Sornette

We address the problem of signal denoising via transform-domain shrinkage based on a novel $\textit{risk}$ criterion called the minimum probability of error (MPE), which measures the probability that the estimated parameter lies outside an…

Applications · Statistics 2020-02-19 Jishnu Sadasivan , Subhadip Mukherjee , Chandra Sekhar Seelamantula