English
Related papers

Related papers: A Variational Expectation-Maximisation Algorithm f…

200 papers

This work concerns estimation of linear autoregressive models with Markov-switching using expectation maximisation (E.M.) algorithm. Our method generalise the method introduced by Elliot for general hidden Markov models and avoid to use…

Methodology · Statistics 2008-02-22 Joseph Rynkiewicz

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Parameter estimation in logistic regression is a well-studied problem with the Newton-Raphson method being one of the most prominent optimization techniques used in practice. A number of monotone optimization methods including…

Computation · Statistics 2023-04-11 Nicholas C. Henderson , Zhongzhe Ouyang

In this work, a data-driven modeling framework of switched dynamical systems under time-dependent switching is proposed. The learning technique utilized to model system dynamics is Extreme Learning Machine (ELM). First, a method is…

Systems and Control · Electrical Eng. & Systems 2021-01-27 Weiming Xiang

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

This paper develops a new class of conditional Markov jump processes with regime switching and paths dependence. The key novel feature of the developed process lies on its ability to switch the transition rate as it moves from one state to…

Methodology · Statistics 2021-07-16 Budhi Surya

In this work, we study the problem of learning partially observed linear dynamical systems from a single sample trajectory. A major practical challenge in the existing system identification methods is the undesirable dependency of their…

Machine Learning · Computer Science 2020-10-09 Salar Fattahi

In this paper, we consider the stability analysis of large-scale distributed networked control systems with random communication delays between linearly interconnected subsystems. The stability analysis is performed in the Markov jump…

Systems and Control · Computer Science 2015-11-13 Kooktae Lee , Raktim Bhattacharya

The Expectation-Maximization (EM) algorithm is a popular choice for learning latent variable models. Variants of the EM have been initially introduced, using incremental updates to scale to large datasets, and using Monte Carlo (MC)…

Machine Learning · Statistics 2022-03-22 Belhal Karimi , Ping Li

A piecewise-deterministic Markov process is a stochastic process whose behavior is governed by an ordinary differential equation punctuated by random jumps occurring at random times. We focus on the nonparametric estimation problem of the…

Statistics Theory · Mathematics 2016-05-24 Romain Azaïs , Aurélie Muller-Gueudin

Stochastic Differential Equations (SDEs) are used as statistical models in many disciplines. However, intractable likelihood functions for SDEs make inference challenging, and we need to resort to simulation-based techniques to estimate and…

Methodology · Statistics 2014-08-12 Grant Schneider , Peter F. Craigmile , Radu Herbei

The methods of statistical physics are widely used for modelling complex networks. Building on the recently proposed Equilibrium Expectation approach, we derive a simple and efficient algorithm for maximum likelihood estimation (MLE) of…

Computation · Statistics 2020-02-12 Alexander Borisenko , Maksym Byshkin , Alessandro Lomi

We present a novel deep learning method for estimating time-dependent parameters in Markov processes through discrete sampling. Departing from conventional machine learning, our approach reframes parameter approximation as an optimization…

Motivated by reduction of computational complexity, this work develops sign-error adaptive filtering algorithms for estimating time-varying system parameters. Different from the previous work on sign-error algorithms, the parameters are…

Optimization and Control · Mathematics 2016-11-17 Araz Hashemi , G. Yin , Le Yi Wang

Continuous-time Markov chains (CTMCs) are popular modeling formalism that constitutes the underlying semantics for real-time probabilistic systems such as queuing networks, stochastic process algebras, and calculi for systems biology. Prism…

Machine Learning · Computer Science 2023-02-20 Giovanni Bacci , Anna Ingólfsdóttir , Kim G. Larsen , Raphaël Reynouard

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

Maximum likelihood estimation (MLE) of latent variable models is often recast as the minimization of a free energy functional over an extended space of parameters and probability distributions. This perspective was recently combined with…

Machine Learning · Computer Science 2024-06-05 Jen Ning Lim , Juan Kuntz , Samuel Power , Adam M. Johansen

We estimate a general mixture of Markov jump processes. The key novel feature of the proposed mixture is that the transition intensity matrices of the Markov processes comprising the mixture are entirely unconstrained. The Markov processes…

Methodology · Statistics 2022-04-12 Halina Frydman , Budhi Surya

Mixtures of linear dynamical systems (MoLDS) provide a path to model time-series data that exhibit diverse temporal dynamics across trajectories. However, its application remains challenging in complex and noisy settings, limiting its…

Machine Learning · Computer Science 2026-03-02 Lulu Gong , Shreya Saxena