English
Related papers

Related papers: Hold-out estimates of prediction models for Markov…

200 papers

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

We consider the problem of simultaneous estimation of a sequence of dependent parameters that are generated from a hidden Markov model. Based on observing a noise contaminated vector of observations from such a sequence model, we consider…

Methodology · Statistics 2020-03-16 Bowen Gang , Gourab Mukherjee , Wenguang Sun

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

This paper is a survey of recent results on the adaptive robust non parametric methods for the continuous time regression model with the semi - martingale noises with jumps. The noises are modeled by the L\'evy processes, the Ornstein --…

Statistics Theory · Mathematics 2019-09-17 Evgeny Pchelintsev , Serguei Pergamenshchikov

In this chapter we review stochastic modelling methods in climate science. First we provide a conceptual framework for stochastic modelling of deterministic dynamical systems based on the Mori-Zwanzig formalism. The Mori-Zwanzig equations…

Atmospheric and Oceanic Physics · Physics 2016-12-23 Georg A. Gottwald , Daan T. Crommelin , Christian L. E. Franzke

This paper investigates a change-point estimation problem in the context of high-dimensional Markov Random Field models. Change-points represent a key feature in many dynamically evolving network structures. The change-point estimate is…

Methodology · Statistics 2018-02-13 Sandipan Roy , Yves Atchade , George Michailidis

Adaptive time series forecasting is essential for prediction under regime changes. Several classical methods assume linear Gaussian state space model (LGSSM) with variances constant in time. However, there are many real-world processes that…

Machine Learning · Statistics 2024-02-23 Baptiste Abélès , Joseph de Vilmarest , Olivier Wintemberger

The Markov assumption in Markov Decision Processes (MDPs) is fundamental in reinforcement learning, influencing both theoretical research and practical applications. Existing methods that rely on the Bellman equation benefit tremendously…

Methodology · Statistics 2024-09-24 Chuyun Ye , Lixing Zhu , Ruoqing Zhu

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Time-homogeneous Markov chains are often used as disease progression models in studies of cost-effectiveness and optimal decision-making. Maximum likelihood estimation of these models can be challenging when data are collected at a time…

Methodology · Statistics 2022-09-26 Duncan Ermini Leaf

A hidden Markov process is a well known concept in information theory and is used for a vast range of applications such as speech recognition and error correction. We bridge between two disciplines, experimental physics and advanced…

Mesoscale and Nanoscale Physics · Physics 2015-06-24 Ido Kanter , Aviad Frydman , Asaf Ater

We propose an algorithm to impute and forecast a time series by transforming the observed time series into a matrix, utilizing matrix estimation to recover missing values and de-noise observed entries, and performing linear regression to…

Machine Learning · Computer Science 2019-04-29 Anish Agarwal , Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

Hidden Markov models are versatile tools for modeling sequential observations, where it is assumed that a hidden state process selects which of finitely many distributions generates any given observation. Specifically for time series of…

Methodology · Statistics 2019-01-11 Timo Adam , Roland Langrock , Christian H. Weiß

Method of moment estimators exhibit appealing statistical properties, such as asymptotic unbiasedness, for nonconvex problems. However, they typically require a large number of samples and are extremely sensitive to model misspecification.…

Computation · Statistics 2016-03-30 Dustin Tran , Minjae Kim , Finale Doshi-Velez

Dynamics of complex systems is studied by first considering a chaotic time series generated by Lorenz equations and adding noise to it. The trend (smooth behavior) is separated from fluctuations at different scales using wavelet analysis…

Chaotic Dynamics · Physics 2009-11-11 Dilip P. Ahalpara , Jitendra C. Parikh

The problem of appropriately matching items subject to compatibility constraints arises in a number of important applications. While most of the literature on matching theory focuses on a static setting with a fixed number of items, several…

Probability · Mathematics 2022-01-04 Céline Comte

Markov jump processes are continuous-time stochastic processes with a wide range of applications in both natural and social sciences. Despite their widespread use, inference in these models is highly non-trivial and typically proceeds via…

Machine Learning · Computer Science 2023-06-01 Patrick Seifner , Ramses J. Sanchez

We extend the feature selection methodology to dependent data and propose a novel time series predictor selection scheme that accommodates statistical dependence in a more typical i.i.d sub-sampling based framework. Furthermore, the…

Methodology · Statistics 2019-05-21 Avleen S. Bijral

Evaluating the predictive performance of a statistical model is commonly done using cross-validation. Among the various methods, leave-one-out cross-validation (LOOCV) is frequently used. Originally designed for exchangeable observations,…

Computation · Statistics 2025-07-04 Zhedong Liu , Janet Van Niekerk , Haavard Rue