English
Related papers

Related papers: Modelling Stochastic Inflow Patterns to a Reservoi…

200 papers

We propose a Neural Hidden Markov Model (HMM) with Adaptive Granularity Attention (AGA) for high-frequency order flow modeling. The model addresses the challenge of capturing multi-scale temporal dynamics in financial markets, where…

Statistical Finance · Quantitative Finance 2026-03-24 Tianzuo Hu

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

Hidden Markov models (HMM) have been widely used by scientists to model stochastic systems: the underlying process is a discrete Markov chain and the observations are noisy realizations of the underlying process. Determining the number of…

Statistics Theory · Mathematics 2024-07-18 Yang Chen , Cheng-Der Fuh , Chu-Lan Michael Kao

Regime-switching models, in particular Hidden Markov Models (HMMs) where the switching is driven by an unobservable Markov chain, are widely-used in financial applications, due to their tractability and good econometric properties. In this…

Statistical Finance · Quantitative Finance 2016-02-18 Vikram Krishnamurthy , Elisabeth Leoff , Jörn Sass

This paper is concerned with the computational complexity of learning the Hidden Markov Model (HMM). Although HMMs are some of the most widely used tools in sequential and time series modeling, they are cryptographically hard to learn in…

Machine Learning · Computer Science 2024-02-27 Sham M. Kakade , Akshay Krishnamurthy , Gaurav Mahajan , Cyril Zhang

Analysis of sequential event data has been recognized as one of the essential tools in data modeling and analysis field. In this paper, after the examination of its technical requirements and issues to model complex but practical situation,…

Artificial Intelligence · Computer Science 2015-08-21 Hiromi Narimatsu , Hiroyuki Kasai

Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite…

Statistics Theory · Mathematics 2009-11-20 Sofia Andersson , Tobias Rydén

There is an increase in interest to model driving maneuver patterns via the automatic unsupervised clustering of naturalistic sequential kinematic driving data. The patterns learned are often used in transportation research areas such as…

Machine Learning · Statistics 2023-11-14 Matthew Aguirre , Wenbo Sun , Jionghua , Jin , Yang Chen

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain.…

Probability · Mathematics 2021-07-21 Nicole Bäuerle , Igor Gilitschenski , Uwe D. Hanebeck

To track rapid changes within our water sector, Global Water Models (GWMs) need to realistically represent hydrologic systems' response patterns - such as baseflow fraction - but are hindered by their limited ability to learn from data.…

This paper studies the synthesis of an active perception policy that maximizes the information leakage of the initial state in a stochastic system modeled as a hidden Markov model (HMM). Specifically, the emission function of the HMM is…

Systems and Control · Electrical Eng. & Systems 2024-09-26 Chongyang Shi , Shuo Han , Michael Dorothy , Jie Fu

There are many situations in which it would be beneficial for a robot to have predictive abilities similar to those of rational humans. Some of these situations include collaborative robots, robots in adversarial situations, and for dynamic…

Robotics · Computer Science 2014-12-02 Alan J. Hamlet , Carl D. Crane

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

Traditional Markov chain Monte Carlo (MCMC) sampling of hidden Markov models (HMMs) involves latent states underlying an imperfect observation process, and generates posterior samples for top-level parameters concurrently with nuisance…

Computation · Statistics 2016-01-13 Daniel Turek , Perry de Valpine , Christopher J. Paciorek

Precipitation is a large-scale, spatio-temporally heterogeneous phenomenon, with frequent anomalies exhibiting unusually high or low values. We use Markov Random Fields (MRFs) to detect spatio-temporally coherent anomalies in gridded annual…

Applications · Statistics 2017-11-01 Adway Mitra , Ashwin K. Seshadri

In this letter we borrow from the inference techniques developed for unbounded state-cardinality (nonparametric) variants of the HMM and use them to develop a tuning-parameter free, black-box inference procedure for Explicit-state-duration…

Machine Learning · Statistics 2015-06-04 Michael Dewar , Chris Wiggins , Frank Wood

A nonhomogeneous hidden semi-Markov model is proposed to segment toroidal time series according to a finite number of latent regimes and, simultaneously, estimate the influence of time-varying covariates on the process' survival under each…

Applications · Statistics 2023-12-25 Francesco Lagona , Marco Mingione

Stochastic volatility models are the backbone of financial engineering. We study both continuous time diffusions as well as discrete time models. We propose two novel approaches to estimating stochastic volatility diffusions, one using…

Quantum Physics · Physics 2025-07-30 Eric Ghysels , Jack Morgan , Hamed Mohammadbagherpoor

Territorial control is a key aspect shaping the dynamics of civil war. Despite its importance, we lack data on territorial control that are fine-grained enough to account for subnational spatio-temporal variation and that cover a large set…

Applications · Statistics 2018-01-23 Therese Anders , Hong Xu , Cheng Cheng , T. K. Satish Kumar