English
Related papers

Related papers: High-Dimensional Markov-switching Ordinary Differe…

200 papers

We investigate nonlinear regression for nonstationary sequential data. In most real-life applications such as business domains including finance, retail, energy and economy, timeseries data exhibits nonstationarity due to the temporally…

Machine Learning · Computer Science 2020-06-19 Fatih Ilhan , Oguzhan Karaahmetoglu , Ismail Balaban , Suleyman Serdar Kozat

Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities. While gradient-based discrete sampling has proven effective, it is susceptible to becoming trapped in local…

Machine Learning · Computer Science 2024-10-28 Patrick Pynadath , Riddhiman Bhattacharya , Arun Hariharan , Ruqi Zhang

This study introduces a novel approach for learning mixtures of Markov chains, a critical process applicable to various fields, including healthcare and the analysis of web users. Existing research has identified a clear divide in…

Machine Learning · Computer Science 2024-05-27 Fabian Spaeh , Konstantinos Sotiropoulos , Charalampos E. Tsourakakis

In this paper we study the asymptotic behavior of a stochastic approximation scheme on two timescales with set-valued drift functions and in the presence of non-additive iterate-dependent Markov noise. It is shown that the recursion on each…

Systems and Control · Computer Science 2016-11-21 Vinayaka Yaji , Shalabh Bhatnagar

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

We propose a unified framework that extends the inference methods for classical hidden Markov models to continuous settings, where both the hidden states and observations occur in continuous time. Two different settings are analyzed: hidden…

Methodology · Statistics 2021-06-18 Qingcan Wang , Weinan E

We obtain necessary and sufficient conditions for the regular variation of the variance of partial sums of functionals of discrete and continuous-time stationary Markov processes with normal transition operators. We also construct a class…

Probability · Mathematics 2014-05-13 George Deligiannidis , Magda Peligrad , Sergey Utev

This paper introduces the Neural Network for Nonlinear Hawkes processes (NNNH), a non-parametric method based on neural networks to fit nonlinear Hawkes processes. Our method is suitable for analyzing large datasets in which events exhibit…

Machine Learning · Statistics 2023-03-07 Sobin Joseph , Shashi Jain

The number of observable degrees of freedom is typically limited in experiments. Here, we consider discrete Markov networks in which an observer has access to a few visible transitions and the waiting times between these transitions.…

Statistical Mechanics · Physics 2025-09-26 Alexander M. Maier , Udo Seifert , Jann van der Meer

Motivated by applications arising in networked systems, this work examines controlled regime-switching systems that stem from a mean-variance formulation. A main point is that the switching process is a hidden Markov chain. An additional…

Optimization and Control · Mathematics 2014-01-21 Zhixin Yang , George Yin , Qing Zhang

Consider a sequence (indexed by n) of Markov chains Z^n in R^d characterized by transition kernels that approximately (in n) depend only on the rescaled state n^{-1} Z^n. Subject to a smoothness condition, such a family can be closely…

Probability · Mathematics 2009-08-17 Kamil Szczegot

We aim at characterizing viability, invariance and some reachability properties of controlled piecewise deterministic Markov processes (PDMPs). Using analytical methods from the theory of viscosity solutions, we establish criteria for…

Optimization and Control · Mathematics 2013-04-09 D. Goreac

There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the ubiquitous Hidden Markov Model for learning from sequential and time-series data. However, in…

Methodology · Statistics 2012-09-11 Matthew J. Johnson , Alan S. Willsky

Fueled in part by recent applications in neuroscience, the multivariate Hawkes process has become a popular tool for modeling the network of interactions among high-dimensional point process data. While evaluating the uncertainty of the…

Machine Learning · Statistics 2020-07-16 Xu Wang , Mladen Kolar , Ali Shojaie

Existing methods for differentiable structure learning in discrete data typically assume that the data are generated from specific structural equation models. However, these assumptions may not align with the true data-generating process,…

Machine Learning · Computer Science 2025-10-28 Chang Deng , Bryon Aragam

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is…

Computation · Statistics 2019-01-10 Andrew Golightly , Emma Bradley , Tom Lowe , Colin S. Gillespie

The efficient calculation of rare-event kinetics in complex dynamical systems, such as the rate and pathways of ligand dissociation from a protein, is a generally unsolved problem. Markov state models can systematically integrate ensembles…

Chemical Physics · Physics 2016-02-03 Benjamin Trendelkamp-Schroer , Frank Noe

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Even simply-defined, finite-state generators produce stochastic processes that require tracking an uncountable infinity of probabilistic features for optimal prediction. For processes generated by hidden Markov chains the consequences are…

Statistical Mechanics · Physics 2021-09-15 Alexandra M. Jurgens , James P. Crutchfield