English
Related papers

Related papers: Topologies of Stochastic Markov Models: Computatio…

200 papers

This paper presents a comprehensive analysis of a broad range of variations of the stochastic proximal point method (SPPM). Proximal point methods have attracted considerable interest owing to their numerical stability and robustness…

Optimization and Control · Mathematics 2024-05-28 Peter Richtárik , Abdurakhmon Sadiev , Yury Demidovich

We present a numerical method to compute the survival function and the moments of the exit time for a piecewise-deterministic Markov process (PDMP). Our approach is based on the quantization of an underlying discrete-time Markov chain…

Probability · Mathematics 2011-08-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Recurrent temporal dynamics is a phenomenon observed frequently in high-dimensional complex systems and its detection is a challenging task. Recurrence quantification analysis utilizing recurrence plots may extract such dynamics, however it…

Data Analysis, Statistics and Probability · Physics 2016-06-22 Peter beim Graben , Kristin K. Sellers , Flavio Fröhlich , Axel Hutt

Autonomous systems with machine learning-based perception can exhibit unpredictable behaviors that are difficult to quantify, let alone verify. Such behaviors are convenient to capture in probabilistic models, but probabilistic model…

Logic in Computer Science · Computer Science 2022-03-17 Matthew Cleaveland , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

We consider off-policy temporal-difference (TD) learning methods for policy evaluation in Markov decision processes with finite spaces and discounted reward criteria, and we present a collection of convergence results for several…

Machine Learning · Computer Science 2018-03-30 Huizhen Yu

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

Continuous-time Markov process models of contagions are widely studied, not least because of their utility in predicting the evolution of real-world contagions and in formulating control measures. It is often the case, however, that…

Physics and Society · Physics 2016-11-23 Peter G. Fennell , Sergey Melnik , James P. Gleeson

In this work, we generalize the concept of bisimulation metric in order to metrize the behaviour of continuous-time processes. Similarly to what is done for discrete-time systems, we follow two approaches and show that they coincide: as a…

Logic in Computer Science · Computer Science 2025-01-23 Linan Chen , Florence Clerc , Prakash Panangaden

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

A common lens to theoretically study neural net architectures is to analyze the functions they can approximate. However, constructions from approximation theory may be unrealistic and therefore less meaningful. For example, a common…

Machine Learning · Computer Science 2023-03-31 Colin Wei , Yining Chen , Tengyu Ma

We consider the problem of predictive monitoring (PM), i.e., predicting at runtime the satisfaction of a desired property from the current system's state. Due to its relevance for runtime safety assurance and online control, PM methods need…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Francesca Cairoli , Nicola Paoletti , Luca Bortolussi

We consider estimating the transition probability matrix of a finite-state finite-observation alphabet hidden Markov model with known observation probabilities. The main contribution is a two-step algorithm; a method of moments estimator…

Systems and Control · Computer Science 2017-11-22 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

We present an algorithm that takes a discrete random variable $X$ and a number $m$ and computes a random variable whose support (set of possible outcomes) is of size at most $m$ and whose Kolmogorov distance from $X$ is minimal. In addition…

Data Structures and Algorithms · Computer Science 2018-05-22 Liat Cohen , Dror Fried , Gera Weiss

This paper deals with control of partially observable discrete-time stochastic systems. It introduces and studies Markov Decision Processes with Incomplete Information and with semi-uniform Feller transition probabilities. The important…

Optimization and Control · Mathematics 2022-08-30 Eugene A. Feinberg , Pavlo O. Kasyanov , Michael Z. Zgurovsky

Stochastic approximation algorithm is a useful technique which has been exploited successfully in probability theory and statistics for a long time. The step sizes used in stochastic approximation are generally taken to be deterministic and…

Probability · Mathematics 2019-09-25 Ujan Gangopadhyay , Krishanu Maulik

Motivated by information geometry, a distance function on the space of stochastic matrices is advocated. Starting with sequences of Markov chains the Bhattacharyya angle is advocated as the natural tool for comparing both short and long…

Probability · Mathematics 2025-05-06 Antony R. Lee , Peter Tino , Iain Bruce Styles

Hidden Markov models (HMMs) are flexible tools for clustering dependent data coming from unknown populations, allowing nonparametric modelling of the population densities. Identifiability fails when the data is in fact independent and…

Statistics Theory · Mathematics 2025-07-16 Kweku Abraham , Elisabeth Gassiat , Zacharie Naulet

Piecewise-Deterministic Markov Processes (PDMPs) hold significant promise for sampling from complex probability distributions. However, their practical implementation is hindered by the need to compute model-specific bounds. Conversely,…

Computation · Statistics 2025-03-17 Augustin Chevallier , Sam Power , Matthew Sutton

We define a metric---the network Gromov-Wasserstein distance---on weighted, directed networks that is sensitive to the presence of outliers. In addition to proving its theoretical properties, we supply network invariants based on optimal…

Discrete Mathematics · Computer Science 2019-09-05 Samir Chowdhury , Facundo Mémoli