English
Related papers

Related papers: Missing Mass Concentration for Markov Chains

200 papers

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

A fundamental problem when aggregating Markov chains is the specification of the number of state groups. Too few state groups may fail to sufficiently capture the pertinent dynamics of the original, high-order Markov chain. Too many state…

Information Theory · Computer Science 2021-07-06 Isaac J. Sledge , Jose C. Principe

We consider irreducible reversible discrete time Markov chains on a finite state space. Mixing times and hitting times are fundamental parameters of the chain. We relate them by showing that the mixing time of the lazy chain is equivalent…

Probability · Mathematics 2013-04-30 Yuval Peres , Perla Sousi

In this paper we are concerned with hitting times of a family of density-dependent Markov chains. A moderate deviation principle of the hitting time is given. The proof of the main theorem relies heavily on moderate deviations of…

Probability · Mathematics 2022-06-15 Yuheng He , Xiaofeng Xue

Missing data in time series is a pervasive problem that puts obstacles in the way of advanced analysis. A popular solution is imputation, where the fundamental challenge is to determine what values should be filled in. This paper proposes…

Machine Learning · Computer Science 2023-07-06 Wenjie Du , David Cote , Yan Liu

In this paper, we study moment and concentration inequalities for the spectral norm of sums of dependent random matrices. We establish novel Rosenthal-Burkholder inequalities for discrete-time matrix local martingales,…

Probability · Mathematics 2025-11-13 Yang Peng , Yuchen Xin , Zhihua Zhang

We develop a systematic matrix-analytic approach, based on intertwinings of Markov semigroups, for proving theorems about hitting-time distributions for finite-state Markov chains -- an approach that (sometimes) deepens understanding of the…

Probability · Mathematics 2012-09-04 James Allen Fill , Vince Lyzinski

In networking applications, one often wishes to obtain estimates about the number of objects at different parts of the network (e.g., the number of cars at an intersection of a road network or the number of packets expected to reach a node…

Social and Information Networks · Computer Science 2020-06-22 Harshal A. Chaudhari , Michael Mathioudakis , Evimaria Terzi

As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and…

Methodology · Statistics 2025-04-21 Jianing Dong , Raymond K. W. Wong , Kwun Chuen Gary Chan

We survey information-theoretic approaches to the reduction of Markov chains. Our survey is structured in two parts: The first part considers Markov chain coarse graining, which focuses on projecting the Markov chain to a process on a…

Information Theory · Computer Science 2022-05-02 Bernhard C. Geiger

Modeling the time evolution of discrete sets of items (e.g., genetic mutations) is a fundamental problem in many biomedical applications. We approach this problem through the lens of continuous-time Markov chains, and show that the…

Machine Learning · Computer Science 2021-07-08 Alkis Gotovos , Rebekka Burkholz , John Quackenbush , Stefanie Jegelka

Given an irreducible discrete-time Markov chain on a finite state space, we consider the largest expected hitting time $T(\alpha)$ of a set of stationary measure at least $\alpha$ for $\alpha\in(0,1)$. We obtain tight inequalities among the…

Probability · Mathematics 2015-10-29 Simon Griffiths , Ross J. Kang , Roberto Imbuzeiro Oliveira , Viresh Patel

Scharfstein et al. (2021) developed a sensitivity analysis model for analyzing randomized trials with repeatedly measured binary outcomes that are subject to nonmonotone missingness. Their approach becomes computationally intractable when…

The problem of sampling from the stationary distribution of a Markov chain finds widespread applications in a variety of fields. The time required for a Markov chain to converge to its stationary distribution is known as the classical…

Quantum Physics · Physics 2022-09-14 Shantanav Chakraborty , Kyle Luh , Jérémie Roland

We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems…

Optimization and Control · Mathematics 2026-05-18 Anik Kumar Paul , Shalabh Bhatnagar

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

Markov jump processes (or continuous-time Markov chains) are a simple and important class of continuous-time dynamical systems. In this paper, we tackle the problem of simulating from the posterior distribution over paths in these models,…

Computation · Statistics 2013-10-21 Vinayak Rao , Yee Whye Teh

Markov chain (MC) algorithms are ubiquitous in machine learning and statistics and many other disciplines. Typically, these algorithms can be formulated as acceptance rejection methods. In this work we present a novel estimator applicable…

Machine Learning · Statistics 2020-08-07 Ingmar Schuster , Ilja Klebanov

This paper considers the problem of system identification (ID) of linear and nonlinear non-autonomous systems from noisy and sparse data. We propose and analyze an objective function derived from a Bayesian formulation for learning a hidden…

Systems and Control · Electrical Eng. & Systems 2023-01-24 Nicholas Galioto , Alex Arkady Gorodetsky

We revisit the problem of \emph{missing mass concentration}, developing a new method of estimating concentration of heterogenic sums, in spirit of celebrated Rosenthal's inequality. As a result we slightly improve the state-of-art bounds…

Statistics Theory · Mathematics 2020-05-25 Maciej Skorski