English
Related papers

Related papers: Minimum information Markov model

200 papers

We study one-sided and $\alpha$-correct sequential hypothesis testing for data generated by an ergodic Markov chain. The null hypothesis is that the unknown transition matrix belongs to a prescribed set $P$ of stochastic matrices, and the…

Statistics Theory · Mathematics 2026-02-20 Alhad Sethi , Kavali Sofia Sagar , Shubhada Agrawal , Debabrota Basu , P. N. Karthik

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

The study of online decision-making problems that leverage contextual information has drawn notable attention due to their significant applications in fields ranging from healthcare to autonomous systems. In modern applications, contextual…

Machine Learning · Statistics 2025-04-22 Qiyu Han , Will Wei Sun , Yichen Zhang

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

While hidden class models of various types arise in many statistical applications, it is often difficult to establish the identifiability of their parameters. Focusing on models in which there is some structure of independence of some of…

Statistics Theory · Mathematics 2009-09-01 Elizabeth S. Allman , Catherine Matias , John A. Rhodes

Current methods for pattern analysis in time series mainly rely on statistical features or probabilistic learning and inference methods to identify patterns and trends in the data. Such methods do not generalize well when applied to…

Artificial Intelligence · Computer Science 2023-05-01 Yushan Huang , Yuchen Zhao , Alexander Capstick , Francesca Palermo , Hamed Haddadi , Payam Barnaghi

The problem of appropriately matching items subject to compatibility constraints arises in a number of important applications. While most of the literature on matching theory focuses on a static setting with a fixed number of items, several…

Probability · Mathematics 2022-01-04 Céline Comte

We present a novel parameter identification algorithm for the estimation of parameters in models of cell motility using imaging data of migrating cells. Two alternative formulations of the objective functional that measures the difference…

In this contribution a practical approach to determine and store position dependent parameters is presented. These parameters can be obtained, among others, using experimental results or expert knowledge and are stored in 'Information…

Computational Engineering, Finance, and Science · Computer Science 2013-12-16 Benjamin wilking , Daniel Meissner , Stephan Reuter , Klaus Dietmayer

Markov chain analysis is a key technique in formal verification. A practical obstacle is that all probabilities in Markov models need to be known. However, system quantities such as failure rates or packet loss ratios, etc. are often not --…

Logic in Computer Science · Computer Science 2023-11-08 Sebastian Junges , Erika Ábrahám , Christian Hensel , Nils Jansen , Joost-Pieter Katoen , Tim Quatmann , Matthias Volk

The algorithmic Markov condition states that the most likely causal direction between two random variables X and Y can be identified as that direction with the lowest Kolmogorov complexity. Due to the halting problem, however, this notion…

Machine Learning · Computer Science 2017-02-23 Kailash Budhathoki , Jilles Vreeken

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr

Markov state modeling has gained popularity in various scientific fields since it reduces complex time-series data sets into transitions between a few states. Yet common Markov state modeling frameworks assume a single Markov chain…

Methodology · Statistics 2026-02-25 Christopher E. Miles , Robert J. Webber

Given a pair of predictor variables and a response variable, how much information do the predictors have about the response, and how is this information distributed between unique, redundant, and synergistic components? Recent work has…

Information Theory · Computer Science 2018-10-29 Pradeep Kr. Banerjee , Johannes Rauh , Guido Montúfar

The broad abundance of time series data, which is in sharp contrast to limited knowledge of the underlying network dynamic processes that produce such observations, calls for a rigorous and efficient method of causal network inference. Here…

Information Theory · Computer Science 2015-05-19 Jie Sun , Dane Taylor , Erik M. Bollt

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

We study notions of robustness of Markov kernels and probability distribution of a system that is described by $n$ input random variables and one output random variable. Markov kernels can be expanded in a series of potentials that allow to…

Commutative Algebra · Mathematics 2011-10-07 Johannes Rauh , Nihat Ay

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

Optimal experimental design is a classic topic in statistics, with many well-studied problems, applications, and solutions. The design problem we study is the placement of sensors to monitor spatiotemporal processes, explicitly accounting…

Methodology · Statistics 2026-01-05 Daniel Waxman , Fernando Llorente , Katia Lamer , Petar M. Djurić

High-dimensional multivariate time series are common in many scientific and industrial applications, where the interest lies in identifying key dependence structure within the data for subsequent analysis tasks, such as forecasting. An…

Methodology · Statistics 2025-12-15 Madeline A. Shelley , Chiara Boetti , Marina I. Knight , Matthew A. Nunes