English
Related papers

Related papers: Ambiguity Rate of Hidden Markov Processes

200 papers

We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and effectively uses a predictive model of its…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

Based on information theory, we present a method to determine an optimal Markov approximation for modelling and prediction from time series data. The method finds a balance between minimal modelling errors by taking as much as possible…

Chaotic Dynamics · Physics 2013-05-29 Detlef Holstein , Holger Kantz

When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…

Quantitative Methods · Quantitative Biology 2025-05-06 David P. Carcamo , Nicholas J. Weaver , Purushottam D. Dixit , Christopher W. Lynn

We consider a stochastic process model with time trend and measurement error. We establish consistency and derive the limiting distributions of the maximum likelihood (ML) estimators of the covariance function parameters under a general…

Statistics Theory · Mathematics 2016-09-29 Chih-Hao Chang , Hsin-Cheng Huang , Ching-Kang Ing

We propose sequential Monte Carlo based algorithms for maximum likelihood estimation of the static parameters in hidden Markov models with an intractable likelihood using ideas from approximate Bayesian computation. The static parameter…

Computation · Statistics 2013-11-19 Sinan Yildirim , Sumeetpal Singh , Thomas Dean , Ajay Jasra

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

We consider discrete stochastic processes, modeled by classical master equations, on networks. The temporal growth of the lack of information about the system is captured by its non-equilibrium entropy, defined via the transition…

Statistical Mechanics · Physics 2017-04-26 Oliver Muelken , Sarah Heinzelmann , Maxim Dolgushev

Implicit probabilistic models are models defined naturally in terms of a sampling procedure and often induces a likelihood function that cannot be expressed explicitly. We develop a simple method for estimating parameters in implicit models…

Machine Learning · Computer Science 2018-10-23 Ke Li , Jitendra Malik

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

Methodology · Statistics 2017-02-09 Hongmei Liu , J. Sunil Rao

Feature selection (FS) is assumed to improve predictive performance and identify meaningful features in high-dimensional datasets. Surprisingly, small random subsets of features (0.02-1%) match or outperform the predictive performance of…

Machine Learning · Computer Science 2025-09-22 Bhavesh Neekhra , Debayan Gupta , Partha Pratim Chakrabarti

In this article, we consider a stochastic numerical simulator to assess the impact of some factors on a phenomenon. The simulator is seen as a black box with inputs and outputs. The quality of a simulation, hereafter referred to as…

Computation · Statistics 2017-07-27 Rémi Stroh , Séverine Demeyer , Nicolas Fischer , Julien Bect , Emmanuel Vazquez

The maximum entropy ansatz, as it is often invoked in the context of time-series analysis, suggests the selection of a power spectrum which is consistent with autocorrelation data and corresponds to a random process least predictable from…

Probability · Mathematics 2008-07-19 Tryphon T. Georgiou

We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under…

Optimization and Control · Mathematics 2014-07-03 Lorenzo Finesso , Angela Grassi , Peter Spreij

In this paper, we analyze the local convergence rate of optimistic mirror descent methods in stochastic variational inequalities, a class of optimization problems with important applications to learning theory and machine learning. Our…

Optimization and Control · Mathematics 2021-07-06 Waïss Azizian , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

Extropy, a complementary dual of entropy, (proposed by Lad et al. \cite{lad2015extropy} in 2015) has attracted considerable interest from the research community. In this study, we focus on discrete random variables and define conditional…

Information Theory · Computer Science 2025-07-16 Naveen Kumar , Vivek Vijay

Model calibration or data inversion is one of fundamental tasks in uncertainty quantification. In this work, we study the theoretical properties of the scaled Gaussian stochastic process (S-GaSP), to model the discrepancy between reality…

Statistics Theory · Mathematics 2020-08-04 Mengyang Gu , Fangzheng Xie , Long Wang

This paper addresses the problem of planning under uncertainty in large Markov Decision Processes (MDPs). Factored MDPs represent a complex state space using state variables and the transition model using a dynamic Bayesian network. This…

Artificial Intelligence · Computer Science 2011-06-10 C. Guestrin , D. Koller , R. Parr , S. Venkataraman

We consider the fundamental problem of how to automatically construct summary statistics for implicit generative models where the evaluation of the likelihood function is intractable, but sampling data from the model is possible. The idea…

Machine Learning · Statistics 2021-03-31 Yanzhi Chen , Dinghuai Zhang , Michael Gutmann , Aaron Courville , Zhanxing Zhu

We consider a robust asymptotic growth problem under model uncertainty in the presence of stochastic factors. We fix two inputs representing the instantaneous covariance for the asset price process $X$, which depends on an additional…

Mathematical Finance · Quantitative Finance 2025-12-19 David Itkin , Benedikt Koch , Martin Larsson , Josef Teichmann

We introduce a novel approach for decomposing and learning every scale of a given multiscale objective function in $\mathbb{R}^d$, where $d\ge 1$. This approach leverages a recently demonstrated implicit bias of the optimization method of…

Numerical Analysis · Mathematics 2024-01-09 Xingjie Helen Li , Molei Tao
‹ Prev 1 8 9 10 Next ›