English
Related papers

Related papers: On the minimal penalty for Markov order estimation

200 papers

This paper deals with order identification for nested models in the i.i.d. framework. We study the asymptotic efficiency of two generalized likelihood ratio tests of the order. They are based on two estimators which are proved to be…

Statistics Theory · Mathematics 2007-06-13 Antoine Chambaz

Penalized likelihood methods are fundamental to ultra-high dimensional variable selection. How high dimensionality such methods can handle remains largely unknown. In this paper, we show that in the context of generalized linear models,…

Statistics Theory · Mathematics 2009-10-08 Jianqing Fan , Jinchi Lv

We consider the branch-length estimation problem on a bifurcating tree: a character evolves along the edges of a binary tree according to a two-state symmetric Markov process, and we seek to recover the edge transition probabilities from…

Computation · Statistics 2025-07-30 David Clancy , Hanbaek Lyu , Sebastien Roch

In this paper, we present a novel iterative Monte Carlo method for approximating the stationary probability of a single state of a positive recurrent Markov chain. We utilize the characterization that the stationary probability of a state…

Data Structures and Algorithms · Computer Science 2015-12-11 Christina E. Lee , Asuman Ozdaglar , Devavrat Shah

In high-dimensional data analysis, penalized likelihood estimators are shown to provide superior results in both variable selection and parameter estimation. A new algorithm, APPLE, is proposed for calculating the Approximate Path for…

Machine Learning · Statistics 2013-05-07 Yi Yu , Yang Feng

When modelling metapopulation dynamics, the influence of a single patch on the metapopulation depends on the number of individuals in the patch. Since the population size has no natural upper limit, this leads to systems in which there are…

Probability · Mathematics 2011-04-01 A. D. Barbour , M. J. Luczak

Computational efficient evaluation of penalized estimators of multivariate exponential family distributions is sought. These distributions encompass among others Markov random fields with variates of mixed type (e.g. binary and continuous)…

Methodology · Statistics 2020-12-29 Diederik S. Laman Trip , Wessel N. van Wieringen

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible…

Statistical Mechanics · Physics 2015-05-28 Hao Ge , Steve Presse , Kingshuk Ghosh , Ken Dill

We propose a penalized pseudo-likelihood criterion to estimate the graph of conditional dependencies in a discrete Markov random field that can be partially observed. We prove the convergence of the estimator in the case of a finite or…

Methodology · Statistics 2022-09-05 Florencia Leonardi , Rodrigo R. S. Carvalho

Since the paper of Kleinberg and Kleinberg, SODA'05, where it was proven that the preferential attachment random graph with degeneracy at least 3 does not obey the first order 0-1 law, no general methods were developed to study logical…

Probability · Mathematics 2023-11-01 Yury Malyshkin , Maksim Zhukovskii

This paper compiles several aspects of the dynamics of stochastic approximation algorithms with Markov iterate-dependent noise when the iterates are not known to be stable beforehand. We achieve the same by extending the lock-in probability…

Dynamical Systems · Mathematics 2019-02-22 Prasenjit Karmakar , Shalabh Bhatnagar

In many complex statistical models maximum likelihood estimators cannot be calculated. In the paper we solve this problem using Markov chain Monte Carlo approximation of the true likelihood. In the main result we prove asymptotic normality…

Statistics Theory · Mathematics 2018-08-09 Błażej Miasojedow , Wojciech Niemiro , Wojciech Rejchel

We study the worst-case communication complexity of distributed algorithms computing a path problem based on stationary distributions of random walks in a network $G$ with the caveat that $G$ is also the communication network. The problem…

Data Structures and Algorithms · Computer Science 2008-10-30 Rahul Sami , Andy Twigg

Consider a Markov chain $\{X_n\}_{n\ge 0}$ with an ergodic probability measure $\pi$. Let $\Psi$ a function on the state space of the chain, with $\alpha$-tails with respect to $\pi$, $\alpha\in (0,2)$. We find sufficient conditions on the…

Probability · Mathematics 2009-12-15 Milton Jara , Tomasz Komorowski , Stefano Olla

We propose a new and computationally efficient algorithm for maximizing the observed log-likelihood for a multivariate normal data matrix with missing values. We show that our procedure based on iteratively regressing the missing on the…

Methodology · Statistics 2012-11-21 Nicolas Städler , Daniel J. Stekhoven , Peter Bühlmann

Laws of large numbers guarantee that given a large enough sample from some population, the measure of any fixed sub-population is well-estimated by its frequency in the sample. We study laws of large numbers in sampling processes that can…

Machine Learning · Computer Science 2021-01-25 Noga Alon , Omri Ben-Eliezer , Yuval Dagan , Shay Moran , Moni Naor , Eylon Yogev

Markov chain Monte Carlo is an inherently serial algorithm. Although likelihood calculations for individual steps can sometimes be parallelized, the serial evolution of the process is widely viewed as incompatible with parallelization,…

Computation · Statistics 2013-12-31 Douglas N. VanDerwerken , Scott C. Schmidler

The analysis of parametrised systems is a growing field in verification, but the analysis of parametrised probabilistic systems is still in its infancy. This is partly because it is much harder: while there are beautiful cut-off results for…

Logic in Computer Science · Computer Science 2018-04-06 Paul Gainer , Ernst Moritz Hahn , Sven Schewe

In this paper, we penalised the standard random walk by several functions of its maximum. The aim is to show that in spite of very close penalisation functions, under the new probabilities, the canonical process behaves very differently.

Probability · Mathematics 2010-12-15 Pierre Debs

The limiting probability distribution is one of the key characteristics of a Markov chain since it shows its long-term behavior. In this paper, for a higher order Markov chain, we establish some properties related to its exact limiting…

Probability · Mathematics 2026-03-20 Lixing Han , Jianhong Xu