English
Related papers

Related papers: A Point on Discrete versus Continuous State-Space …

200 papers

Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…

Statistics Theory · Mathematics 2026-01-26 Lasse Leskelä , Maximilien Dreveton

Building higher-dimensional copulas is generally recognized as a difficult problem. Regular-vines using bivariate copulas provide a flexible class of high-dimensional dependency models. In large dimensions, the drawback of the model is the…

Statistics Theory · Mathematics 2012-06-07 Edith Kovacs , Tamas Szantai

We consider a dynamic version of the stochastic block model, in which the nodes are partitioned into latent classes and the connection between two nodes is drawn from a Bernoulli distribution depending on the classes of these two nodes. The…

Statistics Theory · Mathematics 2023-08-30 Léa Longepierre , Catherine Matias

In this work, we study the effects of finite buffers on the throughput and delay of line networks with erasure links. We identify the calculation of performance parameters such as throughput and delay to be equivalent to determining the…

Information Theory · Computer Science 2011-03-09 Badri N. Vellambi , Nima Torabkhani , Faramarz Fekri

We propose a new semiparametric approach for modelling nonlinear univariate diffusions, where the observed process is a nonparametric transformation of an underlying parametric diffusion (UPD). This modelling strategy yields a general class…

Econometrics · Economics 2020-05-08 Ruijun Bu , Kaddour Hadri , Dennis Kristensen

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

Probability · Mathematics 2021-05-21 Aleksandr Shchegolev

We investigate multivariate regular variation in the context of time-homogeneous Markov chains on general vector spaces and in random coefficient linear models. In the first part, we show that the regular variation of the stationary…

Probability · Mathematics 2025-10-23 Piotr Dyszewski , Tamara Mika

The random numbers driving Markov chain Monte Carlo (MCMC) simulation are usually modeled as independent U(0,1) random variables. Tribble [Markov chain Monte Carlo algorithms using completely uniformly distributed driving sequences (2007)…

Statistics Theory · Mathematics 2011-05-11 S. Chen , J. Dick , A. B. Owen

A penalized maximum likelihood estimation approach is proposed for discrete-time hidden Markov models where covariates affect the observed responses and serial dependence is considered. The proposed penalized maximum likelihood method…

Methodology · Statistics 2025-07-04 Luca Brusa , Fulvia Pennoni , Francesco Bartolucci , Romina Peruilh Bagolini

In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is…

Computation · Statistics 2014-04-04 Randal Douc , Florian Maire , Jimmy Olsson

Sampling from the conditional (or posterior) probability distribution of the latent states of a Hidden Markov Model, given the realization of the observed process, is a non-trivial problem in the context of Markov Chain Monte Carlo. To do…

Statistics Theory · Mathematics 2015-09-29 Sumeetpal S. Singh , Fredrik Lindsten , Eric Moulines

Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled…

Probability · Mathematics 2019-01-18 Son L. Nguyen , George Yin , Tuan A. Hoang

This paper investigates the probabilistic properties that determine the existence of space-time transformations between diffusion processes. We prove that two diffusions are related by a monotone space-time transformation if and only if…

Probability · Mathematics 2015-09-16 Enrico Bibbona , Laura Sacerdote , Emiliano Torre

Probabilistic model checking can provide formal guarantees on the behavior of stochastic models relating to a wide range of quantitative properties, such as runtime, energy consumption or cost. But decision making is typically with respect…

Logic in Computer Science · Computer Science 2024-03-19 Ingy Elsayed-Aly , David Parker , Lu Feng

As a motivating problem, we aim to study some special aspects of the marginal distributions of the order statistics for exchangeable and (more generally) for minimally stable non-negative random variables $T_{1},...,T_{r}$. In any case, we…

Probability · Mathematics 2021-06-16 Rachele Foschi , Giovanna Nappo , Fabio L. Spizzichino

We consider a family of Markov chains whose transition dynamics are affected by model parameters. Understanding the parametric dependence of (complex) performance measures of such Markov chains is often of significant interest. The…

Probability · Mathematics 2017-07-14 Chang-Han Rhee , Peter Glynn

We obtain the posterior distribution of a random process conditioned on observing the empirical frequencies of a finite sample path. We find under a rather broad assumption on the "dependence structure" of the process, {\em c.f.}…

Probability · Mathematics 2022-03-02 Wenqing Hu , Hong Qian

Tests for break points detection in the law of random vectors have been proposed in several papers. Nevertheless, they have often little powers for alternatives involving a change in the dependence between components of vectors. Specific…

Statistics Theory · Mathematics 2016-03-28 Tom Rohmer

We study the problem of predicting numeric labels that are constrained to the integers or to a subrange of the integers. For example, the number of up-votes on social media posts, or the number of bicycles available at a public rental…

Machine Learning · Computer Science 2026-04-14 Bas Maat , Peter Bloem

A time-dependent finite-state Markov chain that uses doubly stochastic transition matrices, is considered. Entropic quantities that describe the randomness of the probability vectors, and also the randomness of the discrete paths, are…

Quantum Physics · Physics 2022-03-18 A. Vourdas