English
Related papers

Related papers: Asymptotic optimality of the cross-entropy method …

200 papers

Identifying future congestion points in electricity distribution networks is an important challenge distribution system operators face. A proven approach for addressing this challenge is to assess distribution grid adequacy using…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Julian N. Betge , Barbera Droste , Jacco Heres , Simon H. Tindemans

We discuss how maximum entropy methods may be applied to the reconstruction of Markov processes underlying empirical time series and compare this approach to usual frequency sampling. It is shown that, at least in low dimension, there…

Risk Management · Quantitative Finance 2015-06-23 Gregor Chliamovitch , Alexandre Dupuis , Bastien Chopard , Anton Golub

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock

In this paper, we consider asymptotics of the optimal value and the optimal solutions of parametric minimax estimation problems. Specifically, we consider estimators of the optimal value and the optimal solutions in a sample minimax problem…

Statistics Theory · Mathematics 2025-04-16 Mika Meitz , Alexander Shapiro

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

This article shows how coupled Markov chains that meet exactly after a random number of iterations can be used to generate unbiased estimators of the solutions of the Poisson equation. Through this connection, we re-derive known unbiased…

Computation · Statistics 2025-12-10 Randal Douc , Pierre E. Jacob , Anthony Lee , Dootika Vats

The estimation of rare event or failure probabilities in high dimensions is of interest in many areas of science and technology. We consider problems where the rare event is expressed in terms of a computationally costly numerical model.…

Computation · Statistics 2020-06-11 Felipe Uribe , Iason Papaioannou , Youssef M. Marzouk , Daniel Straub

We describe Monte Carlo approximation to the maximum likelihood estimator in models with intractable norming constants and explanatory variables. We consider both sources of randomness (due to the initial sample and to Monte Carlo…

Methodology · Statistics 2016-12-08 Blazej Miasojedow , Wojciech Niemiro , Jan Palczewski , Wojciech Rejchel

An asymptotic model for extreme behavior of certain Markov chains is the "tail chain". Generally taking the form of a multiplicative random walk, it is useful in deriving extremal characteristics such as point process limits. We place this…

Probability · Mathematics 2011-12-30 Sidney I. Resnick , David Zeber

We formulate some simple conditions under which a Markov chain may be approximated by the solution to a differential equation, with quantifiable error probabilities. The role of a choice of coordinate functions for the Markov chain is…

Probability · Mathematics 2008-04-23 R. W. R. Darling , J. R. Norris

Suppose we observe a geometrically ergodic semi-Markov process and have a parametric model for the transition distribution of the embedded Markov chain, for the conditional distribution of the inter-arrival times, or for both. The first two…

Statistics Theory · Mathematics 2007-12-21 Ursula U. Müller , Anton Schick , Wolfgang Wefelmeyer

In this paper, we consider semi-Markov processes whose transition times and transition probabilities depend on a small parameter $\varepsilon$. Understanding the asymptotic behavior of such processes is needed in order to study the…

Probability · Mathematics 2024-11-08 Leonid Koralov , Ishfaaq Mohammed Imtiyas

We introduce a modification of Perron's method, where semi-solutions are considered in a carefully defined asymptotic sense. With this definition, we can show, in a rather elementary way, that in a zero-sum game or a control problem (with…

Optimization and Control · Mathematics 2015-02-20 Mihai Sîrbu

Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta

We address the problem of identifying the dynamical law governing the evolution of a population of indistinguishable particles, when only aggregate distributions at successive times are observed. Assuming a Markovian evolution on a discrete…

Optimization and Control · Mathematics 2025-11-21 Michele Mascherpa , Axel Ringh , Amirhossein Taghvaei , Johan Karlsson

This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new…

Machine Learning · Computer Science 2018-05-23 Judy Hoffman , Mehryar Mohri , Ningshan Zhang