English
Related papers

Related papers: Direct evaluation of dynamical large-deviation rat…

200 papers

We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we…

Methodology · Statistics 2025-04-16 Nicolas Bianco , Mauro Bernardi , Daniele Bianchi

We investigate large deviations properties for centered stationary AR(1) and MA(1) processes with independent Gaussian innovations, by giving the explicit bivariate rate functions for the sequence of random vectors $(\boldsymbol{S}_n)_{n…

Probability · Mathematics 2021-02-22 M. J. Karling , A. O. Lopes , S. R. C. Lopes

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Recent work has shown the effectiveness of tensor network methods for computing large deviation functions in constrained stochastic models in the infinite time limit. Here we show that these methods can also be used to study the statistics…

Statistical Mechanics · Physics 2022-03-08 Luke Causer , Mari Carmen Bañuls , Juan P. Garrahan

We establish sharp large deviation principles for cumulative rewards associated with a discrete-time renewal model, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. The framework we…

Probability · Mathematics 2023-04-24 Marco Zamparo

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

We consider strictly stationary heavy tailed time series whose finite-dimensional exponent measures are concentrated on axes, and hence their extremal properties cannot be tackled using classical multivariate regular variation that is…

Statistics Theory · Mathematics 2014-10-10 Rafal Kulik , Philippe Soulier

We derive an annealed large deviation principle for the normalised local times of a continuous-time random walk among random conductances in a finite domain in $\Z^d$ in the spirit of Donsker-Varadhan \cite{DV75}. We work in the interesting…

Probability · Mathematics 2011-04-11 Wolfgang König , Michele Salvi , Tilman Wolff

We establish a sharp large deviation principle for renewal-reward processes, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. In fact, we demonstrate a weak large deviation principle…

Probability · Mathematics 2023-04-24 Marco Zamparo

In stochastic systems, numerically sampling the relevant trajectories for the estimation of the large deviation statistics of time-extensive observables requires overcoming their exponential (in space and time) scarcity. The optimal way to…

Statistical Mechanics · Physics 2021-01-14 Tom H. E. Oakes , Adam Moss , Juan P. Garrahan

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann

The large deviations analysis of solutions to stochastic differential equations and related processes is often based on approximation. The construction and justification of the approximations can be onerous, especially in the case where the…

Probability · Mathematics 2008-08-28 Amarjit Budhiraja , Paul Dupuis , Vasileios Maroulas

We study a variance reduction strategy based on control variables for simulating the averaged macroscopic behavior of a stochastic slow-fast system. We assume that this averaged behavior can be written in terms of a few slow degrees of…

Numerical Analysis · Mathematics 2016-09-16 Ward Melis , Giovanni Samaey

We consider the dynamic linear regression problem, where the predictor vector may vary with time. This problem can be modeled as a linear dynamical system, with non-constant observation operator, where the parameters that need to be learned…

Machine Learning · Computer Science 2022-10-13 Mark Kozdoba , Edward Moroshko , Shie Mannor , Koby Crammer

In this paper we establish a large deviations type estimate for strongly mixing Markov chains with respect to the Lp norm. As applications we derive such estimates for the iterates of a locally constant random cocycle with mixed rank, as…

Dynamical Systems · Mathematics 2026-02-10 Anselmo Pontes

Let $\{{\bf \mathcal{Z}}_n:n\geq 1\}$ be a sequence of i.i.d. random probability measures. Independently, for each $n\geq 1$, let $(X_{n1},\ldots, X_{nn})$ be a random vector of positive random variables that add up to one. This paper…

Probability · Mathematics 2021-06-24 Shui Feng

Models with a large number of latent variables are often used to fully utilize the information in big or complex data. However, they can be difficult to estimate using standard approaches, and variational inference methods are a popular…

Methodology · Statistics 2021-04-20 Rubén Loaiza-Maya , Michael Stanley Smith , David J. Nott , Peter J. Danaher

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

Linear dynamical relations that may exist in continuous-time, or at some natural sampling rate, are not directly discernable at reduced observational sampling rates. Indeed, at reduced rates, matricial spectral densities of vectorial time…

Systems and Control · Computer Science 2018-07-25 Tryphon T. Georgiou , Anders Lindquist

We describe a variational approximation method for efficient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest.…

Artificial Intelligence · Computer Science 2011-05-30 T. S. Jaakkola , M. I. Jordan