English
Related papers

Related papers: Large Deviation Asymptotics and Bayesian Posterior…

200 papers

Regularized system identification is the major advance in system identification in the last decade. Although many promising results have been achieved, it is far from complete and there are still many key problems to be solved. One of them…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Yue Ju , Biqiang Mu , Lennart Ljung , Tianshi Chen

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

In this work we establish the posterior consistency for a parametrized family of partially observed, fully dominated Markov models. As a main assumption, we suppose that the prior distribution assigns positive probability to all…

Statistics Theory · Mathematics 2016-09-01 Randal Douc , Jimmy Olsson , Francois Roueff

We study the asymptotic behavior for an inhomogeneous multiscale stochastic dynamical system with non-smooth coefficients. Depending on the averaging regime and the homogenization regime, two strong convergences in the averaging principle…

Probability · Mathematics 2021-04-21 Michael Röckner , Longjie Xie

We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density…

Information Theory · Computer Science 2015-07-30 Mark Kelbert , Pavel Mozgunov

Most of the consistency analyses of Bayesian procedures for variable selection in regression refer to pairwise consistency, that is, consistency of Bayes factors. However, variable selection in regression is carried out in a given class of…

Methodology · Statistics 2015-07-30 Elías Moreno , Javier Girón , George Casella

A succesful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well chosen mean differential equation. Under an attainability condition,…

Probability · Mathematics 2011-01-19 Mathieu Faure , Gregory Roth

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

In this paper, we consider asymptotic behaviors of multiscale multivalued stochastic systems with small noises. First of all, for general, fully coupled systems for multivalued stochastic differential equations of slow and fast motions with…

Probability · Mathematics 2025-09-30 Huijie Qiao

We study the problem of exponential mixing and large deviations for discrete-time Markov processes associated with a class of random dynamical systems. Under some dissipativity and regularisation hypotheses for the underlying deterministic…

Analysis of PDEs · Mathematics 2014-10-24 Vojkan Jaksic , Vahagn Nersesyan , Claude-Alain Pillet , Armen Shirikyan

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

We recover the Donsker-Varadhan large deviations principle (LDP) for the empirical measure of a continuous time Markov chain on a countable (finite or infinite) state space from the joint LDP for the empirical measure and the empirical flow…

Probability · Mathematics 2013-01-01 L. Bertini , A. Faggionato , D. Gabrielli

We consider stochastic optimization under distributional uncertainty, where the unknown distributional parameter is estimated from streaming data that arrive sequentially over time. Moreover, data may depend on the decision of the time when…

Optimization and Control · Mathematics 2023-10-17 Tianyi Liu , Yifan Lin , Enlu Zhou

The asymptotic analysis of a class of stochastic partial differential equations (SPDEs) with fully locally monotone coefficients covering a large variety of physical systems, a wide class of quasilinear SPDEs and a good number of fluid…

Probability · Mathematics 2022-12-13 Ankit Kumar , Manil T. Mohan

We consider multiple time scales systems of stochastic differential equations with small noise in random environments. We prove a quenched large deviations principle with explicit characterization of the action functional. The random medium…

Probability · Mathematics 2015-04-23 Konstantinos Spiliopoulos

Spatial Gaussian process regression models typically contain finite dimensional covariance parameters that need to be estimated from the data. We study the Bayesian estimation of covariance parameters including the nugget parameter in a…

Statistics Theory · Mathematics 2023-02-22 Cheng Li , Saifei Sun , Yichen Zhu

Many modern experiments, such as microarray gene expression and genome-wide association studies, present the problem of estimating a large number of parallel effects. Bayesian inference is a popular approach for analyzing such data by…

Methodology · Statistics 2018-10-26 J G Liao , Arthur Berg , Timothy L McMurry

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

Parameter identification problems in partial differential equations (PDEs) consist in determining one or more functional coefficient in a PDE. In this article, the Bayesian nonparametric approach to such problems is considered. Focusing on…

Statistics Theory · Mathematics 2025-04-24 Matteo Giordano

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan