English
Related papers

Related papers: Exponential inequalities for sampling designs

200 papers

Estimating the expected value of an observable appearing in a non-equilibrium stochastic process usually involves sampling. If the observable's variance is high, many samples are required. In contrast, we show that performing the same task…

Statistical Mechanics · Physics 2015-04-07 T. H. Johnson , T. J. Elliott , S. R. Clark , D. Jaksch

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

In this paper, a novel method to adaptively approximate the solution to stochastic differential equations, which is based on compressive sampling and sparse recovery, is introduced. The proposed method consider the problem of sparse…

Numerical Analysis · Mathematics 2013-07-03 Behrooz Azarkhalili

We derive both Azuma-Hoeffding and Burkholder-type inequalities for partial sums over a rectangular grid of dimension $d$ of a random field satisfying a weak dependency assumption of projective type: the difference between the expectation…

Probability · Mathematics 2023-06-29 Gilles Blanchard , Alexandra Carpentier , Oleksandr Zadorozhnyi

We establish $L^2$-exponential convergence rate for three popular piecewise deterministic Markov processes for sampling: the randomized Hamiltonian Monte Carlo method, the zigzag process, and the bouncy particle sampler. Our analysis is…

Probability · Mathematics 2022-05-10 Jianfeng Lu , Lihan Wang

In survey sampling, survey data do not necessarily represent the target population, and the samples are often biased. However, information on the survey weights aids in the elimination of selection bias. The Horvitz-Thompson estimator is a…

Methodology · Statistics 2024-04-05 Kosuke Morikawa , Yoshikazu Terada , Jae Kwang Kim

We introduce a new concept of dissipative measure-valued martingale solutions to the stochastic compressible Euler equations. These solutions are weak in the probabilistic sense i.e., the probability space and the driving Wiener process are…

Analysis of PDEs · Mathematics 2020-12-15 Martina Hofmanova , Ujjwal Koley , Utsab Sarkar

In the context of a linear model with a sparse coefficient vector, exponential weights methods have been shown to be achieve oracle inequalities for prediction. We show that such methods also succeed at variable selection and estimation…

Statistics Theory · Mathematics 2012-09-18 Ery Arias-Castro , Karim Lounici

Averaging is an important method to extract effective macroscopic dynamics from complex systems with slow modes and fast modes. This article derives an averaged equation for a class of stochastic partial differential equations without any…

Analysis of PDEs · Mathematics 2009-04-10 W. Wang , A. J. Roberts

For a given target density, there exist an infinite number of diffusion processes which are ergodic with respect to this density. As observed in a number of papers, samplers based on nonreversible diffusion processes can significantly…

Methodology · Statistics 2017-01-17 A. B. Duncan , G. A. Pavliotis , K. C. Zygalakis

In this paper, we have established a new framework of truncated inverse sampling for estimating mean values of non-negative random variables such as binomial, Poisson, hyper-geometrical, and bounded variables. We have derived explicit…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

In this article, recent results about point processes are used in sampling theory. Precisely, we define and study a new class of sampling designs: determinantal sampling designs. The law of such designs is known, and there exists a simple…

Methodology · Statistics 2025-08-27 Vincent Loonis , Xavier Mary

This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for…

Probability · Mathematics 2013-05-06 Daniel Paulin , Lester Mackey , Joel A. Tropp

We present a novel framework for performing statistical sampling, expectation estimation, and partition function approximation using \emph{arbitrary} heuristic stochastic processes defined over discrete state spaces. Using a highly parallel…

Computation · Statistics 2015-12-04 Firas Hamze , Evgeny Andryash

There has been a renewed interest in exponential concentration inequalities for stochastic processes in probability and statistics over the last three decades. De la Pe\~{n}a \cite{d} establishes a nice exponential inequality for discrete…

Probability · Mathematics 2022-04-20 Naiqi Liu , Vladimir V. Ulyanov , Hanchao Wang

Monte Carlo methods, Variational Inference, and their combinations play a pivotal role in sampling from intractable probability distributions. However, current studies lack a unified evaluation framework, relying on disparate performance…

Machine Learning · Computer Science 2024-06-12 Denis Blessing , Xiaogang Jia , Johannes Esslinger , Francisco Vargas , Gerhard Neumann

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

To deal with very large datasets a mini-batch version of the Monte Carlo Markov Chain Stochastic Approximation Expectation-Maximization algorithm for general latent variable models is proposed. For exponential models the algorithm is shown…

Computation · Statistics 2023-08-30 Tabea Rebafka , Estelle Kuhn , Catherine Matias

Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear…

Optimization and Control · Mathematics 2021-03-30 Raj K. Velicheti , Amber Srivastava , Srinivasa M. Salapaka

Using changes of probability measure developed by \mbox{Grama} and Haeusler (Stochastic Process.\ Appl., 2000), we obtain two generalizations of the deviation inequalities of Lanzinger and Stadtm\"{u}ller (Stochastic Process.\ Appl., 2000)…

Probability · Mathematics 2017-08-03 Xiequan Fan