English
Related papers

Related papers: Nonasymptotic Gaussian Approximation for Inference…

200 papers

In this paper, we consider a stochastic system described by a differential equation admitting a spatially varying random coefficient. The differential equation has been employed to model various static physics systems such as elastic…

Probability · Mathematics 2013-09-18 Jingchen Liu , Xiang Zhou

We study time-uniform statistical inference for parameters in stochastic approximation (SA), which encompasses a bunch of applications in optimization and machine learning. To that end, we analyze the almost-sure convergence rates of the…

Machine Learning · Statistics 2024-10-22 Chuhan Xie , Kaicheng Jin , Jiadong Liang , Zhihua Zhang

We study the long time behavior of isentropic compressible Euler equations with linear damping driven by a white-in-time noise, on a one-dimensional torus. We prove the existence of a statistically stationary solution in the class of weak…

Analysis of PDEs · Mathematics 2025-11-03 Jeffrey Kuan , Krutika Tawri , Konstantina Trivisa

The Na\"ive Mean Field (NMF) approximation is widely employed in modern Machine Learning due to the huge computational gains it bestows on the statistician. Despite its popularity in practice, theoretical guarantees for high-dimensional…

Statistics Theory · Mathematics 2023-10-17 Jiaze Qiu

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

We study asymptotic anytime-valid confidence sequences for degree-two U-statistics under continuous monitoring. In the nondegenerate case, Hoeffding's projection reduces the problem to a time-uniform central limit theory for the partial…

Statistics Theory · Mathematics 2026-05-19 Leheng Cai , Qirui Hu , Weijia Li

This paper develops an analytical method of truncating inequality constrained Gaussian distributed variables where the constraints are themselves described by Gaussian distributions. Existing truncation methods either assume hard…

Systems and Control · Computer Science 2016-06-08 Andrew W. Palmer , Andrew J. Hill , Steven J. Scheding

Higher criticism is a large-scale testing procedure that can attain the optimal detection boundary for sparse and faint signals. However, there has been a lack of knowledge in most existing works about its asymptotic distribution for more…

Statistics Theory · Mathematics 2025-11-11 Jingkun Qiu

We tackle the modeling of threshold exceedances in asymptotically independent stochastic processes by constructions based on Laplace random fields. These are defined as Gaussian random fields scaled with a stochastic variable following an…

Methodology · Statistics 2016-03-09 Thomas Opitz

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Statistics Theory · Mathematics 2018-11-05 Avetik Karagulyan

In this paper we study properties of the Laplace approximation of the posterior distribution arising in nonlinear Bayesian inverse problems. Our work is motivated by Schillings et al. (2020), where it is shown that in such a setting the…

Numerical Analysis · Mathematics 2024-04-09 Tapio Helin , Remo Kretschmann

In a previous paper (gr-qc/0105100) we derived a set of near-optimal signal detection techniques for gravitational wave detectors whose noise probability distributions contain non-Gaussian tails. The methods modify standard methods by…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

Gravitational wave detectors will need optimal signal-processing algorithms to extract weak signals from the detector noise. Most algorithms designed to date are based on the unrealistic assumption that the detector noise may be modeled as…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset $S \subseteq \R^d$. This core problem in truncated statistics has long history going back to…

Statistics Theory · Mathematics 2019-08-06 Vasilis Kontonis , Christos Tzamos , Manolis Zampetakis

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

Statistics Theory · Mathematics 2025-02-24 Huiming Zhang , Song Xi Chen

The problem of network-constrained averaging is to compute the average of a set of values distributed throughout a graph G using an algorithm that can pass messages only along graph edges. We study this problem in the noisy setting, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Nima Noorshams , Martin Wainwright

In this paper, we establish non-asymptotic bounds for accuracy of normal approximation for linear two-timescale stochastic approximation (TTSA) algorithms driven by martingale difference or Markov noise. Focusing on both the last iterate…

Machine Learning · Statistics 2025-12-10 Bogdan Butyrin , Artemy Rubtsov , Alexey Naumov , Vladimir Ulyanov , Sergey Samsonov

A nonparametric Bayes approach is proposed for the problem of estimating a sparse sequence based on Gaussian random variables. We adopt the popular two-group prior with one component being a point mass at zero, and the other component being…

Methodology · Statistics 2017-05-31 Yunbo Ouyang , Feng Liang

This paper develops an asymptotic likelihood theory for triangular arrays of stationary Gaussian time series depending on a multidimensional unknown parameter. We give sufficient conditions for the associated sequence of statistical models…

Statistics Theory · Mathematics 2025-11-14 Carsten H. Chong , Fabian Mies