English
Related papers

Related papers: Saddle Point Approximation and Central Limit Theor…

200 papers

We examine the behaviour of the Laplace and saddlepoint approximations in the high-dimensional setting, where the dimension of the model is allowed to increase with the number of observations. Approximations to the joint density, the…

Statistics Theory · Mathematics 2023-11-09 Yanbo Tang , Nancy Reid

We develop new higher-order asymptotic techniques for the Gaussian maximum likelihood estimator in a spatial panel data model, with fixed effects, time-varying covariates, and spatially correlated errors. Our saddlepoint density and tail…

Statistics Theory · Mathematics 2021-07-14 Chaonan Jiang , Davide La Vecchia , Elvezio Ronchetti , Olivier Scaillet

Large-scale testing in modern applications such as genomics often entails a trade-off between accuracy and speed: multiplicity corrections push cutoffs deep into the tails, where normal approximations can fail, while resampling is accurate…

Methodology · Statistics 2025-11-21 Ziang Niu , Jyotishka Ray Choudhury , Eugene Katsevich

Stochastic saddle point (SSP) problems are, in general, less studied compared to stochastic minimization problems. However, SSP problems emerge from machine learning (adversarial training, e.g., GAN, AUC maximization), statistics (robust…

Optimization and Control · Mathematics 2023-12-14 Vitali Pirau

We obtain two theorems extending the use of a saddlepoint approximation to multiparameter problems for likelihood ratio-like statistics which allow their use in permutation and rank tests and could be used in bootstrap approximations. In…

Statistics Theory · Mathematics 2012-03-15 John Kolassa , John Robinson

In this work, we study the asymptotic randomness of an algorithmic estimator of the saddle point of a globally convex-concave and locally strongly-convex strongly-concave objective. Specifically, we show that the averaged iterates of a…

Optimization and Control · Mathematics 2023-11-07 Abhishek Roy , Yi-An Ma

This paper derives central limit and bootstrap theorems for probabilities that sums of centered high-dimensional random vectors hit hyperrectangles and sparsely convex sets. Specifically, we derive Gaussian and bootstrap approximations for…

Statistics Theory · Mathematics 2016-03-09 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

We consider stochastic strongly-convex-strongly-concave (SCSC) saddle point (SP) problems which frequently arise in applications ranging from distributionally robust learning to game theory and fairness in machine learning. We focus on the…

Optimization and Control · Mathematics 2023-07-17 Yassine Laguel , Necdet Serhat Aybat , Mert Gürbüzbalaban

Let $X_1,\dots,X_n$ be independent centered random vectors in $\mathbb{R}^d$. This paper shows that, even when $d$ may grow with $n$, the probability $P(n^{-1/2}\sum_{i=1}^nX_i\in A)$ can be approximated by its Gaussian analog uniformly in…

Statistics Theory · Mathematics 2022-03-08 Yuta Koike

The challenges posed by complex stochastic models used in computational ecology, biology and genetics have stimulated the development of approximate approaches to statistical inference. Here we focus on Synthetic Likelihood (SL), a…

Methodology · Statistics 2017-06-09 Matteo Fasiolo , Simon N. Wood , Florian Hartig , Mark V. Bravington

A saddlepoint approximation of the Student's t-statistic was derived by Daniels and Young [Biometrika 78 (1991) 169-179] under the very stringent exponential moment condition that requires that the underlying density function go down at…

Statistics Theory · Mathematics 2007-06-13 Bing-Yi Jing , Qi-Man Shao , Wang Zhou

This paper studies the generalization bounds for the empirical saddle point (ESP) solution to stochastic saddle point (SSP) problems. For SSP with Lipschitz continuous and strongly convex-strongly concave objective functions, we establish…

Optimization and Control · Mathematics 2020-06-04 Junyu Zhang , Mingyi Hong , Mengdi Wang , Shuzhong Zhang

This paper introduces an upper bound on the absolute difference between: (a) the cumulative distribution function (CDF) of the sum of a finite number of independent and identically distributed random variables with finite absolute third…

Information Theory · Computer Science 2020-07-22 Dadja Anade , Jean-Marie Gorce , Philippe Mary , Samir Perlaza

For a finite set $A\subset \mathbb{R}^d$, let $\Delta(A)$ denote the spread of $A$, which is the ratio of the maximum pairwise distance to the minimum pairwise distance. For a positive integer $n$, let $\gamma_d(n)$ denote the largest…

Combinatorics · Mathematics 2022-12-20 Adrian Dumitrescu , Csaba D. Tóth

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

The large N limit of mean spectral density for the ensemble of NxN sub-unitary matrices derived by Wei and Fyodorov (J. Phys. A: Math. Theor. 41 (2008) 50201) is calculated by a modification of the saddle point method. It is shown that the…

Mathematical Physics · Physics 2015-05-14 E. Bogomolny

This paper deals with the Gaussian and bootstrap approximations to the distribution of the max statistic in high dimensions. This statistic takes the form of the maximum over components of the sum of independent random vectors and its…

Statistics Theory · Mathematics 2022-05-31 Victor Chernozhukov , Denis Chetverikov , Kengo Kato , Yuta Koike

We investigate saddlepoint approximations applied to the score test statistic in genome-wide association studies with binary phenotypes. The inaccuracy in the normal approximation of the score test statistic increases with increasing sample…

A \emph{saddlepoint} of an $n \times n$ matrix is an entry that is the maximum of its row and the minimum of its column. Saddlepoints give the \emph{value} of a two-player zero-sum game, corresponding to its pure-strategy Nash equilibria;…

Computational Complexity · Computer Science 2024-01-17 Justin Dallant , Frederik Haagensen , Riko Jacob , László Kozma , Sebastian Wild

This paper provides a non-asymptotic analysis of linear stochastic approximation (LSA) algorithms with fixed stepsize. This family of methods arises in many machine learning tasks and is used to obtain approximate solutions of a linear…

Machine Learning · Statistics 2021-06-03 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Kevin Scaman , Hoi-To Wai
‹ Prev 1 2 3 10 Next ›