English
Related papers

Related papers: Self-Normalized Concentration Inequalities of Marg…

200 papers

We obtain moderate deviations theorems and exponential (Bernstein type) concentration inequalities for "nonconventional" sums of the form $S_N=\sum_{n=1}^N (F(\xi_{q_1(n)},\xi_{q_2(n)},...,\xi_{q_\ell(n)})-\bar F)$.

Probability · Mathematics 2019-02-11 Yeor Hafouta

We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define several notions of randomness associated with interval, rather than precise,…

Probability · Mathematics 2021-06-24 Gert de Cooman , Jasper De Bock

Intercurrent events, common in clinical trials and observational studies, affect the existence or interpretation of final outcomes. Principal stratification addresses this challenge by defining local average treatment effect estimands…

Methodology · Statistics 2025-09-22 Jiaqi Tong , Brennan Kahan , Michael O. Harhay , Fan Li

Consider a branching process $\{Z_n\}$ in a varying environment. Let $\{W_n\}$ be the natural martingale $Z_n/{\bf E}Z_n$. It converges to some random variable $W$ as $n\to\infty$. An important problem is to show that ${\bf P}(W>0)$ equals…

Probability · Mathematics 2026-04-08 Y. Kirpicheva , A. Shklyaev

The present paper is devoted to the second part of our project on asymmetric maximal inequalities, where we consider martingales in continuous time. Let $(\mathcal M,\tau)$ be a noncommutative probability space equipped with a continuous…

Probability · Mathematics 2016-11-07 Guixiang Hong , Marius Junge , Javier Parcet

Concentration inequalities are widely used for analyzing machine learning algorithms. However, current concentration inequalities cannot be applied to some of the most popular deep neural networks, notably in natural language processing.…

Machine Learning · Statistics 2021-03-22 Rémy Garnier , Raphaël Langhendries

Self-normalized processes arise naturally in many learning-related tasks. While self-normalized concentration has been extensively studied for scalar-valued processes, there are few results for multidimensional processes outside of the…

Probability · Mathematics 2025-05-02 Justin Whitehouse , Zhiwei Steven Wu , Aaditya Ramdas

In this paper, we discuss variational inequality (VI) problems without monotonicity from the perspective of convergence of projection-type algorithms. In particular, we identify existing conditions as well as present new conditions that are…

Optimization and Control · Mathematics 2023-04-11 Kevin Huang , Shuzhong Zhang

This paper presents uniform-in-time finite-sample bounds for regularized linear regression with vector-valued outputs and conditionally zero-mean subgaussian noise. By revisiting classical self-normalized martingale arguments, we obtain…

Statistics Theory · Mathematics 2026-03-20 Léo Simpson , Katrin Baumgärtner , Johannes Köhler , Moritz Diehl

We propose several exponential inequalities for self-normalized martingales similar to those established by De la Pe\~{n}a. The keystone is the introduction of a new notion of random variable heavy on left or right. Applications associated…

Statistics Theory · Mathematics 2008-11-14 Bernard Bercu , Abderrahmen Touati

Variational inference is a popular method for estimating model parameters and conditional distributions in hierarchical and mixed models, which arise frequently in many settings in the health, social, and biological sciences. Variational…

Methodology · Statistics 2019-01-10 Ted Westling , Tyler H. McCormick

In this paper, we use the framework of mod-$\phi$ convergence to prove precise large or moderate deviations for quite general sequences of real valued random variables $(X_{n})_{n \in \mathbb{N}}$, which can be lattice or non-lattice…

Probability · Mathematics 2017-02-14 Valentin Féray , Pierre-Loïc Méliot , Ashkan Nikeghbali

We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define a notion of computable randomness associated with interval, rather than precise,…

Probability · Mathematics 2017-05-05 Gert de Cooman , Jasper De Bock

This paper is focused on the moderate-deviations analysis of binary hypothesis testing. The analysis relies on a concentration inequality for discrete-parameter martingales with bounded jumps, where this inequality forms a refinement to the…

Information Theory · Computer Science 2016-11-17 Igal Sason

We consider the estimation of the mixing distribution of a normal distribution where both the shift and scale are unobserved random variables. We argue that in general, the model is not identifiable. We give an elegant non-constructive…

Statistics Theory · Mathematics 2024-08-20 Ya'acov Ritov

In this paper we survey some recent results on the central limit theorem and its weak invariance principle for stationary sequences. We also describe several maximal inequalities that are the main tool for obtaining the invariance…

Probability · Mathematics 2016-08-16 Florence Merlevède , Magda Peligrad , Sergey Utev

We establish deviation inequalities for the maxima of partial sums of a martingale differences sequence, and of a strictly stationary orthomartingale random field. These inequalities can be used to establish complete convergence of…

Probability · Mathematics 2020-03-10 Davide Giraudo

We give a Cram\'{e}r moderate deviation expansion for martingales with differences having finite conditional moments of order $2+\rho, \rho \in (0,1],$ and finite one-sided conditional exponential moments. The upper bound of the range of…

Probability · Mathematics 2020-05-11 Xiequan Fan , Ion Grama , Quansheng Liu

We obtain necessary and sufficient conditions for the regular variation of the variance of partial sums of functionals of discrete and continuous-time stationary Markov processes with normal transition operators. We also construct a class…

Probability · Mathematics 2014-05-13 George Deligiannidis , Magda Peligrad , Sergey Utev

Cram\'er type moderate deviation theorems quantify the accuracy of the relative error of the normal approximation and provide theoretical justifications for many commonly used methods in statistics. In this paper, we develop a new…

Probability · Mathematics 2016-06-07 Qi-Man Shao , Wen-Xin Zhou