English
Related papers

Related papers: When Does Dynamic Preconditioning Preserve the Pol…

200 papers

We show that the average stability notion introduced by \cite{kearns1999algorithmic, bousquet2002stability} is invariant to data preconditioning, for a wide class of generalized linear models that includes most of the known exp-concave…

Machine Learning · Computer Science 2017-04-18 Alon Gonen , Shai Shalev-Shwartz

We prove the central limit theorem (CLT) for a sequence of independent zero-mean random variables $\xi_j$, perturbed by predictable multiplicative factors $\lambda_j$ with values in intervals $[\underline\lambda_j,\overline\lambda_j]$. It…

Probability · Mathematics 2015-08-31 Dmitry B. Rokhlin

The parameters in the governing system of partial differential equations of multicompartmental poroelastic models typically vary over several orders of magnitude making its stable discretization and efficient solution a challenging task. In…

Numerical Analysis · Mathematics 2018-06-12 Qinggou Hong , Johannes Kraus , Maria Lymbery , Fadi Philo

Stochastic gradient descent (SGD) has emerged as the quintessential method in a data scientist's toolbox. Using SGD for high-stakes applications requires, however, careful quantification of the associated uncertainty. Towards that end, in…

Statistics Theory · Mathematics 2025-10-24 Bhavya Agrawalla , Krishnakumar Balasubramanian , Promit Ghosal

In this paper, employing the weak convergence method, based on a variational representation for expected values of positive functionals of a Brownian motion, we investigate moderate deviation %(CLT for abbreviation) for a class of…

Probability · Mathematics 2018-06-29 Yongqiang Suo , Jin Tao , Wei Zhang

In this manuscript, we address open questions raised by Dieker \& Yakir (2014), who proposed a novel method of estimation of (discrete) Pickands constants $\mathcal{H}^\delta_\alpha$ using a family of estimators $\xi^\delta_\alpha(T), T>0$,…

Probability · Mathematics 2025-02-19 Krzysztof Bisewski , Grigori Jasnovidov

In this paper we give the detailed error analysis of two algorithms $W_1$ and $W_2$ for computing the symplectic factorization of a symmetric positive definite and symplectic matrix $A \in \mathbb R^{2n \times 2n}$ in the form $A=LL^T$,…

Numerical Analysis · Mathematics 2024-09-11 Maksymilian Bujok , Miroslav Rozložník , Agata Smoktunowicz , Alicja Smoktunowicz

In this paper, we analyze the generalization performance of the Iterative Hard Thresholding (IHT) algorithm widely used for sparse recovery problems. The parameter estimation and sparsity recovery consistency of IHT has long been known in…

Machine Learning · Statistics 2022-03-18 Xiao-Tong Yuan , Ping Li

This work focuses on the numerical approximations of neutral stochastic delay differential equations with their drift and diffusion coefficients growing super-linearly with respect to both delay variables and state variables. Under…

Numerical Analysis · Mathematics 2024-02-15 Jingjing Cai , Ziheng Chen , Yuanling Niu

Although it is relatively easy to apply, the gradient method often displays a disappointingly slow rate of convergence. Its convergence is specially based on the structure of the matrix of the algebraic linear system, and on the choice of…

Numerical Analysis · Mathematics 2025-06-03 Ibrahima Dione

The relationship between overparameterization, stability, and generalization remains incompletely understood in the setting of discontinuous classifiers. We address this gap by establishing a generalization bound for finite function classes…

Machine Learning · Computer Science 2026-03-04 Jonas von Berg , Adalbert Fono , Massimiliano Datres , Sohir Maskey , Gitta Kutyniok

For $\alpha\in (1,2)$, we present a generalized central limit theorem for $\alpha$-stable random variables under sublinear expectation. The foundation of our proof is an interior regularity estimate for partial integro-differential…

Probability · Mathematics 2016-06-28 Erhan Bayraktar , Alexander Munk

We prove a conjecture of Arunachalam & Dutt ([AD24]) on the existence of a tolerant stabilizer testing algorithm, and achieve an exponential improvement in the parameters of the tester. Key to our argument is a generalized uncertainty…

Quantum Physics · Physics 2025-08-14 Zongbo Bao , Philippe van Dordrecht , Jonas Helsen

We study in this paper stability estimates for the fault inverse problem. In this problem, faults are assumed to be planar open surfaces in a half space elastic medium with known Lam\'e coefficients. A traction free condition is imposed on…

Analysis of PDEs · Mathematics 2019-07-24 Faouzi Triki , Darko Volkov

Linear structural error-in-variables models with univariate observations are revisited for studying modified least squares estimators of the slope and intercept. New marginal central limit theorems (CLT's) are established for these…

Statistics Theory · Mathematics 2009-09-29 Yuliya V. Martsynyuk

This paper investigates the asymptotic properties of quantile regression estimators in linear models, with a particular focus on polynomial regressors and robustness to heavy-tailed noise. Under independent and identically distributed…

Statistics Theory · Mathematics 2025-06-09 Saïd Maanan , Azzouz Dermoune , Ahmed El Ghini

Prior work (Klochkov $\&$ Zhivotovskiy, 2021) establishes at most $O\left(\log (n)/n\right)$ excess risk bounds via algorithmic stability for strongly-convex learners with high probability. We show that under the similar common assumptions…

Machine Learning · Computer Science 2025-10-31 Bowei Zhu , Shaojie Li , Mingyang Yi , Yong Liu

This paper provides a Central Limit Theorem (CLT) for a process $\{\theta_n, n\geq 0\}$ satisfying a stochastic approximation (SA) equation of the form $\theta_{n+1} = \theta_n + \gamma_{n+1} H(\theta_n,X_{n+1})$; a CLT for the associated…

Probability · Mathematics 2013-09-13 Gersende Fort

We consider non-conforming discretizations of the stationary Stokes equation in three spatial dimensions by Crouzeix-Raviart type elements. The original definition in the seminal paper by M. Crouzeix and P.-A. Raviart in 1973 is implicit…

Numerical Analysis · Mathematics 2022-11-16 Stefan Sauter , Céline Torres

We develop new sub-optimality bounds for gradient descent (GD) that depend on the conditioning of the objective along the path of optimization rather than on global, worst-case constants. Key to our proofs is directional smoothness, a…

Machine Learning · Computer Science 2025-01-15 Aaron Mishkin , Ahmed Khaled , Yuanhao Wang , Aaron Defazio , Robert M. Gower