English
Related papers

Related papers: Sharp Ascent--Descent Spectral Stability under Str…

200 papers

Stochastic approximation (SA) is a classical approach for stochastic convex optimization. Previous studies have demonstrated that the convergence rate of SA can be improved by introducing either smoothness or strong convexity condition. In…

Machine Learning · Computer Science 2019-01-29 Lijun Zhang , Zhi-Hua Zhou

This paper establishes several sharp spectral results for analytic quasiperiodic Schrodinger operators. Key contributions include: (1) exact exponential decay rates for spectral gaps of the almost Mathieu operator, addressing a question…

Dynamical Systems · Mathematics 2025-11-25 Lingrui Ge , Jiangong You , Qi Zhou

This paper is devoted to providing quantitative bounds on the location of eigenvalues, both discrete and embedded, of non self-adjoint Lam\'e operators of elasticity $-\Delta^\ast + V$ in terms of suitable norms of the potential $V$. In…

Spectral Theory · Mathematics 2021-01-26 Biagio Cassano , Lucrezia Cossetti , Luca Fanelli

In high-dimensional learning, models remain stable until they collapse abruptly once the sample size falls below a critical level. This instability is not algorithm-specific but a geometric mechanism: when the weakest Fisher eigendirection…

Machine Learning · Statistics 2025-11-26 William Hao-Cheng Huang

Stochastic gradient descent (SGD) is a foundational algorithm for large-scale statistical learning and stochastic optimization. However, statistical inference based on SGD iterates remains challenging when stochastic gradients have infinite…

Machine Learning · Statistics 2026-05-26 Jose Blanchet , Peter Glynn , Wenhao Yang

Sparse graphs with bounded average degree form a rich class of discrete structures where local geometry strongly influences global behavior. The Benjamini-Schramm (BS) convergence offers a natural framework to describe their asymptotic…

Probability · Mathematics 2025-10-14 Charles Bordenave

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

Machine Learning · Statistics 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

We analyze the constant step size subgradient method on nonsmooth, nonconvex functions. We identify geometric assumptions on the objective function under which i) its domain admits a partition (stratification) into smooth manifolds (strata)…

Optimization and Control · Mathematics 2026-04-21 Evgenii Chzhen , Sholom Schechtman

We study the problem of solving fixed-point equations for seminorm-contractive operators and establish foundational results on the non-asymptotic behavior of iterative algorithms in both deterministic and stochastic settings. Specifically,…

Machine Learning · Computer Science 2025-02-21 Zaiwei Chen , Sheng Zhang , Zhe Zhang , Shaan Ul Haque , Siva Theja Maguluri

Recent studies have shown that quasinormal modes suffer from spectral instabilities, a frailty of black holes that leads to disproportional migration of their spectra in the complex plane when black-hole effective potentials are modified by…

General Relativity and Quantum Cosmology · Physics 2023-11-16 Aubin Courty , Kyriakos Destounis , Paolo Pani

We study stochastic gradient descent {\em without replacement} (\sgdwor) for smooth convex functions. \sgdwor is widely observed to converge faster than true \sgd where each sample is drawn independently {\em with replacement}…

Optimization and Control · Mathematics 2020-02-28 Prateek Jain , Dheeraj Nagaraj , Praneeth Netrapalli

We present a sparse convex-relaxation framework for estimating effective local scaling exponents from short boundary-anchored velocity-increment profiles ($N\approx40$). The detector solves an $\ell_1$-regularized regression in a mixed…

Fluid Dynamics · Physics 2026-04-07 D Yang Eng

This work establishes a rigorous connection between stability properties of discrete-time algorithms (DTAs) and corresponding continuous-time dynamical systems derived through $ O(s^r) $-resolution ordinary differential equations (ODEs). We…

Optimization and Control · Mathematics 2026-03-03 Amir Ali Farzin , Yuen-Man Pun , Philipp Braun , Iman Shames

We study a class of non-convex and non-smooth problems with \textit{rank} regularization to promote sparsity in optimal solution. We propose to apply the proximal gradient descent method to solve the problem and accelerate the process with…

Optimization and Control · Mathematics 2023-07-28 Mengyuan Zhang , Kai Liu

We outline a recently developed theory of impedance-matching, or reflectionless excitation of arbitrary finite photonic structures in any dimension. It describes the necessary and sufficient conditions for perfectly reflectionless…

Nonsmooth sparsity constrained optimization encompasses a broad spectrum of applications in machine learning. This problem is generally non-convex and NP-hard. Existing solutions to this problem exhibit several notable limitations,…

Optimization and Control · Mathematics 2023-12-18 Ganzhao Yuan

We provide a general theorem on the asymptotic behavior of stochastic processes that conform to a relaxed supermartingale condition. The distinguishing feature of our result is that it provides quantitative convergence guarantees at a much…

Optimization and Control · Mathematics 2026-05-11 Morenikeji Neri , Nicholas Pischke , Thomas Powell

Tuning hyperparameters, such as the stepsize, presents a major challenge of training machine learning models. To address this challenge, numerous adaptive optimization algorithms have been developed that achieve near-optimal complexities,…

Optimization and Control · Mathematics 2023-11-07 Florian Hübler , Junchi Yang , Xiang Li , Niao He

This work presents a sum-of-squares (SOS) based framework to perform data-driven stabilization and robust control tasks on discrete-time linear systems where the full-state observations are corrupted by L-infinity bounded input,…

Optimization and Control · Mathematics 2023-03-31 Jared Miller , Tianyu Dai , Mario Sznaier

In this paper, we prove the codimension-one nonlinear asymptotic stability of the extremal Reissner-Nordstr\"om family of black holes in the spherically symmetric Einstein-Maxwell-neutral scalar field model, up to and including the event…

General Relativity and Quantum Cosmology · Physics 2026-01-16 Yannis Angelopoulos , Christoph Kehle , Ryan Unger