English
Related papers

Related papers: Tight Low Degree Hardness for Optimizing Pure Sphe…

200 papers

We show that Glauber dynamics for $ p$-spin glass mixes exponentially slowly at inverse temperatures larger than a constant times $ \ln (p)/p $ for large enough $ p $. This is done by analyzing the energy landscape using Gaussian…

Probability · Mathematics 2026-05-15 Anouar Kouraich , Simone Warzel

Many machine learning applications require learning a function with a small worst-case error over the entire input domain, that is, the $L_\infty$-error, whereas most existing theoretical works only guarantee recovery in average errors such…

Machine Learning · Computer Science 2023-05-02 Kefan Dong , Tengyu Ma

In this paper, we revisit approximation properties of piecewise polynomial spaces, which contain more than ${\cal P}_{r-1}$ but not ${\cal P}_r$. We develop more accurate upper and lower error bounds that are sharper than those used in…

Numerical Analysis · Mathematics 2015-02-17 Hehu Xie , Zhimin Zhang

We study the $L^p$ mapping properties of the strong spherical maximal function, which is a multiparameter generalisation of Stein's spherical maximal function. We show that this operator is bounded on $L^p$ for $p > 2$ in all dimensions $n…

Classical Analysis and ODEs · Mathematics 2025-02-06 Jonathan Hickman , Joshua Zahl

DeepLLL algorithm (Schnorr, 1994) is a famous variant of LLL lattice basis reduction algorithm, and PotLLL algorithm (Fontein et al., 2014) and $S^2$LLL algorithm (Yasuda and Yamaguchi, 2019) are recent polynomial-time variants of DeepLLL…

Data Structures and Algorithms · Computer Science 2021-06-02 Takuto Odagawa , Koji Nuida

The PL geometric category of a polyhedron $P$, denoted $\hbox{plgcat}(P)$, provides a natural upper bound for the Lusternik--Schnirelmann category and it is defined as the minimum number of PL collapsible subpolyhedra of $P$ that cover $P$.…

Computational Geometry · Computer Science 2023-03-31 Michael Skotnica , Martin Tancer

We study the oracle complexity of producing $(\delta,\epsilon)$-stationary points of Lipschitz functions, in the sense proposed by Zhang et al. [2020]. While there exist dimension-free randomized algorithms for producing such points within…

Optimization and Control · Mathematics 2025-05-01 Guy Kornowski , Ohad Shamir

Spin glass systems as lattices of disordered magnets with random interactions have important implications within the theory of magnetization and applications to a wide-range of hard combinatorial optimization problems. Nevertheless, despite…

Disordered Systems and Neural Networks · Physics 2025-10-28 Fredrik Hasselgren , Max O. Al-Hasso , Amy Searle , Joseph Tindall , Marko von der Leyen

We study a class of optimization problems on Riemannian manifolds, where the objective function consists of a smooth term and quasi-norm type penalties with exponent $p \in (0, 1]$. The essential difficulty lies in the fact that the…

Optimization and Control · Mathematics 2026-04-21 Lei Wang , Xiaojun Chen

We consider the problem of approximating the partition function of the hard-core model on planar graphs of degree at most 4. We show that when the activity lambda is sufficiently large, there is no fully polynomial randomised approximation…

Computational Complexity · Computer Science 2014-07-08 Leslie Ann Goldberg , Mark Jerrum , Colin McQuillan

Given a random $n \times n$ symmetric matrix $\boldsymbol W$ drawn from the Gaussian orthogonal ensemble (GOE), we consider the problem of certifying an upper bound on the maximum value of the quadratic form $\boldsymbol x^\top \boldsymbol…

Data Structures and Algorithms · Computer Science 2019-04-09 Afonso S. Bandeira , Dmitriy Kunisky , Alexander S. Wein

In large-scale applications, such as machine learning, it is desirable to design non-convex optimization algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of finding a stationary point, which…

Optimization and Control · Mathematics 2025-05-15 Huanjian Zhou , Andi Han , Akiko Takeda , Masashi Sugiyama

This work studies optimal polynomial approximants (OPAs) in the classical Hardy spaces on the unit disk, $H^p$ ($1 < p < \infty$). For fixed $f\in H^p$ and $n\in\mathbb{N}$, the OPA of degree $n$ associated to $f$ is the polynomial which…

Functional Analysis · Mathematics 2024-04-24 Raymond Cheng , Christopher Felder

We derive lower bounds on the black-box oracle complexity of large-scale smooth convex minimization problems, with emphasis on minimizing smooth (with Holder continuous, with a given exponent and constant, gradient) convex functions over…

Optimization and Control · Mathematics 2018-11-29 Cristobal Guzman , Arkadi Nemirovski

We study stochastic convex optimization (SCO) with heavy-tailed gradients under pure $\varepsilon$-differential privacy (DP). Instead of assuming a bound on the worst-case Lipschitz parameter of the loss, we assume only a bounded $k$-th…

Machine Learning · Computer Science 2026-05-06 Andrew Lowy

We give improved pseudorandom generators (PRGs) for Lipschitz functions of low-degree polynomials over the hypercube. These are functions of the form psi(P(x)), where P is a low-degree polynomial and psi is a function with small Lipschitz…

Computational Complexity · Computer Science 2012-11-07 Daniel Kane , Raghu Meka

Replica symmetry breaking postulates that near optima of spin glass Hamiltonians have an ultrametric structure. Namely, near optima can be associated to leaves of a tree, and the Euclidean distance between them corresponds to the distance…

Probability · Mathematics 2022-06-22 Antonio Auffinger , Andrea Montanari , Eliran Subag

We prove lower bounds for higher-order methods in smooth non-convex finite-sum optimization. Our contribution is threefold: We first show that a deterministic algorithm cannot profit from the finite-sum structure of the objective, and that…

Optimization and Control · Mathematics 2021-07-05 Nicolas Emmenegger , Rasmus Kyng , Ahad N. Zehmakan

We formulate an affine invariant implementation of the accelerated first-order algorithm in Nesterov (1983). Its complexity bound is proportional to an affine invariant regularity constant defined with respect to the Minkowski gauge of the…

Optimization and Control · Mathematics 2016-11-29 Alexandre d'Aspremont , Cristóbal Guzmán , Martin Jaggi

It is often useful to have polynomial upper or lower bounds on a one-dimensional function that are valid over a finite interval, called a trust region. A classical way to produce polynomial bounds of degree $k$ involves bounding the range…

Numerical Analysis · Mathematics 2023-08-24 Matthew Streeter , Joshua V. Dillon