English
Related papers

Related papers: Upper and Lower Bounds on the Smoothed Complexity …

200 papers

Smoothed analysis is a method for analyzing the performance of algorithms, used especially for those algorithms whose running time in practice is significantly better than what can be proven through worst-case analysis. Spielman and Teng…

Data Structures and Algorithms · Computer Science 2026-05-26 Eleon Bach , Sophie Huiberts

Explaining the excellent practical performance of the simplex method for linear programming has been a major topic of research for over 50 years. One of the most successful frameworks for understanding the simplex method was given by…

Data Structures and Algorithms · Computer Science 2019-06-12 Daniel Dadush , Sophie Huiberts

The smoothed analysis of algorithms is concerned with the expected running time of an algorithm under slight random perturbations of arbitrary inputs. Spielman and Teng proved that the shadow-vertex simplex method has polynomial smoothed…

Data Structures and Algorithms · Computer Science 2016-12-23 Roman Vershynin

This paper introduces a smoothed proximal Lagrangian method for minimizing a nonconvex smooth function over a convex domain with additional explicit convex nonlinear constraints. Two key features are 1) the proposed method is single-looped,…

Optimization and Control · Mathematics 2024-08-28 Wenqiang Pu , Kaizhao Sun , Jiawei Zhang

Smoothed analysis is a new way of analyzing algorithms introduced by Spielman and Teng (J. ACM, 2004). Classical methods like worst-case or average-case analysis have accompanying complexity classes, like P and AvgP, respectively. While…

Computational Complexity · Computer Science 2015-03-20 Markus Bläser , Bodo Manthey

We perform a smoothed analysis of the termination phase of an interior-point method. By combining this analysis with the smoothed analysis of Renegar's interior-point algorithm by Dunagan, Spielman and Teng, we show that the smoothed…

Data Structures and Algorithms · Computer Science 2007-05-23 Daniel A. Spielman , Shang-Hua Teng

We study the simplex method over polyhedra satisfying certain "discrete curvature" lower bounds, which enforce that the boundary always meets vertices at sharp angles. Motivated by linear programs with totally unimodular constraint…

Data Structures and Algorithms · Computer Science 2014-12-23 Daniel Dadush , Nicolai Hähnle

We introduce the smoothed analysis of algorithms, which is a hybrid of the worst-case and average-case analysis of algorithms. In smoothed analysis, we measure the maximum over inputs of the expected performance of an algorithm under small…

Data Structures and Algorithms · Computer Science 2009-09-25 Daniel A. Spielman , Shang-Hua Teng

The existence of a pivot rule for the simplex method that guarantees a strongly polynomial run-time is a longstanding, fundamental open problem in the theory of linear programming. The leading pivot rule in theory is the shadow pivot rule,…

Optimization and Control · Mathematics 2024-05-09 Alexander E. Black

We study the complexity of smoothed agnostic learning of halfspaces on $\{\pm 1\}^n$ under uniform marginals in the model of~\cite{KM25}, where each input coordinate is independently flipped with probability $\sigma \in (0, {1}/{2})$. We…

Machine Learning · Computer Science 2026-05-14 Tim Sinen

We present a randomized polynomial-time simplex algorithm with higher probability and tighter bounds for linear programming by applying improved quasi-convex properties, a logarithmic rounding on a given polytope and its logarithmic…

Computational Complexity · Computer Science 2026-05-01 Daniel Gibor

The 2-opt heuristic is a very simple local search heuristic for the traveling salesperson problem. In practice it usually converges quickly to solutions within a few percentages of optimality. In contrast to this, its running-time is…

Data Structures and Algorithms · Computer Science 2023-08-02 Marvin Künnemann , Bodo Manthey , Rianne Veenstra

Narrowing the gap between theory and practice is a longstanding goal of the algorithm analysis community. To further progress our understanding of how algorithms work in practice, we propose a new algorithm analysis framework that we call…

Data Structures and Algorithms · Computer Science 2025-10-27 Eleon Bach , Alexander E. Black , Sophie Huiberts , Sean Kafer

Smoothed analysis is a framework for analyzing the complexity of an algorithm, acting as a bridge between average and worst-case behaviour. For example, Quicksort and the Simplex algorithm are widely used in practical applications, despite…

Machine Learning · Computer Science 2015-03-29 Bichen Shi , Michel Schellekens , Georgiana Ifrim

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Specifically, we focus…

Machine Learning · Computer Science 2026-02-25 Ilias Diakonikolas , Daniel M. Kane

Recent advances in randomized incremental methods for minimizing $L$-smooth $\mu$-strongly convex finite sums have culminated in tight complexity of $\tilde{O}((n+\sqrt{n L/\mu})\log(1/\epsilon))$ and $O(n+\sqrt{nL/\epsilon})$, where…

Machine Learning · Computer Science 2020-02-11 Yossi Arjevani , Amit Daniely , Stefanie Jegelka , Hongzhou Lin

We propose a new algorithm that finds an $\varepsilon$-approximate fixed point of a smooth function from the $n$-dimensional $\ell_2$ unit ball to itself. We use the general framework of finding approximate solutions to a variational…

Computer Science and Game Theory · Computer Science 2025-01-22 Idan Attias , Yuval Dagan , Constantinos Daskalakis , Rui Yao , Manolis Zampetakis

It is well-known that the lower bound of iteration complexity for solving nonconvex unconstrained optimization problems is $\Omega(1/\epsilon^2)$, which can be achieved by standard gradient descent algorithm when the objective function is…

Optimization and Control · Mathematics 2022-11-02 Jiawei Zhang , Wenqiang Pu , Zhi-Quan Luo

In this paper, we revisit the smooth and strongly-convex-strongly-concave minimax optimization problem. Zhang et al. (2021) and Ibrahim et al. (2020) established the lower bound $\Omega\left(\sqrt{\kappa_x\kappa_y} \log…

Optimization and Control · Mathematics 2022-05-12 Dmitry Kovalev , Alexander Gasnikov

In recent years, non-convex optimization problems are more often described by generalized $(L_0, L_1)$-smoothness assumption rather than standard one. Meanwhile, severely corrupted data used in these problems has increased the demand for…

Optimization and Control · Mathematics 2025-05-28 Nikita Kornilov , Philip Zmushko , Andrei Semenov , Mark Ikonnikov , Alexander Gasnikov , Alexander Beznosikov
‹ Prev 1 2 3 10 Next ›