Lectures on optimization
Optimization and Control
2026-05-11 v1
Authors:
Sinho Chewi
Abstract
These lecture notes cover the theory of convex optimization, with a particular emphasis on first-order methods.
Keywords
Cite
@article{arxiv.2605.07006,
title = {Lectures on optimization},
author = {Sinho Chewi},
journal= {arXiv preprint arXiv:2605.07006},
year = {2026}
}
Comments
149 pages
Related papers
View all related →
Optimization and Control · Mathematics
First-Order Methods for Convex Optimization
Pavel Dvurechensky, Mathias Staudigl, Shimrit Shtern
2021-01-07
Machine Learning · Statistics
Optimization Methods for Supervised Machine Learning: From Linear Models to Deep Learning
Frank E. Curtis, Katya Scheinberg
2017-07-03
Optimization and Control · Mathematics
Optimization with First Order Algorithms
Charles Dossal, Samuel Hurault, Nicolas Papadakis
2024-10-28
Optimization and Control · Mathematics
Convex optimization
Evgeniya Vorontsova, Roland Hildebrand, Alexander Gasnikov, Fedor Stonyakin
2021-11-23
Optimization and Control · Mathematics
Conic Optimization Theory: Convexification Techniques and Numerical Algorithms
Richard Y. Zhang, Cédric Josz, Somayeh Sojoudi
2019-03-14
Optimization and Control · Mathematics
On The Convergence of First Order Methods for Quasar-Convex Optimization
Jikai Jin
2020-10-28
Optimization and Control · Mathematics
Tutorials on Advanced Optimization Methods
Wei Wei
2020-07-28
Optimization and Control · Mathematics
Recent Theoretical Advances in Non-Convex Optimization
Marina Danilova, Pavel Dvurechensky, Alexander Gasnikov, Eduard Gorbunov +3
2021-11-29
Optimization and Control · Mathematics
Set optimization - a rather short introduction
Andreas H. Hamel, Frank Heyde, Andreas Löhne, Birgit Rudloff +1
2024-01-26
Machine Learning · Computer Science
A Comparison of First-order Algorithms for Machine Learning
Yu Wei, Pock Thomas
2014-04-29
Optimization and Control · Mathematics
Trilevel and Multilevel Optimization using Monotone Operator Theory
Allahkaram Shafiei, Vyacheslav Kungurtsev, Jakub Marecek
2024-04-30
Optimization and Control · Mathematics
Alternatives for optimization in systems and control: convex and non-convex approaches
Emile Simon
2012-05-02
Optimization and Control · Mathematics
Optimization Methods for Fully Composite Problems
Nikita Doikov, Yurii Nesterov
2021-03-24
Machine Learning · Computer Science
Efficient Algorithms for Non-convex Isotonic Regression through Submodular Optimization
Francis Bach
2017-07-31
Machine Learning · Computer Science
Lecture Notes: Optimization for Machine Learning
Elad Hazan
2019-09-10
Optimization and Control · Mathematics
A First Order Method for Solving Convex Bi-Level Optimization Problems
Shoham Sabach, Shimrit Shtern
2017-02-15
Machine Learning · Computer Science
Introduction to Online Convex Optimization
Elad Hazan
2023-08-08
Logic · Mathematics
Lectures on the Epsilon Calculus
Richard Zach
2014-11-14
Optimization and Control · Mathematics
On Fundamental Proof Structures in First-Order Optimization
Baptiste Goujaud, Aymeric Dieuleveut, Adrien Taylor
2023-10-04
Numerical Analysis · Computer Science
Towards a Broader View of Theory of Computing
Narendra Karmarkar
2014-12-11
Machine Learning · Computer Science
On Graduated Optimization for Stochastic Non-Convex Problems
Elad Hazan, Kfir Y. Levy, Shai Shalev-Shwartz
2015-07-28
Optimization and Control · Mathematics
A Simple Nearly-Optimal Restart Scheme For Speeding-Up First Order Methods
James Renegar, Benjamin Grimmer
2020-10-22
Machine Learning · Computer Science
Learning From An Optimization Viewpoint
Karthik Sridharan
2012-04-19
Optimization and Control · Mathematics
Level-set methods for convex optimization
Aleksandr Y. Aravkin, James V. Burke, Dmitriy Drusvyatskiy, Michael P. Friedlander +1
2016-02-05
Optimization and Control · Mathematics
A Course in Dynamic Optimization
Bar Light
2024-10-11