English
Related papers

Related papers: Online First-Order Framework for Robust Convex Opt…

200 papers

Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to…

Data Structures and Algorithms · Computer Science 2020-11-04 Marco Molinaro

We consider the problem of analyzing the probabilistic performance of first-order methods when solving convex optimization problems drawn from an unknown distribution only accessible through samples. By combining performance estimation…

Optimization and Control · Mathematics 2025-12-11 Jisun Park , Vinit Ranjan , Bartolomeo Stellato

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

Machine Learning · Computer Science 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

As predictive models are increasingly being deployed in high-stakes decision making (e.g., loan approvals), there has been growing interest in post hoc techniques which provide recourse to affected individuals. These techniques generate…

Machine Learning · Computer Science 2021-07-14 Sohini Upadhyay , Shalmali Joshi , Himabindu Lakkaraju

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

Robust optimization is a very popular means to address decision-making problems affected by uncertainty. Its success has been fueled by its attractive robustness and scalability properties, by ease of modeling, and by the limited…

Optimization and Control · Mathematics 2020-06-17 Phebe Vayanos , Qing Jin , George Elissaios

This paper proposes a new robust optimization (RO) formulation namely the RO under objective functional uncertainty (ObRO). The ObRO adopts a min-max structure where the inner problem finds the worst-case objective function in a continuous…

Optimization and Control · Mathematics 2026-05-19 Yue Song , Yuxi Lu , Gang Li , Kairui Feng , Qi Liu

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

"Classical" First Order (FO) algorithms of convex optimization, such as Mirror Descent algorithm or Nesterov's optimal algorithm of smooth convex optimization, are well known to have optimal (theoretical) complexity estimates which do not…

Optimization and Control · Mathematics 2013-08-27 Bruce Cox , Anatoli Juditsky , Arkadi Nemirovski

Adaptive robust optimization problems have received significant attention in recent years, but remain notoriously difficult to solve when recourse decisions are discrete in nature. In this paper, we propose new reformulation techniques for…

Optimization and Control · Mathematics 2024-03-29 Merve Bodur , Timothy C. Y. Chan , Ian Yihang Zhu

We tackle robust optimization problems under objective uncertainty in the oracle model, i.e., when the deterministic problem is solved by an oracle. The oracle-based setup is favorable in many situations, e.g., when a compact formulation of…

Optimization and Control · Mathematics 2024-12-06 Mathieu Besançon , Jannis Kurtz

We introduce a numerical framework to verify the finite step convergence of first-order methods for parametric convex quadratic optimization. We formulate the verification problem as a mathematical optimization problem where we maximize a…

Optimization and Control · Mathematics 2025-04-18 Vinit Ranjan , Bartolomeo Stellato

We consider a broad class of first-order optimization algorithms which are \emph{oblivious}, in the sense that their step sizes are scheduled regardless of the function under consideration, except for limited side-information such as…

Optimization and Control · Mathematics 2016-05-12 Yossi Arjevani , Ohad Shamir

We derive several numerical methods for designing optimized first-order algorithms in unconstrained convex optimization settings. Our methods are based on the Performance Estimation Problem (PEP) framework, which casts the worst-case…

Optimization and Control · Mathematics 2025-07-29 Yassine Kamri , Julien M. Hendrickx , François Glineur

Multicriteria adjustable robust optimization (MARO) problems arise in a wide variety of practical settings, for example, in the design of a building's energy supply. However, no general approaches, neither for the characterization of…

Optimization and Control · Mathematics 2024-06-13 Elisabeth Halser , Elisabeth Finhold , Neele Leithäuser , Jan Schwientek , Katrin Teichert , Karl-Heinz Küfer

This thesis focuses on developing and analyzing accelerated and inexact first-order methods for solving or finding stationary points of various nonconvex composite optimization (NCO) problems. The main tools mainly come from variational and…

Optimization and Control · Mathematics 2021-12-28 Weiwei Kong

We propose a novel approach for analyzing dynamic regret of first-order constrained online convex optimization algorithms for strongly convex and Lipschitz-smooth objectives. Crucially, we provide a general analysis that is applicable to a…

Optimization and Control · Mathematics 2025-08-22 Fabian Jakob , Andrea Iannelli

This paper presents new first-order methods for achieving optimal oracle complexities in convex optimization with convex functional constraints. Oracle complexities are measured by the number of function and gradient evaluations. To achieve…

Optimization and Control · Mathematics 2026-04-17 Qi Deng , Guanghui Lan , Zhenwei Lin

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

In this paper, we study the problem of minimizing a sum of convex objective functions, which are locally available to agents in a network. Distributed optimization algorithms make it possible for the agents to cooperatively solve the…

Optimization and Control · Mathematics 2020-03-31 Fatemeh Mansoori , Ermin Wei