English
Related papers

Related papers: On the Strength of Linear Relaxations in Ordered O…

200 papers

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

Optimization and Control · Mathematics 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

In the first part of this paper, we present a unified framework for analyzing the algorithmic complexity of any optimization problem, whether it be continuous or discrete in nature. This helps to formalize notions like "input", "size" and…

Optimization and Control · Mathematics 2022-07-06 Amitabh Basu

We investigate the information complexity of mixed-integer convex optimization under different types of oracles. We establish new lower bounds for the standard first-order oracle, improving upon the previous best known lower bound. This…

Optimization and Control · Mathematics 2023-08-23 Amitabh Basu , Hongyi Jiang , Phillip Kerger , Marco Molinaro

We consider joint optimization and learning problems arising in real-time decision systems. While most existing work focuses primarily on convex, revenue-based objectives, we extend this line of research to multi-objective formulations. In…

Optimization and Control · Mathematics 2026-04-14 Zijun Li , Aswin Kannan

In classical inverse linear optimization, one assumes a given solution is a candidate to be optimal. Real data is imperfect and noisy, so there is no guarantee this assumption is satisfied. Inspired by regression, this paper presents a…

Optimization and Control · Mathematics 2017-06-23 Timothy C. Y. Chan , Taewoo Lee , Daria Terekhov

We propose an approach to trajectory optimization for piecewise polynomial systems based on the recently proposed graphs of convex sets framework. We instantiate the framework with a convex relaxation of optimal control based on occupation…

Optimization and Control · Mathematics 2025-07-28 Etienne Buehrle , Ömer Şahin Taş , Christoph Stiller

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

Optimization and Control · Mathematics 2026-04-09 Alberto De Marchi

We propose a unified framework to address a family of classical mixed-integer optimization problems with logically constrained decision variables, including network design, facility location, unit commitment, sparse portfolio selection,…

Optimization and Control · Mathematics 2021-10-19 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Why is it that semidefinite relaxations have been so successful in numerous applications in computer vision and robotics for solving non-convex optimization problems involving rotations? In studying the empirical performance we note that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Lucas Brynte , Viktor Larsson , José Pedro Iglesias , Carl Olsson , Fredrik Kahl

Composite minimization involves a collection of smooth functions which are aggregated in a nonsmooth manner. In the convex setting, we design an algorithm by linearizing each smooth component in accordance with its main curvature. The…

Optimization and Control · Mathematics 2019-03-26 Jérôme Bolte , Zheng Chen , Edouard Pauwels

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

In high-stakes engineering applications, optimization algorithms must come with provable worst-case guarantees over a mathematically defined class of problems. Designing for the worst case, however, inevitably sacrifices performance on the…

Systems and Control · Electrical Eng. & Systems 2025-08-04 Andrea Martin , Ian R. Manchester , Luca Furieri

Solving non-convex, NP-hard optimization problems is crucial for training machine learning models, including neural networks. However, non-convexity often leads to black-box machine learning models with unclear inner workings. While convex…

Machine Learning · Computer Science 2025-03-18 Karthik Prakhya , Tolga Birdal , Alp Yurtsever

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

The classical linear ordering problem seeks a single ranking representing a given preference matrix. While suitable for homogeneous populations, it fails when observed preferences arise from several latent groups with distinct ranking…

Optimization and Control · Mathematics 2026-05-15 Juan A. Aledo , Concepción Domínguez , Juan de Dios Jaime-Alcántara , Mercedes Landete

This paper studies the isolated calmness of the optimal solution mapping and the associated Lagrange system for regularized convex composite optimization problems. Several necessary and sufficient conditions for this property are…

Optimization and Control · Mathematics 2026-01-27 Tran T. A. Nghia , Huy N. Pham

The minimization of convex functions which are only available through partial and noisy information is a key methodological problem in many disciplines. In this paper we consider convex optimization with noisy zero-th order information,…

Machine Learning · Computer Science 2016-05-27 Francis Bach , Vianney Perchet

Nonconvex optimization problems with an L1-constraint are ubiquitous, and are found in many application domains including: optimal control of hybrid systems, machine learning and statistics, and operations research. This paper shows that…

Optimization and Control · Mathematics 2017-09-27 Yonatan Mintz , Anil Aswani

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

Machine Learning · Statistics 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh