English
Related papers

Related papers: Characterization of the norm-based robust solution…

200 papers

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

Machine Learning · Computer Science 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

This paper is concerned with solution algorithms for general convex vector optimization problems (CVOPs). So far, solution concepts and approximation algorithms for solving CVOPs exist only for bounded problems [Ararat et al. 2022, Doerfler…

Optimization and Control · Mathematics 2023-01-24 Andrea Wagner , Firdevs Ulus , Birgit Rudloff , Gabriela Kováčová , Niklas Hey

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

In nonsmooth optimization, a negative subgradient is not necessarily a descent direction, making the design of convergent descent methods based on zeroth-order and first-order information a challenging task. The well-studied bundle methods…

Optimization and Control · Mathematics 2025-05-13 Hanyang Li , Ying Cui

There is a recent surge of interest in nonconvex reformulations via low-rank factorization for stochastic convex semidefinite optimization problem in the purpose of efficiency and scalability. Compared with the original convex formulations,…

Optimization and Control · Mathematics 2018-02-27 Jinshan Zeng , Ke Ma , Yuan Yao

Vector-based algorithms are novel algorithms in optimal any-angle path planning that are motivated by bug algorithms, bypassing free space by directly conducting line-of-sight checks between two queried points, and searching along obstacle…

Robotics · Computer Science 2024-08-13 Yan Kai Lai

Efficient methods to provide sub-optimal solutions to non-convex optimization problems with knowledge of the solution's sub-optimality would facilitate the widespread application of nonlinear optimal control algorithms. To that end,…

Optimization and Control · Mathematics 2023-04-10 Prithvi Akella , Aaron D. Ames

In this paper we study the convex problem of optimizing the sum of a smooth function and a compactly supported non-smooth term with a specific separable form. We analyze the block version of the generalized conditional gradient method when…

Optimization and Control · Mathematics 2015-09-28 Amir Beck , Edouard Pauwels , Shoham Sabach

We propose a stochastic variance-reduced cubic regularized Newton method for non-convex optimization. At the core of our algorithm is a novel semi-stochastic gradient along with a semi-stochastic Hessian, which are specifically designed for…

Machine Learning · Computer Science 2018-02-14 Dongruo Zhou , Pan Xu , Quanquan Gu

We propose two new alternating direction methods to solve "fully" nonsmooth constrained convex problems. Our algorithms have the best known worst-case iteration-complexity guarantee under mild assumptions for both the objective residual and…

Optimization and Control · Mathematics 2018-01-16 Quoc Tran-Dinh , Volkan Cevher

Convex optimization problems with staged structure appear in several contexts, including optimal control, verification of deep neural networks, and isotonic regression. Off-the-shelf solvers can solve these problems but may scale poorly. We…

Optimization and Control · Mathematics 2020-10-28 Rudy Bunel , Oliver Hinder , Srinadh Bhojanapalli , Krishnamurthy , Dvijotham

We extend the standard notion of self-concordance to non-convex optimization and develop a family of second-order algorithms with global convergence guarantees. In particular, two function classes -- \textit{weakly self-concordant}…

Optimization and Control · Mathematics 2026-04-07 Donald Goldfarb , Lexiao Lai , Tianyi Lin , Jiayu Zhang

Nonconvex optimization refers to the process of solving problems whose objective or constraints are nonconvex. Historically, this type of problems have been very difficult to solve to global optimality, with traditional solvers often…

Optimization and Control · Mathematics 2025-08-12 Dimitris Bertsimas , Danique de Moor , Thodoris Koukouvinos , Demetrios Kriezis

We study the problem of high-dimensional robust mean estimation in the presence of a constant fraction of adversarial outliers. A recent line of work has provided sophisticated polynomial-time algorithms for this problem with…

Machine Learning · Computer Science 2020-05-05 Yu Cheng , Ilias Diakonikolas , Rong Ge , Mahdi Soltanolkotabi

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

In this work, we propose an outer approximation algorithm for solving bounded convex vector optimization problems (CVOPs). The scalarization model solved iteratively within the algorithm is a modification of the norm-minimizing…

Optimization and Control · Mathematics 2023-05-24 Çağın Ararat , Firdevs Ulus , Muhammad Umer

Variable order structures model situations in which the comparison between two points depends on a point-to-cone map. In this paper, an inexact projected gradient method for solving smooth constrained vector optimization problems on…

Optimization and Control · Mathematics 2019-08-09 Jose Yunier Bello Cruz , Gemayqzel Bouza Allende

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai