English
Related papers

Related papers: Approximation of optimization problems with constr…

200 papers

We consider potentially non-convex optimization problems, for which optimal rates of approximation depend on the dimension of the parameter space and the smoothness of the function to be optimized. In this paper, we propose an algorithm…

Machine Learning · Computer Science 2022-04-12 Blake Woodworth , Francis Bach , Alessandro Rudi

Motivated by applications in robotics and computer vision, we study problems related to spatial reasoning of a 3D environment using sublevel sets of polynomials. These include: tightly containing a cloud of points (e.g., representing an…

Optimization and Control · Mathematics 2017-03-09 Amir Ali Ahmadi , Georgina Hall , Ameesh Makadia , Vikas Sindhwani

Numerous interesting properties in nonlinear systems analysis can be written as polynomial optimization problems with nonconvex sum-of-squares problems. To solve those problems efficiently, we propose a sequential approach of local…

Optimization and Control · Mathematics 2023-10-03 Torbjørn Cunis , Benoît Legat

In this paper we propose a convex Sum-of-Squares optimization problem for finding outer approximations of forward reachable sets for nonlinear uncertain Ordinary Differential Equations (ODE's) with either (or both) L2 or point-wise bounded…

Dynamical Systems · Mathematics 2019-02-01 Morgan Jones , Matthew M. Peet

Transport-based density estimation methods are receiving growing interest because of their ability to efficiently generate samples from the approximated density. We further invertigate the sequential transport maps framework proposed from…

Machine Learning · Statistics 2024-10-03 Benjamin Zanger , Olivier Zahm , Tiangang Cui , Martin Schreiber

Given a graph and an integer $k$, Densest $k$-Subgraph is the algorithmic task of finding the subgraph on $k$ vertices with the maximum number of edges. This is a fundamental problem that has been subject to intense study for decades, with…

Computational Complexity · Computer Science 2023-03-31 Chris Jones , Aaron Potechin , Goutham Rajendran , Jeff Xu

This chapter investigates how symmetries can be used to reduce the computational complexity in polynomial optimization problems. A focus will be specifically given on the Moment-SOS hierarchy in polynomial optimization, where results from…

Optimization and Control · Mathematics 2023-05-10 Philippe Moustrou , Cordian Riener , Hugues Verdure

We address black-box convex optimization problems, where the objective and constraint functions are not explicitly known but can be sampled within the feasible set. The challenge is thus to generate a sequence of feasible points converging…

Optimization and Control · Mathematics 2022-11-08 Baiwei Guo , Yuning Jiang , Maryam Kamgarpour , Giancarlo Ferrari-Trecate

We study a class of combinatorial scheduling problems characterized by a particular type of constraint often associated with electrical power or gas energy. This constraint appears in several practical applications and is expressed as a sum…

Data Structures and Algorithms · Computer Science 2023-12-27 Trung Thanh Nguyen , Khaled Elbassioni , Areg Karapetyan , Majid Khonji

The Sum of Squares (\sos{}) hierarchy gives an automatized technique to create a family of increasingly tight convex relaxations for binary programs. There are several problems for which a constant number of rounds of this hierarchy give…

Data Structures and Algorithms · Computer Science 2020-05-19 Victor Verdugo , José Verschae , Andreas Wiese

We introduce a new framework for unifying and systematizing the performance analysis of first-order black-box optimization algorithms for unconstrained convex minimization. The low-cost iteration complexity enjoyed by first-order algorithms…

Optimization and Control · Mathematics 2021-06-23 Sandra S. Y. Tan , Antonios Varvitsiotis , Vincent Y. F. Tan

The minimum sum-of-squares clustering (MSSC), or k-means type clustering, is traditionally considered an unsupervised learning task. In recent years, the use of background knowledge to improve the cluster quality and promote…

Optimization and Control · Mathematics 2022-07-26 Veronica Piccialli , Anna Russo Russo , Antonio M. Sudoso

The Sum-of-Squares (SoS) hierarchy is a semi-definite programming meta-algorithm that captures state-of-the-art polynomial time guarantees for many optimization problems such as Max-$k$-CSPs and Tensor PCA. On the flip side, a SoS lower…

Computational Complexity · Computer Science 2020-09-07 Mrinalkanti Ghosh , Fernando Granha Jeronimo , Chris Jones , Aaron Potechin , Goutham Rajendran

We construct near optimal linear decision trees for a variety of decision problems in combinatorics and discrete geometry. For example, for any constant $k$, we construct linear decision trees that solve the $k$-SUM problem on $n$ elements…

Computational Geometry · Computer Science 2017-05-05 Daniel M. Kane , Shachar Lovett , Shay Moran

In this work, we consider convex optimization problems with smooth objective function and nonsmooth functional constraints. We propose a new stochastic gradient algorithm, called Stochastic Halfspace Approximation Method (SHAM), to solve…

Optimization and Control · Mathematics 2024-12-04 Nitesh Kumar Singh , Ion Necoara

Estimating unknown rotations from noisy measurements is an important step in SfM and other 3D vision tasks. Typically, local optimization methods susceptible to returning suboptimal local minima are used to solve the rotation averaging…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Matthew Giamou , Filip Maric , Valentin Peretroukhin , Jonathan Kelly

Finite-sum optimization has wide applications in machine learning, covering important problems such as support vector machines, regression, etc. In this paper, we initiate the study of solving finite-sum optimization problems by quantum…

Quantum Physics · Physics 2024-06-06 Yexin Zhang , Chenyi Zhang , Cong Fang , Liwei Wang , Tongyang Li

We investigate how to solve smooth matrix optimization problems with general linear inequality constraints on the eigenvalues of a symmetric matrix. We present solution methods to obtain exact global minima for linear objective functions,…

Optimization and Control · Mathematics 2025-07-23 Casey Garner , Gilad Lerman , Shuzhong Zhang

High-order tensor methods that employ Taylor-based local models (of degree $p\ge 3$) within adaptive regularization frameworks have been recently proposed for both convex and nonconvex optimization problems. They have been shown to have…

Optimization and Control · Mathematics 2024-04-19 Wenqi Zhu , Coralia Cartis

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev