English
Related papers

Related papers: Optimizing Low Dimensional Functions over the Inte…

200 papers

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is…

Machine Learning · Computer Science 2018-09-28 Dan Garber , Atara Kaplan

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

Constrained Optimization solution algorithms are restricted to point based solutions. In practice, single or multiple objectives must be satisfied, wherein both the objective function and constraints can be non-convex resulting in multiple…

Neural and Evolutionary Computing · Computer Science 2021-01-05 Gurpreet Singh , Soumyajit Gupta , Matthew Lease

Interior point methods for solving linearly constrained convex programming involve a variable projection matrix at each iteration to deal with the linear constraints. This matrix often becomes ill-conditioned near the boundary of the…

Optimization and Control · Mathematics 2024-12-31 Xun Qian , Li-Zhi Liao , Jie Sun

We derive lower bounds on the black-box oracle complexity of large-scale smooth convex minimization problems, with emphasis on minimizing smooth (with Holder continuous, with a given exponent and constant, gradient) convex functions over…

Optimization and Control · Mathematics 2018-11-29 Cristobal Guzman , Arkadi Nemirovski

Functionally constrained stochastic optimization problems, where neither the objective function nor the constraint functions are analytically available, arise frequently in machine learning applications. In this work, assuming we only have…

Optimization and Control · Mathematics 2022-10-11 Anthony Nguyen , Krishnakumar Balasubramanian

Constrained non-convex optimization is fundamentally challenging, as global solutions are generally intractable and constraint qualifications may not hold. However, in many applications, including safe policy optimization in control and…

Optimization and Control · Mathematics 2025-11-14 Ilyas Fatkhullin , Niao He , Guanghui Lan , Florian Wolf

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

While recent work suggests that quantum computers can speed up the solution of semidefinite programs, little is known about the quantum complexity of more general convex optimization. We present a quantum algorithm that can optimize a…

Quantum Physics · Physics 2020-01-15 Shouvanik Chakrabarti , Andrew M. Childs , Tongyang Li , Xiaodi Wu

We address optimization of nonlinear functions of the form $f(Wx)$, where $f:\R^d\to \R$ is a nonlinear function, $W$ is a $d\times n$ matrix, and feasible $x$ are in some large finite set $F$ of integer points in $\R^n$. One motivation is…

Combinatorics · Mathematics 2008-07-25 Yael Berstein , Jon Lee , Shmuel Onn , Robert Weismantel

In bi-objective integer optimization the optimal result corresponds to a set of non-dominated solutions. We propose a generic bi-objective branch-and-bound algorithm that uses a problem-independent branching rule exploiting available…

Data Structures and Algorithms · Computer Science 2018-09-19 Sophie N. Parragh , Fabien Tricoire

We consider the problem of chasing convex functions, where functions arrive over time. The player takes actions after seeing the function, and the goal is to achieve a small function cost for these actions, as well as a small cost for…

Data Structures and Algorithms · Computer Science 2020-05-29 C. J. Argue , Anupam Gupta , Guru Guruganesh

In this paper, we present the first outer approximation algorithm for multi-objective mixed-integer linear programming problems with any number of objectives. The algorithm also works for certain classes of non-linear programming problems.…

Optimization and Control · Mathematics 2022-05-04 Fritz Bökler , Sophie N. Parragh , Markus Sinnl , Fabien Tricoire

In this article, we use the monotonic optimization approach to propose an outcome-space outer approximation by copolyblocks for solving strictly quasiconvex multiobjective programming problems and especially in the case that the objective…

Optimization and Control · Mathematics 2020-03-26 Tran Ngoc Thang , Vijender Kumar Solanki , Tuan Anh Dao , Nguyen Thi Ngoc Anh , Hai V. Pham

One of the most effective algorithms for differentially private learning and optimization is objective perturbation. This technique augments a given optimization problem (e.g. deriving from an ERM problem) with a random linear term, and…

Machine Learning · Computer Science 2021-01-01 Seth Neel , Aaron Roth , Giuseppe Vietri , Zhiwei Steven Wu

We consider the problem of minimizing a smooth, Lipschitz, convex function over a compact, convex set using sub-zeroth-order oracles: an oracle that outputs the sign of the directional derivative for a given point and a given direction, an…

Optimization and Control · Mathematics 2021-03-02 Mustafa O. Karabag , Cyrus Neary , Ufuk Topcu

We consider the global minimization of smooth functions based solely on function evaluations. Algorithms that achieve the optimal number of function evaluations for a given precision level typically rely on explicitly constructing an…

Optimization and Control · Mathematics 2020-12-23 Alessandro Rudi , Ulysse Marteau-Ferey , Francis Bach

We study the problem of maximizing a monotone submodular set function subject to linear packing constraints. An instance of this problem consists of a matrix $A \in [0,1]^{m \times n}$, a vector $b \in [1,\infty)^m$, and a monotone…

Data Structures and Algorithms · Computer Science 2012-05-01 Yossi Azar , Iftah Gamzu

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant