English
Related papers

Related papers: Minimizing a low-dimensional convex function over …

200 papers

Given a separation oracle $\mathsf{SO}$ for a convex function $f$ defined on $\mathbb{R}^n$ that has an integral minimizer inside a box with radius $R$, we show how to find an exact minimizer of $f$ using at most (a) $O(n (n \log \log…

Data Structures and Algorithms · Computer Science 2022-09-22 Haotian Jiang

Minimizing a convex, quadratic objective of the form $f_{\mathbf{A},\mathbf{b}}(x) := \frac{1}{2}x^\top \mathbf{A} x - \langle \mathbf{b}, x \rangle$ for $\mathbf{A} \succ 0 $ is a fundamental problem in machine learning and optimization.…

Machine Learning · Computer Science 2019-04-17 Max Simchowitz

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

A key idea in convex optimization theory is to use well-structured affine functions to approximate general functions, leading to impactful developments in conjugate functions and convex duality theory. This raises the question: what are the…

Optimization and Control · Mathematics 2025-04-22 Ningji Wei

A min-max formula is proved for the minimum of an integer-valued separable discrete convex function where the minimum is taken over the set of integral elements of a box total dual integral (box-TDI) polyhedron. One variant of the theorem…

Combinatorics · Mathematics 2021-01-28 András Frank , Kazuo Murota

We consider $\min\{f(x):g(x) \le 0, ~x\in X\},$ where $X$ is a compact convex subset of $\RR^m$, and $f$ and $g$ are continuous convex functions defined on an open neighbourhood of $X$. We work in the setting of derivative-free…

Optimization and Control · Mathematics 2012-10-25 Heinz H. Bauschke , Warren L. Hare , Walaa M. Moursi

Our contribution in this paper is two folded. We consider first the case of linear programming with real coefficients and give a method which allows the computation of a new upper bound on the distance from the origin to a feasible point.…

Optimization and Control · Mathematics 2020-10-30 Beniamin Costandin , Marius Costandin , Petru Dobra

We address optimization of nonlinear functions of the form $f(Wx)$, where $f:\R^d\to \R$ is a nonlinear function, $W$ is a $d\times n$ matrix, and feasible $x$ are in some large finite set $F$ of integer points in $\R^n$. One motivation is…

Combinatorics · Mathematics 2008-07-25 Yael Berstein , Jon Lee , Shmuel Onn , Robert Weismantel

The optimization problem concerning the determination of the minimizer for the sum of convex functions holds significant importance in the realm of distributed and decentralized optimization. In scenarios where full knowledge of the…

Optimization and Control · Mathematics 2024-09-24 Kananart Kuwaranancharoen , Shreyas Sundaram

We study the complexity of optimizing highly smooth convex functions. For a positive integer $p$, we want to find an $\epsilon$-approximate minimum of a convex function $f$, given oracle access to the function and its first $p$ derivatives,…

Optimization and Control · Mathematics 2021-12-06 Ankit Garg , Robin Kothari , Praneeth Netrapalli , Suhail Sherif

Minimum Weight Cycle (MWC) is the problem of finding a simple cycle of minimum weight in a graph $G=(V,E)$. This is a fundamental graph problem with classical sequential algorithms that run in $\tilde{O}(n^3)$ and $\tilde{O}(mn)$ time where…

Data Structures and Algorithms · Computer Science 2024-05-24 Vignesh Manoharan , Vijaya Ramachandran

Assume that f is a strict convex function with a unique minimum in R^n. We divide the vector of n-variables to d groups of vector subvariables with d at least two. We assume that we can find the partial minimum of f with respect to each…

Optimization and Control · Mathematics 2019-06-06 Shmuel Friedland

This paper bridges discrete and continuous optimization approaches for decomposable submodular function minimization, in both the standard and parametric settings. We provide improved running times for this problem by reducing it to a…

Data Structures and Algorithms · Computer Science 2021-03-08 Kyriakos Axiotis , Adam Karczmarz , Anish Mukherjee , Piotr Sankowski , Adrian Vladu

Given an $n*n$ sparse symmetric matrix with $m$ nonzero entries, performing Gaussian elimination may turn some zeroes into nonzero values. To maintain the matrix sparse, we would like to minimize the number $k$ of these changes, hence…

Computational Complexity · Computer Science 2016-06-28 Yixin Cao , R. B. Sandeep

Operator convex functions defined on the positive half-line play a prominent role in the theory of quantum information, where they are used to define quantum $f$-divergences. Such functions admit integral representations in terms of…

Optimization and Control · Mathematics 2023-05-23 Oisín Faust , Hamza Fawzi

We explore separable property of the joint numerical range $G(\Bbb R^n)$ of a special class of quadratic functions and apply it to solving the smallest enclosing ball (SEB) problem which asks to find a ball $B(a,r)$ in $\Bbb R^n$ with…

Optimization and Control · Mathematics 2025-10-21 Van-Bong Nguyen , Huu-Quang Nguyen

We consider the problem of minimizing the sum of two convex functions. One of those functions has Lipschitz-continuous gradients, and can be accessed via stochastic oracles, whereas the other is "simple". We provide a Bregman-type algorithm…

Optimization and Control · Mathematics 2024-11-26 Benjamin Dubois-Taine , Francis Bach , Quentin Berthet , Adrien Taylor

Integrally convex functions constitute a fundamental function class in discrete convex analysis, including M-convex functions, L-convex functions, and many others. This paper aims at a rather comprehensive survey of recent results on…

Combinatorics · Mathematics 2023-02-23 Kazuo Murota , Akihisa Tamura

This paper studies simple bilevel problems, where a convex upper-level function is minimized over the optimal solutions of a convex lower-level problem. We first show the fundamental difficulty of simple bilevel problems, that the…

Optimization and Control · Mathematics 2025-01-28 Huaqing Zhang , Lesi Chen , Jing Xu , Jingzhao Zhang

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen