English
Related papers

Related papers: Sum of Squares Submodularity

200 papers

In this thesis, a new class of algorithms based on Sums of Squares Programming is developed. These allow to reduce a degree-$d$ homogeneous polynomial $T = \sum_{i = 1}^m \langle a_i, X \rangle^d $ to a quadratic form being close to a…

Numerical Analysis · Mathematics 2018-12-14 Alexander Taveira Blomenhofer

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

We study a mixed-integer set $S:=\{(x,t) \in \{0,1\}^n \times \mathbb{R}: f(x) \ge t\}$ arising in the submodular maximization problem, where $f$ is a submodular function defined over $\{0,1\}^n$. We use intersection cuts to tighten a…

Optimization and Control · Mathematics 2023-02-28 Liding Xu , Leo Liberti

We develop a general framework to significantly reduce the degree of sum-of-squares proofs by introducing new variables. To illustrate the power of this framework, we use it to speed up previous algorithms based on sum-of-squares for two…

Data Structures and Algorithms · Computer Science 2021-01-06 David Steurer , Stefan Tiegel

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

Submodular function minimization is a key problem in a wide variety of applications in machine learning, economics, game theory, computer vision, and many others. The general solver has a complexity of $O(n^3 \log^2 n . E +n^4 {\log}^{O(1)}…

Data Structures and Algorithms · Computer Science 2017-01-25 Srikumar Ramalingam , Chris Russell , Lubor Ladicky , Philip H. S. Torr

Numerical solutions of differential equations are usually not smooth functions. However, they should resemble the smoothness of the corresponding real solutions in one way or another. In two of our recent papers, a kind of spacial…

Numerical Analysis · Mathematics 2012-07-13 Tong Sun

We consider the problem of minimizing the sum of submodular set functions assuming minimization oracles of each summand function. Most existing approaches reformulate the problem as the convex minimization of the sum of the corresponding…

Machine Learning · Computer Science 2019-05-28 K S Sesh Kumar , Francis Bach , Thomas Pock

We consider min-max optimization problems for polynomial functions, where a multivariate polynomial is maximized with respect to a subset of variables, and the resulting maximal value is minimized with respect to the remaining variables.…

Optimization and Control · Mathematics 2023-06-27 Francis Bach

This paper is devoted to the problem of minimizing a sum of rational functions over a basic semialgebraic set. We provide a hierarchy of sum of squares (SOS) relaxations that is dual to the generalized moment problem approach due to…

Optimization and Control · Mathematics 2024-05-16 Feng Guo , Jie Wang , Jianhao Zheng

The release of SOSTOOLS v4.00 comes as we approach the 20th anniversary of the original release of SOSTOOLS v1.00 back in April, 2002. SOSTOOLS was originally envisioned as a flexible tool for parsing and solving polynomial optimization…

Semi-algebraic proof systems such as sum-of-squares (SoS) have attracted a lot of attention recently due to their relation to approximation algorithms: constant degree semi-algebraic proofs lead to conjecturally optimal polynomial-time…

Logic in Computer Science · Computer Science 2021-05-20 Fedor Part , Neil Thapen , Iddo Tzameret

We consider a class of sparsity-inducing regularization terms based on submodular functions. While previous work has focused on non-decreasing functions, we explore symmetric submodular functions and their \lova extensions. We show that the…

Machine Learning · Computer Science 2011-06-13 Francis Bach

We consider the problem of minimizing a function represented as a sum of submodular terms. We assume each term allows an efficient computation of {\em exchange capacities}. This holds, for example, for terms depending on a small number of…

Data Structures and Algorithms · Computer Science 2012-06-12 Vladimir Kolmogorov

Schur's transforms of a polynomial are used to count its roots in the unit disk. These are generalized them by introducing the sequence of symmetric sub-resultants of two polynomials. Although they do have a determinantal definition, we…

Symbolic Computation · Computer Science 2007-05-23 Cyril Brunie , Philippe Saux Picart

We provide a sparse version of the bounded degree SOS hierarchy BSOS [7] for polynomial optimization problems. It permits to treat large scale problems which satisfy a structured sparsity pattern. When the sparsity pattern satisfies the…

Optimization and Control · Mathematics 2017-05-30 Tillmann Weisser , Jean-Bernard Lasserre , Kim-Chuan Toh

The degree-$4$ Sum-of-Squares (SoS) SDP relaxation is a powerful algorithm that captures the best known polynomial time algorithms for a broad range of problems including MaxCut, Sparsest Cut, all MaxCSPs and tensor PCA. Despite being an…

Computational Complexity · Computer Science 2019-11-05 Sidhanth Mohanty , Prasad Raghavendra , Jeff Xu

This paper addresses the problem of sequential submodular maximization: selecting and ranking items in a sequence to optimize some composite submodular function. In contrast to most of the previous works, which assume access to the utility…

Machine Learning · Computer Science 2024-09-10 Jing Yuan , Shaojie Tang

Motivated by applications in robotics and computer vision, we study problems related to spatial reasoning of a 3D environment using sublevel sets of polynomials. These include: tightly containing a cloud of points (e.g., representing an…

Optimization and Control · Mathematics 2017-03-09 Amir Ali Ahmadi , Georgina Hall , Ameesh Makadia , Vikas Sindhwani

Submodular functions are a special class of set functions which naturally model the notion of representativeness, diversity, coverage etc. and have been shown to be computationally very efficient. A lot of past work has applied submodular…

Machine Learning · Computer Science 2022-02-24 Vishal Kaushal , Ganesh Ramakrishnan , Rishabh Iyer