English
Related papers

Related papers: Parallel Quasi-concave set optimization: A new fro…

200 papers

We give the first approximation algorithm for mixed packing and covering semidefinite programs (SDPs) with polylogarithmic dependence on width. Mixed packing and covering SDPs constitute a fundamental algorithmic primitive with recent…

Data Structures and Algorithms · Computer Science 2021-07-13 Arun Jambulapati , Yin Tat Lee , Jerry Li , Swati Padmanabhan , Kevin Tian

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

The class of quasiseparable matrices is defined by the property that any submatrix entirely below or above the main diagonal has small rank, namely below a bound called the order of quasiseparability. These matrices arise naturally in…

Symbolic Computation · Computer Science 2019-10-22 Clement Pernet , Arne Storjohann

A fundamental task underlying many important optimization problems, from influence maximization to sensor placement to content recommendation, is to select the optimal group of $k$ items from a larger set. Submodularity has been very…

Data Structures and Algorithms · Computer Science 2022-03-02 Jon Kleinberg , Emily Ryu , Éva Tardos

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for parallel…

Machine Learning · Statistics 2023-02-07 Jeffrey Chan , Aldo Pacchiano , Nilesh Tripuraneni , Yun S. Song , Peter Bartlett , Michael I. Jordan

In this paper we consider finite sum composite convex optimization problems with many functional constraints. The objective function is expressed as a finite sum of two terms, one of which admits easy computation of (sub)gradients while the…

Optimization and Control · Mathematics 2024-12-03 Nitesh Kumar Singh , Ion Necoara , Vyacheslav Kungurtsev

Constrained maximization of submodular functions poses a central problem in combinatorial optimization. In many realistic scenarios, a number of agents need to maximize multiple submodular objectives over the same ground set. We study such…

Data Structures and Algorithms · Computer Science 2024-07-22 Georgios Amanatidis , Georgios Birmpas , Philip Lazos , Stefano Leonardi , Rebecca Reiffenhäuser

In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum…

Optimization and Control · Mathematics 2024-12-03 Ion Necoara , Nitesh Kumar Singh

In this paper, we study the communication complexity for the problem of computing a conjunctive query on a large database in a parallel setting with $p$ servers. In contrast to previous work, where upper and lower bounds on the…

Databases · Computer Science 2016-04-08 Paul Beame , Paraschos Koutris , Dan Suciu

In this article, we propose a quasi-Newton method for unconstrained set optimization problems to find its weakly minimal solutions with respect to lower set-less ordering. The set-valued objective mapping under consideration is given by a…

Optimization and Control · Mathematics 2025-01-10 Debdas Ghosh , Anshika , Jen-Chih Yao , Xiaopeng Zhao

A new result in convex analysis on the calculation of proximity operators in certain scaled norms is derived. We describe efficient implementations of the proximity calculation for a useful class of functions; the implementations exploit…

Optimization and Control · Mathematics 2013-03-04 Stephen Becker , M. Jalal Fadili

In many naturally occurring optimization problems one needs to ensure that the definition of the optimization problem lends itself to solutions that are tractable to compute. In cases where exact solutions cannot be computed tractably, it…

Machine Learning · Computer Science 2015-05-08 Bharath Sankaran , Marjan Ghazvininejad , Xinran He , David Kale , Liron Cohen

Randomized parallel algorithms for many fundamental problems achieve optimal linear work in expectation, but upgrading this guarantee to hold with high probability (whp) remains a recurring theoretical challenge. In this paper, we address…

Data Structures and Algorithms · Computer Science 2026-03-03 Chase Hutton , Adam Melrod

We design new approximation algorithms for the problems of optimizing submodular and supermodular functions subject to a single matroid constraint. Specifically, we consider the case in which we wish to maximize a nondecreasing submodular…

Data Structures and Algorithms · Computer Science 2014-12-15 Maxim Sviridenko , Jan Vondrák , Justin Ward

Sampling from high-dimensional probability distributions is fundamental in machine learning and statistics. As datasets grow larger, computational efficiency becomes increasingly important, particularly in reducing adaptive complexity,…

Data Structures and Algorithms · Computer Science 2025-09-23 Huanjian Zhou , Masashi Sugiyama

We introduce the concept of quotient-convergence for sequences of submodular set functions, providing, among others, a new framework for the study of convergence of matroids through their rank functions. Extending the limit theory of…

Combinatorics · Mathematics 2024-06-17 Kristóf Bérczi , Márton Borbényi , László Lovász , László Márton Tóth

We develop a new parallel algorithm for minimizing Lipschitz, convex functions with a stochastic subgradient oracle. The total number of queries made and the query depth, i.e., the number of parallel rounds of queries, match the prior…

Optimization and Control · Mathematics 2024-06-12 Arun Jambulapati , Aaron Sidford , Kevin Tian

Many clustering applications in machine learning and data mining rely on solving metric-constrained optimization problems. These problems are characterized by $O(n^3)$ constraints that enforce triangle inequalities on distance variables…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-30 Cameron Ruggles , Nate Veldt , David F. Gleich

Superlinear convergence has been an elusive goal for black-box nonsmooth optimization. Even in the convex case, the subgradient method is very slow, and while some cutting plane algorithms, including traditional bundle methods, are popular…

Optimization and Control · Mathematics 2019-07-30 Adrian Lewis , Calvin Wylie

Optimization problems often involve vector norms, which has led to extensive research on developing algorithms that can handle objectives beyond the $\ell_p$ norms. Our work introduces the concept of submodular norms, which are a versatile…

Data Structures and Algorithms · Computer Science 2023-10-10 Kalen Patton , Matteo Russo , Sahil Singla