English
Related papers

Related papers: Guruswami-Sinop Rounding without Higher Level Lass…

200 papers

In the non-uniform sparsest cut problem, we are given a supply graph G and a demand graph D, both with the same set of nodes V. The goal is to find a cut of V that minimizes the ratio of the total capacity on the edges of G crossing the cut…

Data Structures and Algorithms · Computer Science 2021-11-12 Vincent Cohen-Addad , Tobias Mömke , Victor Verdugo

We focus on solving the clustered lasso problem, which is a least squares problem with the $\ell_1$-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regression parameters.…

Optimization and Control · Mathematics 2019-05-02 Meixia Lin , Yong-Jin Liu , Defeng Sun , Kim-Chuan Toh

We consider column-sparse covering integer programs, a generalization of set cover, which have a long line of research of (randomized) approximation algorithms. We develop a new rounding scheme based on the Partial Resampling variant of the…

Data Structures and Algorithms · Computer Science 2023-10-13 Antares Chen , David G. Harris , Aravind Srinivasan

We propose novel optimal and parameter-free algorithms for computing an approximate solution with small (projected) gradient norm. Specifically, for computing an approximate solution such that the norm of its (projected) gradient does not…

Optimization and Control · Mathematics 2024-11-18 Guanghui Lan , Yuyuan Ouyang , Zhe Zhang

Building on the blueprint from Goemans and Williamson (1995) for the Max-Cut problem, we construct a polynomial-time approximation algorithm for orthogonally constrained quadratic optimization problems. First, we derive a semidefinite…

Optimization and Control · Mathematics 2026-03-17 Ryan Cory-Wright , Jean Pauphilet

In this paper we show lower bounds for a certain large class of algorithms solving the Graph Isomorphism problem, even on expander graph instances. Spielman [25] shows an algorithm for isomorphism of strongly regular expander graphs that…

Computational Complexity · Computer Science 2016-10-31 Aaron Snook , Grant Schoenebeck , Paolo Codenotti

Good approximations have been attained for the sparsest cut problem by rounding solutions to convex relaxations via low-distortion metric embeddings. Recently, Bryant and Tupper showed that this approach extends to the hypergraph setting by…

Data Structures and Algorithms · Computer Science 2023-03-09 Adam D. Jozefiak , F. Bruce Shepherd

We consider the problem of training a deep neural network with nonsmooth regularization to retrieve a sparse and efficient sub-structure. Our regularizer is only assumed to be lower semi-continuous and prox-bounded. We combine an adaptive…

Machine Learning · Statistics 2022-06-20 Dounia Lakhmiri , Dominique Orban , Andrea Lodi

We develop a method for optimization in shape spaces, i.e., sets of surfaces modulo re-parametrization. Unlike previously proposed gradient flows, we achieve superlinear convergence rates through a subtle approximation of the shape Hessian,…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 J. Balzer , S. Soatto

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

Semidefinite programs (SDPs) are a framework for exact or approximate optimization that have widespread application in quantum information theory. We introduce a new method for using reductions to construct integrality gaps for SDPs. These…

Quantum Physics · Physics 2019-03-18 Aram W. Harrow , Anand Natarajan , Xiaodi Wu

Regularized empirical risk minimization (rERM) has become important in data-intensive fields such as genomics and advertising, with stochastic gradient methods typically used to solve the largest problems. However, ill-conditioned…

Machine Learning · Statistics 2025-01-28 Jingruo Sun , Zachary Frangella , Madeleine Udell

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

Large-scale non-convex sparsity-constrained problems have recently gained extensive attention. Most existing deterministic optimization methods (e.g., GraSP) are not suitable for large-scale and high-dimensional problems, and thus…

Machine Learning · Computer Science 2019-12-03 Fanhua Shang , Bingkun Wei , Hongying Liu , Yuanyuan Liu , Jiacheng Zhuo

We prove a structure theorem for the feasible solutions of the Arora-Rao-Vazirani SDP relaxation on low threshold rank graphs and on small-set expanders. We show that if G is a graph of bounded threshold rank or a small-set expander, then…

Data Structures and Algorithms · Computer Science 2013-04-12 Shayan Oveis Gharan , Luca Trevisan

We develop a new technique for constructing sparse graphs that allow us to prove near-linear lower bounds on the round complexity of computing distances in the CONGEST model. Specifically, we show an $\widetilde{\Omega}(n)$ lower bound for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-18 Amir Abboud , Keren Censor-Hillel , Seri Khoury

We develop an accelerated gradient descent algorithm on the Grassmann manifold to compute the subspace spanned by a number of leading eigenvectors of a symmetric positive semi-definite matrix. This has a constant cost per iteration and a…

Optimization and Control · Mathematics 2024-06-27 Foivos Alimisis , Simon Vary , Bart Vandereycken

We study the power of the bounded-width consistency algorithm in the context of the fixed-template Promise Constraint Satisfaction Problem (PCSP). Our main technical finding is that the template of every PCSP that is solvable in bounded…

Computational Complexity · Computer Science 2021-07-14 Albert Atserias , Víctor Dalmau

Sparsity-inducing regularization problems are ubiquitous in machine learning applications, ranging from feature selection to model compression. In this paper, we present a novel stochastic method -- Orthant Based Proximal Stochastic…

Optimization and Control · Mathematics 2020-07-24 Tianyi Chen , Tianyu Ding , Bo Ji , Guanyi Wang , Jing Tian , Yixin Shi , Sheng Yi , Xiao Tu , Zhihui Zhu

A sufficient condition reported very recently for perfect recovery of a K-sparse vector via orthogonal matching pursuit (OMP) in K iterations is that the restricted isometry constant of the sensing matrix satisfies…

Information Theory · Computer Science 2014-01-06 Ling-Hua Chang , Jwo-Yuh Wu