English
Related papers

Related papers: Accelerated Relax-and-Round for Concave Coverage P…

200 papers

This paper proposes a precise signal recovery method with multilayered non-convex regularization, enhancing sparsity/low-rankness for high-dimensional signals including images and videos. In optimization-based signal recovery, multilayered…

Signal Processing · Electrical Eng. & Systems 2024-09-24 Akari Katsuma , Seisuke Kyochi , Shunsuke Ono , Ivan Selesnick

Solving point-wise feature correspondence in visual data is a fundamental problem in computer vision. A powerful model that addresses this challenge is to formulate it as graph matching, which entails solving a Quadratic Assignment Problem…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yongqing Liang , Huijun Han , Xin Li

We propose an accelerated meta-algorithm, which allows to obtain accelerated methods for convex unconstrained minimization in different settings. As an application of the general scheme we propose nearly optimal methods for minimizing…

We give a lower bound on the iteration complexity of a natural class of Lagrangean-relaxation algorithms for approximately solving packing/covering linear programs. We show that, given an input with $m$ random 0/1-constraints on $n$…

Data Structures and Algorithms · Computer Science 2015-11-23 Phil Klein , Neal E. Young

Positive linear programs (LP), also known as packing and covering linear programs, are an important class of problems that bridges computer science, operations research, and optimization. Despite the consistent efforts on this problem, all…

Data Structures and Algorithms · Computer Science 2016-11-15 Zeyuan Allen-Zhu , Lorenzo Orecchia

The relaxed maximum entropy problem is concerned with finding a probability distribution on a finite set that minimizes the relative entropy to a given prior distribution, while satisfying relaxed max-norm constraints with respect to a…

Machine Learning · Computer Science 2013-11-08 Moshe Dubiner , Matan Gavish , Yoram Singer

In this paper, we develop a unified convergence analysis framework for the Accelerated Smoothed GAp ReDuction algorithm (ASGARD) introduced in [20, Tran-Dinh et al, 2015] Unlike[20], the new analysis covers three settings in a single…

Optimization and Control · Mathematics 2021-06-16 Quoc Tran-Dinh

Packing and covering linear programs (PC-LPs) form an important class of linear programs (LPs) across computer science, operations research, and optimization. In 1993, Luby and Nisan constructed an iterative algorithm for approximately…

Data Structures and Algorithms · Computer Science 2018-02-28 Zeyuan Allen-Zhu , Lorenzo Orecchia

We study the Regularized A-optimal Design (RAOD) problem, which selects a subset of $k$ experiments to minimize the inverse of the Fisher information matrix, regularized with a scaled identity matrix. RAOD has broad applications in Bayesian…

Optimization and Control · Mathematics 2025-05-22 Yongchun Li

Signal estimation problems with smoothness and sparsity priors can be naturally modeled as quadratic optimization with $\ell_0$-"norm" constraints. Since such problems are non-convex and hard-to-solve, the standard approach is, instead, to…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez , Shaoning Han

We present a convex relaxation-based algorithm for large-scale general phase retrieval problems. General phase retrieval problems include i.a. the estimation of the phase of the optical field in the pupil plane based on intensity…

Optimization and Control · Mathematics 2018-08-15 Reinier Doelman , H. Thao Nguyen , Michel Verhaegen

In this work, we study the computational complexity of reducing the squared gradient magnitude for smooth minimax optimization problems. First, we present algorithms with accelerated $\mathcal{O}(1/k^2)$ last-iterate rates, faster than the…

Optimization and Control · Mathematics 2021-06-11 TaeHo Yoon , Ernest K. Ryu

In this paper, we present a generic framework that allows accelerating almost arbitrary non-accelerated deterministic and randomized algorithms for smooth convex optimization problems. The main approach of our envelope is the same as in…

Optimization and Control · Mathematics 2021-03-09 Anastasiya Ivanova , Dmitry Pasechnyuk , Dmitry Grishchenko , Egor Shulgin , Alexander Gasnikov , Vladislav Matyukhin

We introduce a new iterative rounding technique to round a point in a matroid polytope subject to further matroid constraints. This technique returns an independent set in one matroid with limited violations of the other ones. On top of the…

Data Structures and Algorithms · Computer Science 2018-11-26 André Linhares , Neil Olver , Chaitanya Swamy , Rico Zenklusen

Nonconvex optimization problems arise in different research fields and arouse lots of attention in signal processing, statistics and machine learning. In this work, we explore the accelerated proximal gradient method and some of its…

Optimization and Control · Mathematics 2017-12-05 Tsz Kit Lau , Yuan Yao

The linear coupling method was introduced recently by Allen-Zhu and Orecchia for solving convex optimization problems with first order methods, and it provides a conceptually simple way to integrate a gradient descent step and mirror…

Data Structures and Algorithms · Computer Science 2015-10-07 Di Wang , Satish Rao , Michael W. Mahoney

Low-rank matrix completion consists of computing a matrix of minimal complexity that recovers a given set of observations as accurately as possible. Unfortunately, existing methods for matrix completion are heuristics that, while highly…

Machine Learning · Computer Science 2026-03-12 Dimitris Bertsimas , Ryan Cory-Wright , Sean Lo , Jean Pauphilet

We consider a generalization of the densest subhypergraph problem where nonnegative rewards are given for including partial hyperedges in a dense subhypergraph. Prior work addressed this problem only in cases where reward functions are…

Data Structures and Algorithms · Computer Science 2025-06-17 Vedangi Bengali , Nikolaj Tatti , Iiro Kumpulainen , Florian Adriaens , Nate Veldt

In this paper, we introduce a higher-order multiscale method for time-dependent problems with highly oscillatory coefficients. Building on the localized orthogonal decomposition (LOD) framework, we construct enriched correction operators to…

Numerical Analysis · Mathematics 2026-05-15 Balaje Kalyanaraman , Felix Krumbiegel , Roland Maier , Siyang Wang

We propose an accelerated forward-backward method with fast convergence rate for finding a minimizer of a decomposable nonsmooth convex function over a closed convex set, and name it smoothing accelerated proximal gradient (SAPG) algorithm.…

Optimization and Control · Mathematics 2021-10-05 Wei Bian , Fan Wu