English
Related papers

Related papers: Just Take the Average! An Embarrassingly Simple $2…

200 papers

Recently [Bhattacharya et al., STOC 2015] provide the first non-trivial algorithm for the densest subgraph problem in the streaming model with additions and deletions to its edges, i.e., for dynamic graph streams. They present a…

Data Structures and Algorithms · Computer Science 2015-07-30 Hossein Esfandiari , MohammadTaghi Hajiaghayi , David P. Woodruff

We consider the maximum vertex-weighted matching problem (MVM) for non-bipartite graphs. In earlier work we have described a 2/3-approximation algorithm for the MVM on bipartite graphs (Dobrian, Halappanavar, Pothen and Al-Herz, SIAM J.…

Data Structures and Algorithms · Computer Science 2019-02-18 Ahmed Al-Herz , Alex Pothen

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is…

Machine Learning · Computer Science 2018-09-28 Dan Garber , Atara Kaplan

We consider the problem of computing shortest paths in weighted unit-disk graphs in constant dimension $d$. Although the single-source and all-pairs variants of this problem are well-studied in the plane case, no non-trivial exact distance…

Computational Geometry · Computer Science 2021-03-18 Adam Karczmarz , Jakub Pawlewicz , Piotr Sankowski

We investigate the relation of two fundamental tools in machine learning and signal processing, that is the support vector machine (SVM) for classification, and the Lasso technique used in regression. We show that the resulting optimization…

Machine Learning · Computer Science 2014-04-28 Martin Jaggi

A fast algorithm for solving the under-determined 3-D linear gravity inverse problem based on the randomized singular value decomposition (RSVD) is developed. The algorithm combines an iteratively reweighted approach for $L_1$-norm…

Numerical Analysis · Mathematics 2022-08-16 Saeed Vatankhah , Rosemary A. Renaut , Vahid E. Ardestani

In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of…

Systems and Control · Electrical Eng. & Systems 2022-04-15 Thomas Lew , Lucas Janson , Riccardo Bonalli , Marco Pavone

A lattice reduction is an algorithm that transforms the given basis of the lattice to another lattice basis such that problems like finding a shortest vector and closest vector become easier to solve. Some of the famous lattice reduction…

Data Structures and Algorithms · Computer Science 2019-12-05 Mithilesh Kumar

Many algorithms which exactly solve hard problems require branching on more or less complex structures in order to do their job. Those who design such algorithms often find themselves doing a meticulous analysis of numerous different cases…

Data Structures and Algorithms · Computer Science 2023-07-04 Radovan Červený , Ondřej Suchý

SGD (Stochastic Gradient Descent) is a popular algorithm for large scale optimization problems due to its low iterative cost. However, SGD can not achieve linear convergence rate as FGD (Full Gradient Descent) because of the inherent…

Machine Learning · Computer Science 2017-12-05 Aixiang Chen , Bingchuan Chen , Xiaolong Chai , Rui Bian , Hengguang Li

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

In this article we intend to develop a simple and implementable algorithm for minimizing a convex function over the solution set of another convex optimization problem. Such a problem is often referred to as a simple bilevel programming…

Optimization and Control · Mathematics 2025-04-17 Stephan Dempe , Joydeep Duta , Tanushree Pandit , K. S. Mallikarjuna Rao

Sourav Chatterjee, Persi Diaconis, Allan Sly and Lingfu Zhang, prompted by a question of Ramis Movassagh, renewed the study of a process proposed in the early 1980s by Jean Bourgain. A state vector $v \in \mathbb R^n$, labeled with the…

Probability · Mathematics 2022-05-11 Ramis Movassagh , Mario Szegedy , Guanyang Wang

Vassilevska and Williams (STOC 2009) showed how to count simple paths on $k$ vertices and matchings on $k/2$ edges in an $n$-vertex graph in time $n^{k/2+O(1)}$. In the same year, two different algorithms with the same runtime were given by…

Data Structures and Algorithms · Computer Science 2015-08-17 Andreas Björklund , Petteri Kaski , Łukasz Kowalik

We give a novel spectral approximation algorithm for the balanced separator problem that, given a graph G, a constant balance b \in (0,1/2], and a parameter \gamma, either finds an \Omega(b)-balanced cut of conductance O(\sqrt(\gamma)) in…

Data Structures and Algorithms · Computer Science 2011-11-08 Lorenzo Orecchia , Sushant Sachdeva , Nisheeth K. Vishnoi

Randomized SVD has become an extremely successful approach for efficiently computing a low-rank approximation of matrices. In particular the paper by Halko, Martinsson, and Tropp (SIREV 2011) contains extensive analysis, and has made it a…

Numerical Analysis · Mathematics 2020-09-25 Yuji Nakatsukasa

This paper introduces an efficient algorithm for finding the dominant generalized eigenvectors of a pair of symmetric matrices. Combining tools from approximation theory and convex optimization, we develop a simple scalable algorithm with…

Optimization and Control · Mathematics 2019-06-26 Vien V. Mai , Mikael Johansson

Given an $n$-point metric space, consider the problem of finding a point with the minimum sum of distances to all points. We show that this problem has a randomized algorithm that {\em always} outputs a $(2+\epsilon)$-approximate solution…

Data Structures and Algorithms · Computer Science 2017-02-28 Ching-Lueh Chang

We consider the stochastic composition optimization problem proposed in \cite{wang2017stochastic}, which has applications ranging from estimation to statistical and machine learning. We propose the first ADMM-based algorithm named…

Machine Learning · Computer Science 2017-05-23 Yue Yu , Longbo Huang

A split graph is a graph whose vertex set can be partitioned into a clique and a stable set. Given a graph $G$ and weight function $w: V(G) \to \mathbb{Q}_{\geq 0}$, the Split Vertex Deletion (SVD) problem asks to find a minimum weight set…

Combinatorics · Mathematics 2020-09-24 Matthew Drescher , Samuel Fiorini , Tony Huynh