English
Related papers

Related papers: Sketch & Project Methods for Linear Feasibility Pr…

200 papers

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

Compressed sensing applied to magnetic resonance imaging (MRI) allows to reduce the scanning time by enabling images to be reconstructed from highly undersampled data. In this paper, we tackle the problem of designing a sampling mask for an…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Thomas Sanchez , Baran Gözcü , Ruud B. van Heeswijk , Armin Eftekhari , Efe Ilıcak , Tolga Çukur , Volkan Cevher

We analyse the problem of controllability for parameter-dependent linear finite-dimensional systems. The goal is to identify the most distinguished realisations of those parameters so to better describe or approximate the whole range of…

Optimization and Control · Mathematics 2016-10-07 Martin Lazar , Enrique Zuazua

An effective technique for solving optimization problems over massive data sets is to partition the data into smaller pieces, solve the problem on each piece and compute a representative solution from it, and finally obtain a solution…

Data Structures and Algorithms · Computer Science 2015-06-23 Vahab Mirrokni , Morteza Zadimoghaddam

Reachability analysis is at the core of many applications, from neural network verification, to safe trajectory planning of uncertain systems. However, this problem is notoriously challenging, and current approaches tend to be either too…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Thomas Lew , Marco Pavone

Rollout algorithms have demonstrated excellent performance on a variety of dynamic and discrete optimization problems. Interpreted as an approximate dynamic programming algorithm, a rollout algorithm estimates the value-to-go at each…

Data Structures and Algorithms · Computer Science 2013-11-27 Andrew Mastin , Patrick Jaillet

A $k$-submodular function naturally generalizes submodular functions by taking as input $k$ disjoint subsets, rather than a single subset. Unlike standard submodular maximization, which only requires selecting elements for the solution,…

Data Structures and Algorithms · Computer Science 2025-07-18 Chenhao Wang

This study investigated typical performance of approximation algorithms known as belief propagation, greedy algorithm, and linear-programming relaxation for maximum coverage problems on sparse biregular random graphs. After using the cavity…

Disordered Systems and Neural Networks · Physics 2018-02-27 Satoshi Takabe , Takanori Maehara , Koji Hukushima

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

Generative models excel at synthesizing high-fidelity samples from complex data distributions, but they often violate hard constraints arising from physical laws or task specifications. A common remedy is to project intermediate samples…

Machine Learning · Computer Science 2025-09-30 Jinhao Liang , Yixuan Sun , Anirban Samaddar , Sandeep Madireddy , Ferdinando Fioretto

Among recent developments centered around Randomized Kaczmarz (RK), a row-sampling iterative projection method for large-scale linear systems, several adaptions to the method have inspired faster convergence. Focusing solely on…

Numerical Analysis · Mathematics 2026-03-03 James Nguyen , Oleg Presnyakov , Adityakrishnan Radhakhrishnan

In this paper, we consider a subset selection problem in a spatial field where we seek to find a set of k locations whose observations provide the best estimate of the field value at a finite set of prediction locations. The measurements…

Optimization and Control · Mathematics 2022-04-12 Shamak Dutta , Nils Wilde , Stephen L. Smith

Sketch-and-solve (SAS) is a very successful method to efficiently estimate the solution of heavily overdetermined large linear least squares problems. It uses random sketching to reduce the size of the problem, hence reducing the…

Numerical Analysis · Mathematics 2026-05-26 Irina-Beatrice Haas , Michael B. Giles , Yuji Nakatsukasa

Is it possible to maximize a monotone submodular function faster than the widely used lazy greedy algorithm (also known as accelerated greedy), both in theory and practice? In this paper, we develop the first linear-time algorithm for…

Machine Learning · Computer Science 2014-12-01 Baharan Mirzasoleiman , Ashwinkumar Badanidiyuru , Amin Karbasi , Jan Vondrak , Andreas Krause

We develop a randomized Newton method capable of solving learning problems with huge dimensional feature spaces, which is a common setting in applications such as medical imaging, genomics and seismology. Our method leverages randomized…

Optimization and Control · Mathematics 2019-10-04 Robert M. Gower , Dmitry Kovalev , Felix Lieder , Peter Richtárik

Many machine learning models depend on solving a large scale optimization problem. Recently, sub-sampled Newton methods have emerged to attract much attention for optimization due to their efficiency at each iteration, rectified a weakness…

Optimization and Control · Mathematics 2016-09-06 Haishan Ye , Luo Luo , Zhihua Zhang

Sampling-based motion planning techniques have emerged as an efficient algorithmic paradigm for solving complex motion planning problems. These approaches use a set of probing samples to construct an implicit graph representation of the…

Robotics · Computer Science 2019-10-10 Brian Ichter , Edward Schmerling , Tsang-Wei Edward Lee , Aleksandra Faust

We study the problem of sampling and reconstructing spectrally sparse graph signals where the objective is to select a subset of nodes of prespecified cardinality that ensures interpolation of the original signal with the lowest possible…

Signal Processing · Electrical Eng. & Systems 2021-11-24 Abolfazl Hashemi , Rasoul Shafipour , Haris Vikalo , Gonzalo Mateos

Clustering problems such as $k$-means and $k$-median are staples of unsupervised learning, and many algorithmic techniques have been developed to tackle their numerous aspects. In this paper, we focus on the class of greedy approximation…

Data Structures and Algorithms · Computer Science 2025-10-30 Max Dupré la Tour , David Saulpic

We prove global convergence of classical projection algorithms for feasibility problems involving union convex sets, which refer to sets expressible as the union of a finite number of closed convex sets. We present a unified strategy for…

Optimization and Control · Mathematics 2023-07-18 Jan Harold Alcantara , Ching-pei Lee