English
Related papers

Related papers: Near-Optimal Space Lower Bounds for Streaming CSPs

200 papers

We consider the stochastic optimization problem with smooth but not necessarily convex objectives in the heavy-tailed noise regime, where the stochastic gradient's noise is assumed to have bounded $p$th moment ($p\in(1,2]$). Zhang et al.…

Machine Learning · Computer Science 2023-09-06 Zijian Liu , Jiawei Zhang , Zhengyuan Zhou

We investigate the space complexity of two graph streaming problems: Max-Cut and its quantum analogue, Quantum Max-Cut. Previous work by Kapralov and Krachun [STOC `19] resolved the classical complexity of the \emph{classical} problem,…

Quantum Physics · Physics 2022-09-21 John Kallaugher , Ojas Parekh

We show that fundamental learning tasks, such as finding an approximate linear separator or linear regression, require memory at least \emph{quadratic} in the dimension, in a natural streaming setting. This implies that such problems cannot…

Machine Learning · Computer Science 2019-06-13 Yuval Dagan , Gil Kur , Ohad Shamir

We consider the problem of maximizing aggregate user utilities over a multi-hop network, subject to link capacity constraints, maximum end-to-end delay constraints, and user throughput requirements. A user's utility is a concave function of…

Networking and Internet Architecture · Computer Science 2018-12-27 Qingyu Liu , Haibo Zeng , Minghua Chen

We introduce a new notion of information complexity for multi-pass streaming problems and use it to resolve several important questions in data streams. In the coin problem, one sees a stream of $n$ i.i.d. uniform bits and one would like to…

Computational Complexity · Computer Science 2024-04-01 Mark Braverman , Sumegha Garg , Qian Li , Shuo Wang , David P. Woodruff , Jiapeng Zhang

Many problems on data streams have been studied at two extremes of difficulty: either allowing randomized algorithms, in the static setting (where they should err with bounded probability on the worst case stream); or when only…

Data Structures and Algorithms · Computer Science 2022-11-11 Manuel Stoeckl

We study the problem of extracting a small subset of representative items from a large data stream. In many data mining and machine learning applications such as social network analysis and recommender systems, this problem can be…

Data Structures and Algorithms · Computer Science 2021-02-15 Yanhao Wang , Francesco Fabbri , Michael Mathioudakis

An instance of the Constraint Satisfaction Problem (CSP) is given by a family of constraints on overlapping sets of variables, and the goal is to assign values from a fixed domain to the variables so that all constraints are satisfied. In…

Data Structures and Algorithms · Computer Science 2018-12-06 Víctor Dalmau , Marcin Kozik , Andrei Krokhin , Konstantin Makarychev , Yury Makarychev , Jakub Opršal

Given a dataset of points in a metric space and an integer $k$, a diversity maximization problem requires determining a subset of $k$ points maximizing some diversity objective measure, e.g., the minimum or the average distance between two…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-24 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci , Eli Upfal

Approximating the length of the longest increasing sequence (LIS) of an array is a well-studied problem. We study this problem in the data stream model, where the algorithm is allowed to make a single left-to-right pass through the array…

Data Structures and Algorithms · Computer Science 2013-04-16 Michael Saks , C. Seshadhri

We consider the Low Rank Approximation problem, where the input consists of a matrix $A \in \mathbb{R}^{n_R \times n_C}$ and an integer $k$, and the goal is to find a matrix $B$ of rank at most $k$ that minimizes $\| A - B \|_0$, which is…

Data Structures and Algorithms · Computer Science 2023-11-03 Vincent Cohen-Addad , Chenglin Fan , Suprovat Ghoshal , Euiwoong Lee , Arnaud de Mesmay , Alantha Newman , Tony Chang Wang

Given a collection of $m$ sets from a universe $\mathcal{U}$, the Maximum Set Coverage problem consists of finding $k$ sets whose union has largest cardinality. This problem is NP-Hard, but the solution can be approximated by a polynomial…

Data Structures and Algorithms · Computer Science 2023-12-13 Stephen Jaud , Anthony Wirth , Farhana Choudhury

This paper describes a new approach on optimization of constraint satisfaction problems (CSPs) by means of substituting sub-CSPs with locally consistent regular membership constraints. The purpose of this approach is to reduce the number of…

Artificial Intelligence · Computer Science 2019-08-19 Sven Löffler , Ke Liu , Petra Hofstedt

The subspace approximation problem Subspace($k$,$p$) asks for a $k$-dimensional linear subspace that fits a given set of points optimally, where the error for fitting is a generalization of the least squares fit and uses the $\ell_{p}$ norm…

Data Structures and Algorithms · Computer Science 2011-01-04 Amit Deshpande , Kasturi Varadarajan , Madhur Tulsiani , Nisheeth K. Vishnoi

We consider the dynamic resource allocation problem where the decision space is finite-dimensional, yet the solution must satisfy a large or even infinite number of constraints revealed via streaming data or oracle feedback. We model this…

Machine Learning · Computer Science 2026-03-18 Yiming Zong , Jiashuo Jiang

Constraint satisfaction problems (CSPs) are ubiquitous in theoretical computer science. We study the problem of StrongCSPs, i.e. instances where a large induced sub-instance has a satisfying assignment. More formally, given a CSP instance…

Data Structures and Algorithms · Computer Science 2022-05-24 Suprovat Ghoshal , Anand Louis

We consider approximation algorithms for covering integer programs of the form min $\langle c, x \rangle $ over $x \in \mathbb{N}^n $ subject to $A x \geq b $ and $x \leq d$; where $A \in \mathbb{R}_{\geq 0}^{m \times n}$, $b \in…

Data Structures and Algorithms · Computer Science 2018-11-20 Chandra Chekuri , Kent Quanrud

In statistical learning for real-world large-scale data problems, one must often resort to "streaming" algorithms which operate sequentially on small batches of data. In this work, we present an analysis of the information-theoretic limits…

Machine Learning · Statistics 2018-01-22 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

Given a convex polygon $P$ with $n$ vertices, the two-center problem is to find two congruent closed disks of minimum radius such that they completely cover $P$. We propose an algorithm for this problem in the streaming setup, where the…

Computational Geometry · Computer Science 2015-12-09 Sanjib Sadhu , Sasanka Roy , Soumen Nandi , Anil Maheswari , Subhas C. Nandy

In this paper, we investigate optimization problems with nonnegative and orthogonal constraints, where any feasible matrix of size $n \times p$ exhibits a sparsity pattern such that each row accommodates at most one nonzero entry. Our…

Optimization and Control · Mathematics 2025-11-06 Lei Wang , Xin Liu , Xiaojun Chen