English
Related papers

Related papers: Communication Lower Bounds and Algorithms for Sket…

200 papers

Sketching techniques have gained popularity in numerical linear algebra to accelerate the solution of least squares problems. The so-called $\varepsilon$-subspace embedding property of a sketching matrix $S$ has been largely used to…

Numerical Analysis · Mathematics 2025-11-21 Davide Palitta , Valeria Simoncini

Sketches are probabilistic data structures that can provide approximate results within mathematically proven error bounds while using orders of magnitude less memory than traditional approaches. They are tailored for streaming data analysis…

Data Structures and Algorithms · Computer Science 2019-03-05 Fatih Taşyaran , Kerem Yıldırır , Kamer Kaya , Mustafa Kemal Taş

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon

We consider distributed optimization over a $d$-dimensional space, where $K$ remote clients send coded gradient estimates over an {\em additive Gaussian Multiple Access Channel (MAC)} with noise variance $\sigma_z^2$. Furthermore, the…

Information Theory · Computer Science 2023-10-06 Shubham Jha

The power method is one of the most fundamental tools for extracting top principal components from data through low-rank matrix approximation. Yet, when the target rank is large, the cost of matrix multiplication associated with this…

Numerical Analysis · Mathematics 2026-05-12 Shabarish Chenakkod , Michał Dereziński

Sketches, probabilistic structures for estimating item frequencies in infinite data streams with limited space, are widely used across various domains. Recent studies have shifted the focus from handcrafted sketches to neural sketches,…

Machine Learning · Computer Science 2025-05-27 Yuan Feng , Yukun Cao , Hairu Wang , Xike Xie , S Kevin Zhou

In this paper we consider a network of processors aiming at cooperatively solving linear programming problems subject to uncertainty. Each node only knows a common cost function and its local uncertain constraint set. We propose a…

Optimization and Control · Mathematics 2019-08-27 Mohammadreza Chamanbaz , Giuseppe Notarstefano , Roland Bouffanais

This work initiates the study of memory-query tradeoffs for graph problems, with a focus on correlation clustering. Correlation clustering asks for a partition of the vertices that minimizes disagreements: non-edges inside clusters plus…

Computational Complexity · Computer Science 2026-05-25 Sumegha Garg , Songhua He , Periklis A. Papakonstantinou

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Feng Liang , Zhen Zhang , Haifeng Lu , Victor C. M. Leung , Yanyi Guo , Xiping Hu

Neural network training relies on gradient computation through backpropagation, yet memory requirements for storing layer activations present significant scalability challenges. We present the first adaptation of control-theoretic matrix…

Machine Learning · Computer Science 2025-10-02 Harbir Antil , Deepanshu Verma

We study common randomness generation problems where $n$ players aim to generate same sequences of random coin flips where some subsets of the players share an independent common coin which can be tossed multiple times, and there is a…

Information Theory · Computer Science 2023-12-08 Yanjun Han , Kedar Tatwawadi , Gowtham R. Kurri , Zhengqing Zhou , Vinod M. Prabhakaran , Tsachy Weissman

This paper studies the distributed linearly separable computation problem, which is a generalization of many existing distributed computing problems such as distributed gradient descent and distributed linear transform. In this problem, a…

Information Theory · Computer Science 2020-10-06 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

This work considers the problem of learning the Markov parameters of a linear system from observed data. Recent non-asymptotic system identification results have characterized the sample complexity of this problem in the single and…

Optimization and Control · Mathematics 2021-12-09 Han Wang , James Anderson

Two important optimization problems in the analysis of geometric data sets are clustering and sketching. Here, clustering refers to the problem of partitioning some input metric measure space (mm-space) into k clusters, minimizing some…

Computational Geometry · Computer Science 2018-10-19 Facundo Mémoli , Anastasios Sidiropoulos , Kritika Singhal

In distributed statistical learning, $N$ samples are split across $m$ machines and a learner wishes to use minimal communication to learn as well as if the examples were on a single machine. This model has received substantial interest in…

Machine Learning · Computer Science 2019-03-19 Jayadev Acharya , Christopher De Sa , Dylan J. Foster , Karthik Sridharan

As artificial intelligence systems spread to more diverse and larger tasks in many domains, the machine learning algorithms, and in particular the deep learning models and the databases required to train them are getting bigger themselves.…

Machine Learning · Computer Science 2019-04-22 Philippe Lacaille

Scaling models has led to significant advancements in deep learning, but training these models in decentralized settings remains challenging due to communication bottlenecks. While existing compression techniques are effective in…

Machine Learning · Computer Science 2025-06-03 Sameera Ramasinghe , Thalaiyasingam Ajanthan , Gil Avraham , Yan Zuo , Alexander Long

Network stream mining is fundamental to many network operations. Sketches, as compact data structures that offer low memory overhead with bounded accuracy, have emerged as a promising solution for network stream mining. Recent studies…

Networking and Internet Architecture · Computer Science 2025-02-12 Yuanpeng Li , Zhen Xu , Zongwei Lv , Yannan Hu , Yong Cui , Tong Yang

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

Sketching is a powerful dimensionality reduction technique for accelerating algorithms for data analysis. A crucial step in sketching methods is to compute a subspace embedding (SE) for a large matrix $\mathbf{A} \in \mathbb{R}^{N \times…

Data Structures and Algorithms · Computer Science 2021-07-14 Rajesh Jayaram , Alireza Samadian , David P. Woodruff , Peng Ye