English
Related papers

Related papers: On the Value of Multiple Read/Write Streams for Da…

200 papers

Deep learning-based lossless compression methods offer substantial advantages in compressing medical volumetric images. Nevertheless, many learning-based algorithms encounter a trade-off between practicality and compression performance.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Qianhao Chen , Jietao Chen

We study how much memory one-pass compression algorithms need to compete with the best multi-pass algorithms. We call a one-pass algorithm an (f (n, \ell))-footprint compressor if, given $n$, $\ell$ and an $n$-ary string $S$, it stores $S$…

Information Theory · Computer Science 2007-07-16 Travis Gagie

Secure distributed data compression in the presence of an eavesdropper is explored. Two correlated sources that need to be reliably transmitted to a legitimate receiver are available at separate encoders. Noise-free, limited rate links from…

Information Theory · Computer Science 2016-11-17 Deniz Gunduz , Elza Erkip , H. Vincent Poor

Data compression is a powerful tool for managing massive but repetitive datasets, especially schemes such as grammar-based compression that support computation over the data without decompressing it. In the best case such a scheme takes a…

Data Structures and Algorithms · Computer Science 2019-06-04 Travis Gagie , Tomohiro I , Giovanni Manzini , Gonzalo Navarro , Hiroshi Sakamoto , Yoshimasa Takabatake

In the semi-streaming model, an algorithm receives a stream of edges of a graph in arbitrary order and uses a memory of size $O(n \mbox{ polylog } n)$, where $n$ is the number of vertices of a graph. In this work, we present semi-streaming…

Data Structures and Algorithms · Computer Science 2014-04-11 Christian Konrad , Frédéric Magniez , Claire Mathieu

The following question arises naturally in the study of graph streaming algorithms: "Is there any graph problem which is "not too hard", in that it can be solved efficiently with total communication (nearly) linear in the number $n$ of…

Data Structures and Algorithms · Computer Science 2024-05-24 Sepehr Assadi , Prantar Ghosh , Bruno Loff , Parth Mittal , Sagnik Mukhopadhyay

This paper investigates the challenging problem of learned image compression (LIC) with extreme low bitrates. Previous LIC methods based on transmitting quantized continuous features often yield blurry and noisy reconstruction due to the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Lei Lu , Yanyue Xie , Wei Jiang , Wei Wang , Xue Lin , Yanzhi Wang

Submodular maximization problems belong to the family of combinatorial optimization problems and enjoy wide applications. In this paper, we focus on the problem of maximizing a monotone submodular function subject to a $d$-knapsack…

Machine Learning · Computer Science 2016-07-06 Qilian Yu , Easton Li Xu , Shuguang Cui

Constrained coding plays a key role in optimizing performance and mitigating errors in applications such as storage and communication, where specific constraints on codewords are required. While non-parametric constraints have been…

Information Theory · Computer Science 2025-05-05 Daniella Bar-Lev , Michael Shlizerman

Modern scientific simulations generate massive volumes of data, creating significant challenges for I/O and storage systems. Error-bounded lossy compression (EBLC) offers a solution by reducing data set sizes while preserving data quality…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-16 Grant Wilkins , Sheng Di , Jon C. Calhoun , Robert Underwood , Franck Cappello

Synthetic polymer-based storage seems to be a particularly promising candidate that could help to cope with the ever-increasing demand for archival storage requirements. It involves designing molecules of distinct masses to represent the…

Information Theory · Computer Science 2026-04-02 Anisha Banerjee , Antonia Wachter-Zeh , Eitan Yaakobi

Parsing is essential for a wide range of use cases, such as stream processing, bulk loading, and in-situ querying of raw data. Yet, the compute-intense step often constitutes a major bottleneck in the data ingestion pipeline, since parsing…

Databases · Computer Science 2020-04-16 Elias Stehle , Hans-Arno Jacobsen

We introduce a novel algorithm to perform graph clustering in the edge streaming setting. In this model, the graph is presented as a sequence of edges that can be processed strictly once. Our streaming algorithm has an extremely low memory…

Machine Learning · Computer Science 2017-12-13 Alexandre Hollocou , Julien Maudet , Thomas Bonald , Marc Lelarge

Optimizing distributed learning systems is an art of balancing between computation and communication. There have been two lines of research that try to deal with slower networks: {\em communication compression} for low bandwidth networks,…

Machine Learning · Computer Science 2019-02-04 Hanlin Tang , Shaoduo Gan , Ce Zhang , Tong Zhang , Ji Liu

In a recent breakthrough, Paz and Schwartzman (SODA'17) presented a single-pass ($2+\epsilon$)-approximation algorithm for the maximum weight matching problem in the semi-streaming model. Their algorithm uses $O(n\log^2 n)$ bits of space,…

Data Structures and Algorithms · Computer Science 2019-01-01 Mohsen Ghaffari , David Wajc

Conventional low-power static random access memories (SRAMs) reduce read energy by decreasing the bit-line voltage swings uniformly across the bit-line columns. This is because the read energy is proportional to the bit-line swings. On the…

Information Theory · Computer Science 2018-05-31 Yongjune Kim , Mingu Kang , Lav R. Varshney , Naresh R. Shanbhag

In this paper, we present a fast and reliable method based on PCA to select the number of dimensions for word embeddings. First, we train one embedding with a generous upper bound (e.g. 1,000) of dimensions. Then we transform the embeddings…

Computation and Language · Computer Science 2019-09-05 Yu Wang

We prove that any algorithm computing the sum-exclude-self of an unsigned $d$-bit integer array of length $n$ under sublinear space must perform two linear passes over the input. More precisely, the algorithm must read at least $n-1$ input…

Data Structures and Algorithms · Computer Science 2026-04-02 Andrew Au

On-device machine learning is often constrained by limited storage, particularly in continuous data collection scenarios. This paper presents an empirical study on storage-aware learning, focusing on the trade-off between data quantity and…

Machine Learning · Computer Science 2025-12-24 Kichang Lee , Songkuk Kim , JaeYeon Park , JeongGil Ko

We show how to compress communication in selection protocols, where the goal is to agree on a sequence of random bits using only a broadcast channel. More specifically, we present a generic method for converting any selection protocol, into…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-14 Yael Tauman Kalai , Ilan Komargodski