English
Related papers

Related papers: Bounds for Compression in Streaming Models

200 papers

The rapid increase in networked systems and data transmission requires advanced data compression solutions to optimize bandwidth utilization and enhance network performance. This study introduces a novel byte-level predictive model using…

Networking and Internet Architecture · Computer Science 2025-03-26 Xuanhao Luo , Zhiyuan Peng , Zhouyu Li , Ruozhou Yu , Yuchen Liu

In order to avoid the reference bias introduced by mapping reads to a reference genome, bioinformaticians are investigating reference-free methods for analyzing sequenced genomes. With large projects sequencing thousands of individuals,…

Data Structures and Algorithms · Computer Science 2016-01-15 Jouni Sirén

Streaming algorithms are generally judged by the quality of their solution, memory footprint, and computational complexity. In this paper, we study the problem of maximizing a monotone submodular function in the streaming setting with a…

Machine Learning · Computer Science 2019-05-14 Ehsan Kazemi , Marko Mitrovic , Morteza Zadimoghaddam , Silvio Lattanzi , Amin Karbasi

We propose a streaming submodular maximization algorithm "stream clipper" that performs as well as the offline greedy algorithm on document/video summarization in practice. It adds elements from a stream either to a solution set $S$ or to…

Machine Learning · Statistics 2018-02-14 Tianyi Zhou , Jeff Bilmes

We propose a streaming algorithm for the binary classification of data based on crowdsourcing. The algorithm learns the competence of each labeller by comparing her labels to those of other labellers on the same tasks and uses this…

Machine Learning · Statistics 2016-02-24 Thomas Bonald , Richard Combes

The Burrows-Wheeler-Transform (BWT), a reversible string transformation, is one of the fundamental components of many current data structures in string processing. It is central in data compression, as well as in efficient query algorithms…

Data Structures and Algorithms · Computer Science 2024-04-16 Sara Giuliani , Shunsuke Inenaga , Zsuzsanna Lipták , Nicola Prezza , Marinella Sciortino , Anna Toffanello

Learned image compression has achieved great success due to its excellent modeling capacity, but seldom further considers the Rate-Distortion Optimization (RDO) of each input image. To explore this potential in the learned codec, we make…

Image and Video Processing · Electrical Eng. & Systems 2022-03-31 Dezhao Wang , Wenhan Yang , Yueyu Hu , Jiaying Liu

In many machine learning applications, it is important to explain the predictions of a black-box classifier. For example, why does a deep neural network assign an image to a particular class? We cast interpretability of black-box…

Machine Learning · Statistics 2017-11-27 Ethan R. Elenberg , Alexandros G. Dimakis , Moran Feldman , Amin Karbasi

In 1994, Burrows and Wheeler developed a data compression algorithm which performs significantly better than Lempel-Ziv based algorithms. Since then, a lot of work has been done in order to improve their algorithm, which is based on a…

Data Structures and Algorithms · Computer Science 2007-05-23 Dragos Trinca

The Burrows-Wheeler Transform (BWT) serves as the basis for many important sequence indexes. On very large datasets (e.g. genomic databases), classical BWT construction algorithms are often infeasible because they usually need to have the…

Data Structures and Algorithms · Computer Science 2025-09-24 Jannik Olbrich

Streaming algorithms are typically analyzed in the oblivious setting, where we assume that the input stream is fixed in advance. Recently, there is a growing interest in designing adversarially robust streaming algorithms that must maintain…

Data Structures and Algorithms · Computer Science 2023-01-24 Menachem Sadigurschi , Moshe Shechner , Uri Stemmer

In this paper we propose a flexible and lightweight technique for merging compressed indices based on variants of Burrows-Wheeler transform (BWT), thus addressing the need for algorithms that compute compressed indices over large…

Data Structures and Algorithms · Computer Science 2019-03-06 Lavinia Egidi , Giovanni Manzini

Frequency estimation in data streams is one of the classical problems in streaming algorithms. Following much research, there are now almost matching upper and lower bounds for the trade-off needed between the number of samples and the…

Computational Complexity · Computer Science 2023-01-16 Shachar Lovett , Jiapeng Zhang

Simultaneous or streaming machine translation generates translation while reading the input stream. These systems face a quality/latency trade-off, aiming to achieve high translation quality similar to non-streaming models with minimal…

Computation and Language · Computer Science 2025-03-31 Zeeshan Ahmed , Frank Seide , Zhe Liu , Rastislav Rabatin , Jachym Kolar , Niko Moritz , Ruiming Xie , Simone Merello , Christian Fuegen

We consider communication-efficient weighted and unweighted (uniform) random sampling from distributed data streams presented as a sequence of mini-batches of items. This is a natural model for distributed streaming computation, and our…

Data Structures and Algorithms · Computer Science 2020-02-26 Lorenz Hübschle-Schneider , Peter Sanders

It is known that the exact form of the Burrows-Wheeler-Transform (BWT) of a string collection depends, in most implementations, on the input order of the strings in the collection. Reordering strings of an input collection affects the…

Data Structures and Algorithms · Computer Science 2022-12-05 Davide Cenzato , Veronica Guerrini , Zsuzsanna Lipták , Giovanna Rosone

Given a string of characters, the Burrows-Wheeler Transform rearranges the characters in it so as to produce another string of the same length which is more amenable to compression techniques such as move to front, run-length encoding, and…

Data Structures and Algorithms · Computer Science 2012-01-17 Joseph Yossi Gil , David Allen Scott

Attention-based models have been gaining popularity recently for their strong performance demonstrated in fields such as machine translation and automatic speech recognition. One major challenge of attention-based models is the need of…

Computation and Language · Computer Science 2020-11-17 Ching-Feng Yeh , Yongqiang Wang , Yangyang Shi , Chunyang Wu , Frank Zhang , Julian Chan , Michael L. Seltzer

In this paper we study the extraction of representative elements in the data stream model in the form of submodular maximization. Different from the previous work on streaming submodular maximization, we are interested only in the recent…

Data Structures and Algorithms · Computer Science 2016-11-02 Jiecao Chen , Huy L. Nguyen , Qin Zhang

Backpressure scheduling and routing, in which packets are preferentially transmitted over links with high queue differentials, offers the promise of throughput-optimal operation for a wide range of communication networks. However, when the…

Networking and Internet Architecture · Computer Science 2016-11-17 Majed Alresaini , Maheswaran Sathiamoorthy , Bhaskar Krishnamachari , Michael J. Neely