中文
相关论文

相关论文: Bounds for Compression in Streaming Models

200 篇论文

Large Language Models (LLMs) have demonstrated exceptional capabilities across diverse natural language processing benchmarks. However, the escalating scale of model parameters imposes prohibitive memory overheads during training,…

机器学习 · 计算机科学 2026-04-28 Ziqing Wen , Ping Luo , Jiahuan Wang , Kun Yuan , Dongsheng Li , Tao Sun

Wavelets are well known for data compression, yet have rarely been applied to the compression of neural networks. This paper shows how the fast wavelet transform can be used to compress linear layers in neural networks. Linear layers still…

机器学习 · 计算机科学 2020-08-21 Moritz Wolter , Shaohui Lin , Angela Yao

The Burrows-Wheeler Transform (BWT) is among the most influential discoveries in text compression and DNA storage. It is a reversible preprocessing step that rearranges an $n$-letter string into runs of identical characters (by exploiting…

数据结构与算法 · 计算机科学 2018-12-06 Sandip Sinha , Omri Weinstein

We study streaming algorithms in the white-box adversarial model, where the stream is chosen adaptively by an adversary who observes the entire internal state of the algorithm at each time step. We show that nontrivial algorithms are still…

数据结构与算法 · 计算机科学 2022-07-26 Miklos Ajtai , Vladimir Braverman , T. S. Jayram , Sandeep Silwal , Alec Sun , David P. Woodruff , Samson Zhou

Streaming submodular maximization is a natural model for the task of selecting a representative subset from a large-scale dataset. If datapoints have sensitive attributes such as gender or race, it becomes important to enforce fairness to…

机器学习 · 计算机科学 2025-11-25 Marwa El Halabi , Federico Fusco , Ashkan Norouzi-Fard , Jakab Tardos , Jakub Tarnawski

The Burrows-Wheeler Transform is a string transformation that plays a fundamental role for the design of self-indexing compressed data structures. Over the years, researchers have successfully extended this transformation outside the…

数据结构与算法 · 计算机科学 2019-02-05 Raffaele Giancarlo , Giovanni Manzini , Giovanna Rosone , Marinella Sciortino

Recently, the existence of considerable amount of redundancy in the Internet traffic has stimulated the deployment of several redundancy elimination techniques within the network. These techniques are often based on either packet-level…

信息论 · 计算机科学 2012-04-02 Mohsen Sardari , Ahmad Beirami , Faramarz Fekri

Run-length encoding Burrows-Wheeler Transformed strings, resulting in Run-Length BWT (RLBWT), is a powerful tool for processing highly repetitive strings. We propose a new algorithm for online RLBWT working in run-compressed space, which…

数据结构与算法 · 计算机科学 2017-10-17 Tatsuya Ohno , Yoshimasa Takabatake , Tomohiro I , Hiroshi Sakamoto

Constrained $k$-submodular maximization is a general framework that captures many discrete optimization problems such as ad allocation, influence maximization, personalized recommendation, and many others. In many of these applications,…

数据结构与算法 · 计算机科学 2023-05-26 Fabian Spaeh , Alina Ene , Huy L. Nguyen

In this paper, we define streaming register transducer (SRT), a one-way, letter-to-letter, transductional machine model for transformations of infinite data words whose data domain forms a linear group. Comparing with existing data word…

形式语言与自动机理论 · 计算机科学 2020-01-22 Xiaokang Qiu

In theory, Bayesian nonparametric (BNP) models are well suited to streaming data scenarios due to their ability to adapt model complexity with the observed data. Unfortunately, such benefits have not been fully realized in practice;…

机器学习 · 统计学 2015-04-22 Alex Tank , Nicholas J. Foti , Emily B. Fox

In the past few years, lossy compression has been widely applied in the field of wireless sensor networks (WSN), where energy efficiency is a crucial concern due to the constrained nature of the transmission devices. Often, the common…

网络与互联网体系结构 · 计算机科学 2012-06-12 Davide Zordan , Borja Martinez , Ignasi Vilajosana , Michele Rossi

Problems involving the efficient arrangement of simple objects, as captured by bin packing and makespan scheduling, are fundamental tasks in combinatorial optimization. These are well understood in the traditional online and offline cases,…

数据结构与算法 · 计算机科学 2026-01-27 Graham Cormode , Pavel Veselý

We study the classic set cover problem in the streaming model: the sets that comprise the instance are revealed one by one in a stream and the goal is to solve the problem by making one or few passes over the stream while maintaining a…

数据结构与算法 · 计算机科学 2017-03-07 Sepehr Assadi

Recent progress in (semi-)streaming algorithms for monotone submodular function maximization has led to tight results for a simple cardinality constraint. However, current techniques fail to give a similar understanding for natural…

数据结构与算法 · 计算机科学 2022-02-17 Moran Feldman , Paul Liu , Ashkan Norouzi-Fard , Ola Svensson , Rico Zenklusen

We consider the Maximum-weight Matching (MWM) problem in the streaming sliding window model of computation. In this model, the input consists of a sequence of weighted edges on a given vertex set $V$ of size $n$. The objective is to…

数据结构与算法 · 计算机科学 2023-01-11 Cezar-Mihail Alexandru , Pavel Dvořák , Christian Konrad , Kheeran K. Naidu

In this paper we consider the design of wireless queueing network control policies with special focus on application-dependent service constraints. In particular we consider streaming traffic induced requirements such as avoiding buffer…

系统与控制 · 计算机科学 2015-03-20 Martin Kasparick , Gerhard Wunder

Prior work inspired by compression algorithms has described how the Burrows Wheeler Transform can be used to create a distance measure for bioinformatics problems. We describe issues with this approach that were not widely known, and…

密码学与安全 · 计算机科学 2020-02-19 Edward Raff , Charles Nicholas , Mark McLean

Space efficient algorithms play a central role in dealing with large amount of data. In such settings, one would like to analyse the large data using small amount of "working space". One of the key steps in many algorithms for analysing…

数据结构与算法 · 计算机科学 2015-01-19 Anup Bhattacharya , Davis Issac , Ragesh Jaiswal , Amit Kumar

Sliced optimal transport (SOT), or sliced Wasserstein (SW) distance, is widely recognized for its statistical and computational scalability. In this work, we further enhance computational scalability by proposing the first method for…

机器学习 · 计算机科学 2026-05-12 Khai Nguyen