English
Related papers

Related papers: Sensitivity of string compressors and repetitivene…

200 papers

We consider the communication complexity of the Hamming distance of two strings. Bille et al. [SPIRE 2018] considered the communication complexity of the longest common prefix (LCP) problem in the setting where the two parties have their…

Data Structures and Algorithms · Computer Science 2021-04-02 Shiori Mitsuya , Yuto Nakashima , Shunsuke Inenaga , Hideo Bannai , Masayuki Takeda

Tensor Compressive Sensing (TCS) is a multidimensional framework of Compressive Sensing (CS), and it is advantageous in terms of reducing the amount of storage, easing hardware implementations and preserving multidimensional structures of…

Machine Learning · Computer Science 2017-06-07 Xin Ding , Wei Chen , Ian J. Wassell

The Kolmogorov complexity of x, denoted C(x), is the length of the shortest program that generates x. For such a simple definition, Kolmogorov complexity has a rich and deep theory, as well as applications to a wide variety of topics…

Computational Complexity · Computer Science 2017-02-17 Stephen Fenner , Lance Fortnow

We present a polynomial-time algorithm that discovers all maximal patterns in a point set, $D\subset\mathbb{R}^k$, that are related by transformations in a user-specified class, $F$, of bijections over $\mathbb{R}^k$. We also present a…

Machine Learning · Computer Science 2022-02-01 David Meredith

In this paper we introduce a variant of pushdown dimension called bounded pushdown (BPD) dimension, that measures the density of information contained in a sequence, relative to a BPD automata, i.e. a finite state machine equipped with an…

Computational Complexity · Computer Science 2007-07-13 Pilar Albert , Elvira Mayordomo , Philippe Moser

The ability to find short representations, i.e. to compress data, is crucial for many intelligent systems. We present a theory of incremental compression showing that arbitrary data strings, that can be described by a set of features, can…

Information Theory · Computer Science 2020-09-15 Arthur Franz , Oleksandr Antonenko , Roman Soletskyi

Generative neural networks have been empirically found very promising in providing effective structural priors for compressed sensing, since they can be trained to span low-dimensional data manifolds in high-dimensional signal spaces.…

Information Theory · Computer Science 2020-06-29 Constantinos Daskalakis , Dhruv Rohatgi , Manolis Zampetakis

In this paper we present a simple linear-time algorithm constructing a context-free grammar of size O(g log(N/g)) for the input string, where N is the size of the input string and g the size of the optimal grammar generating this string.…

Data Structures and Algorithms · Computer Science 2013-11-08 Artur Jeż

Future detection/non-detection of tensor modes from inflation in CMB observations presents a unique way to test certain features of string theory. Current limit on the ratio of tensor to scalar perturbations, r=T/S, is r < 0.3, future…

High Energy Physics - Theory · Physics 2009-11-13 Renata Kallosh , Andrei Linde

We study approximation algorithms for the following three string measures that are widely used in practice: edit distance (ED), longest common subsequence (LCS), and longest increasing sequence (LIS). All three problems can be solved…

Data Structures and Algorithms · Computer Science 2020-07-28 Kuan Cheng , Zhengzhong Jin , Xin Li , Yu Zheng

This paper provides an upper bound for several subsets of maximal repeats and maximal pairs in compressed strings and also presents a formerly unknown relationship between maximal pairs and the run-length Burrows-Wheeler transform. This…

Data Structures and Algorithms · Computer Science 2020-02-18 Julian Pape-Lange

Prompting is the primary way to utilize the multitask capabilities of language models (LMs), but prompts occupy valuable space in the input context window, and repeatedly encoding the same prompt is computationally inefficient. Finetuning…

Computation and Language · Computer Science 2024-02-14 Jesse Mu , Xiang Lisa Li , Noah Goodman

We study the fundamental problem of finding the best string to represent a given set, in the form of the Closest String problem: Given a set $X \subseteq \Sigma^d$ of $n$ strings, find the string $x^*$ minimizing the radius of the smallest…

Computational Complexity · Computer Science 2023-05-30 Amir Abboud , Nick Fischer , Elazar Goldenberg , Karthik C. S. , Ron Safier

We show that it is decidable, given an automatic sequence $\bf s$ and a constant $c$, whether all prefixes of $\bf s$ have a string attractor of size $\leq c$. Using a decision procedure based on this result, we show that all prefixes of…

Formal Languages and Automata Theory · Computer Science 2024-05-31 Luke Schaeffer , Jeffrey Shallit

Large language models (LLMs) trained on web-scale datasets raise substantial concerns regarding permissible data usage. One major question is whether these models "memorize" all their training data or they integrate many data sources in…

Machine Learning · Computer Science 2024-11-13 Avi Schwarzschild , Zhili Feng , Pratyush Maini , Zachary C. Lipton , J. Zico Kolter

Sparse Tensor Compilers (STCs) have emerged as critical infrastructure for optimizing high-dimensional data analytics and machine learning workloads. The STCs must synthesize complex, irregular control flow for various compressed storage…

Programming Languages · Computer Science 2026-03-20 Kabilan Mahathevan , Yining Zhang , Muhammad Ali Gulzar , Kirshanthan Sundararajah

The one-bit compressed sensing framework aims to reconstruct a sparse signal by only using the sign information of its linear measurements. To compensate for the loss of scale information, past studies in the area have proposed recovering…

Information Theory · Computer Science 2016-09-21 Yingying Xu , Yoshiyuki Kabashima

Sensitivity measures how much the output of an algorithm changes, in terms of Hamming distance, when part of the input is modified. While approximation algorithms with low sensitivity have been developed for many problems, no sensitivity…

Data Structures and Algorithms · Computer Science 2025-10-17 Noah Fleming , Yuichi Yoshida

Compact directed acyclic word graphs (CDAWGs) [Blumer et al. 1987] are a fundamental data structure on strings with applications in text pattern searching, data compression, and pattern discovery. Intuitively, the CDAWG of a string $T$ is…

Data Structures and Algorithms · Computer Science 2025-02-11 Rikuya Hamai , Hiroto Fujimaru , Shunsuke Inenaga

Compression refers to encoding data using bits, so that the representation uses as few bits as possible. Compression could be lossless: i.e. encoded data can be recovered exactly from its representation) or lossy where the data is…

Information Theory · Computer Science 2012-10-19 Narayana Santhanam , Dharmendra Modha