English
Related papers

Related papers: Practical combinations of repetition-aware data st…

200 papers

The problem of string reconstruction from substring information has found many applications due to its relevance in DNA- and polymer-based data storage. One practically important and challenging paradigm requires reconstructing mixtures of…

Information Theory · Computer Science 2020-10-22 Ryan Gabrys , Srilakshmi Pattabiraman , Olgica Milenkovic

Dynamic Time Warping (DTW) is a widely used similarity measure for comparing strings that encode time series data, with applications to areas including bioinformatics, signature verification, and speech recognition. The standard…

Data Structures and Algorithms · Computer Science 2022-07-05 Zoe Xi , William Kuszmaul

Linear combination is a potent data fusion method in information retrieval tasks, thanks to its ability to adjust weights for diverse scenarios. However, achieving optimal weight training has traditionally required manual relevance…

Information Retrieval · Computer Science 2023-09-25 Qiuyu Xu , Yidong Huang , Shengli Wu , Adrian Moore

The Linked Open Data practice has led to a significant growth of structured data on the Web in the last decade. Such structured data describe real-world entities in a machine-readable way, and have created an unprecedented opportunity for…

Computation and Language · Computer Science 2022-06-27 Ziqi Zhang , Xingyi Song

Technology and collaboration enable dramatic increases in the size of psychological and psychiatric data collections, but finding structure in these large data sets with many collected variables is challenging. Decision tree ensembles like…

Machine Learning · Statistics 2017-02-15 Patrick J. Miller , Gitta H. Lubke , Daniel B. McArtor , C. S. Bergeman

Real world arrays often contain underlying structure, such as sparsity, runs of repeated values, or symmetry. Specializing for structure yields significant speedups. But automatically generating efficient code for structured data is…

Programming Languages · Computer Science 2023-10-13 Willow Ahrens , Daniel Donenfeld , Fredrik Kjolstad , Saman Amarasinghe

In today's data-centric world, fast and effective compression of data is paramount. To measure success towards the second goal, Kempa and Prezza [STOC2018] introduce the string attractor, a combinatorial object unifying dictionary-based…

Data Structures and Algorithms · Computer Science 2024-07-23 Philip Whittington

Detecting and measuring repetitiveness of strings is a problem that has been extensively studied in data compression and text indexing. However, when the data are structured in a non-linear way, like in the context of two-dimensional…

Data Structures and Algorithms · Computer Science 2024-04-11 Giuseppe Romana , Marinella Sciortino , Cristian Urbina

Lempel-Ziv-Double (LZD) is a variation of the LZ78 compression scheme that achieves better compression on repetitive datasets. Nevertheless, prior research has identified computational inefficiencies and a weakness in its compressibility…

Data Structures and Algorithms · Computer Science 2025-05-05 Linus Götz , Dominik Köppl

Based on the Breslauer-Italiano online suffix tree construction algorithm (2013) with double logarithmic worst-case guarantees on the update time per letter, we develop near-real-time algorithms for several classical problems on strings,…

Data Structures and Algorithms · Computer Science 2026-02-18 Dominik Köppl , Gregory Kucherov

In this paper, we present the first study of the computational complexity of converting an automata-based text index structure, called the Compact Directed Acyclic Word Graph (CDAWG), of size $e$ for a text $T$ of length $n$ into other text…

Data Structures and Algorithms · Computer Science 2023-08-07 Hiroki Arimura , Shunsuke Inenaga , Yasuaki Kobayashi , Yuto Nakashima , Mizuki Sue

It is known that the majority of the human genome consists of repeated sequences. Furthermore, it is believed that a significant part of the rest of the genome also originated from repeated sequences and has mutated to its current form. In…

Information Theory · Computer Science 2014-01-21 Farzad Farnoud , Moshe Schwartz , Jehoshua Bruck

The Sliding Window Lempel-Ziv (SWLZ) algorithm that makes use of recurrence times and match lengths has been studied from various perspectives in information theory literature. In this paper, we undertake a finer study of these quantities…

Information Theory · Computer Science 2016-11-17 Siddharth Jain , R. K. Bansal

Combining data from various sources empowers researchers to explore innovative questions, for example those raised by conducting healthcare monitoring studies. However, the lack of a unique identifier often poses challenges. Record linkage…

Methodology · Statistics 2025-09-16 Kayané Robach , Stéphanie L van der Pas , Mark A van de Wiel , Michel H Hof

Systematicity, i.e., the ability to recombine known parts and rules to form new sequences while reasoning over relational data, is critical to machine intelligence. A model with strong systematicity is able to train on small-scale tasks and…

Artificial Intelligence · Computer Science 2022-05-16 Shengyao Lu , Bang Liu , Keith G. Mills , Shangling Jui , Di Niu

Recent research has employed reinforcement learning (RL) algorithms to optimize long-term user engagement in recommender systems, thereby avoiding common pitfalls such as user boredom and filter bubbles. They capture the sequential and…

Information Retrieval · Computer Science 2023-01-25 Romain Deffayet , Thibaut Thonet , Jean-Michel Renders , Maarten de Rijke

The Burrows-Wheeler Transform (BWT) is an important technique both in data compression and in the design of compact indexing data structures. It has been generalized from single strings to collections of strings and some classes of labeled…

Data Structures and Algorithms · Computer Science 2019-05-30 Jarno Alanko , Travis Gagie , Gonzalo Navarro , Louisa Seelbach Benkner

Random access to highly compressed strings -- represented by straight-line programs or Lempel-Ziv parses, for example -- is a well-studied topic. Random access to such strings in strongly sublogarithmic time is impossible in the worst case,…

Data Structures and Algorithms · Computer Science 2026-02-05 Ferdinando Cicalese , Zsuzsanna Lipták , Travis Gagie , Gonzalo Navarro , Nicola Prezza , Cristian Urbina

Motivated by studies of data retrieval in polymer-based storage systems, we consider the problem of reconstructing a multiset of binary strings that have the same length and the same weight from the compositions of their prefixes and…

Discrete Mathematics · Computer Science 2024-11-07 Yaoyu Yang , Zitan Chen

A bit catastrophe, loosely defined, is when a change in just one character of a string causes a significant change in the size of the compressed string. We study this phenomenon for the Burrows-Wheeler Transform (BWT), a string transform at…

Data Structures and Algorithms · Computer Science 2025-06-10 Sara Giuliani , Shunsuke Inenaga , Zsuzsanna Lipták , Giuseppe Romana , Marinella Sciortino , Cristian Urbina