English
Related papers

Related papers: Compressed Text Indexes:From Theory to Practice!

200 papers

Modern big data applications integrate data from various sources. As a result, these datasets may not satisfy perfect constraints, leading to sparse schema information and non-optimal query performance. The existing approach of PatchIndexes…

Databases · Computer Science 2021-02-15 Steffen Kläbe , Kai-Uwe Sattler , Stephan Baumann

Automatically summarizing large text collections is a valuable tool for document research, with applications in journalism, academic research, legal work, and many other fields. In this work, we contrast two classes of systems for…

Computation and Language · Computer Science 2025-02-11 Adithya Pratapa , Teruko Mitamura

This paper considers the problem of compressive sensing over a finite alphabet, where the finite alphabet may be inherent to the nature of the data or a result of quantization. There are multiple examples of finite alphabet based static as…

Information Theory · Computer Science 2013-03-19 Abhik Kumar Das , Sriram Vishwanath

The FM-index is a celebrated compressed data structure for full-text pattern searching. After the first wave of interest in its theoretical developments, we can observe a surge of interest in practical FM-index variants in the last few…

Data Structures and Algorithms · Computer Science 2015-10-27 Szymon Grabowski , Marcin Raniszewski , Sebastian Deorowicz

We discuss the applicability of compressed sensing theory. We take a genuine look at both experimental results and theoretical works. We answer the following questions: 1) What can compressed sensing really do? 2) More importantly, why?

Information Theory · Computer Science 2013-12-03 Xiteng Liu

Compressing integer keys is a fundamental operation among multiple communities, such as database management (DB), information retrieval (IR), and high-performance computing (HPC). Recent advances in \emph{learned indexes} have inspired the…

Databases · Computer Science 2024-12-17 Qiyu Liu , Siyuan Han , Jianwei Liao , Jin Li , Jingshu Peng , Jun Du , Lei Chen

Recent advances in text-guided image compression have shown great potential to enhance the perceptual quality of reconstructed images. These methods, however, tend to have significantly degraded pixel-wise fidelity, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hagyeong Lee , Minkyu Kim , Jun-Hyuk Kim , Seungeon Kim , Dokwan Oh , Jaeho Lee

In this paper, proximity full-text searches in large text arrays are considered. A search query consists of several words. The search result is a list of documents containing these words. In a modern search system, documents that contain…

Information Retrieval · Computer Science 2020-06-28 Alexander B. Veretennikov

Index plays an essential role in modern database engines to accelerate the query processing. The new paradigm of "learned index" has significantly changed the way of designing index structures in DBMS. The key insight is that indexes could…

Databases · Computer Science 2021-04-14 Jiacheng Wu , Yong Zhang , Shimin Chen , Jin Wang , Yu Chen , Chunxiao Xing

Compression algorithms reduce the redundancy in data representation to decrease the storage required for that data. Data compression offers an attractive approach to reducing communication costs by using available bandwidth effectively.…

Performance · Computer Science 2007-05-23 B. S. Shajeemohan , Dr. V. K. Govindan

In data exploration, users need to analyze large data files quickly, aiming to minimize data-to-analysis time. While recent adaptive indexing approaches address this need, they are cases where demonstrate poor performance. Particularly,…

Databases · Computer Science 2024-07-29 Stavros Maroulis , Nikos Bikakis , Vassilis Stamatopoulos , George Papastefanatos

Database indexes facilitate data retrieval and benefit broad applications in real-world systems. Recently, a new family of index, named learned index, is proposed to learn hidden yet useful data distribution and incorporate such information…

Databases · Computer Science 2021-01-05 Yaliang Li , Daoyuan Chen , Bolin Ding , Kai Zeng , Jingren Zhou

The huge amount of information stored in text form makes methods that deal with texts really interesting. This thesis focuses on dealing with texts using compression distances. More specifically, the thesis takes a small step towards…

Information Theory · Computer Science 2012-05-30 Ana Granados

The presence of smart objects is increasingly widespread and their ecosystem, also known as Internet of Things, is relevant in many different application scenarios. The huge amount of temporally annotated data produced by these smart…

Databases · Computer Science 2022-09-21 Giacomo Chiarot , Claudio Silvestri

This work addresses the problem of extracting deeply learned features directly from compressive measurements. There has been no work in this area. Existing deep learning tools only give good results when applied on the full signal, that too…

Computer Vision and Pattern Recognition · Computer Science 2016-12-23 Shikha Singh , Vanika Singhal , Angshul Majumdar

The sheer increase in volume of RDF data demands efficient solutions for the triple indexing problem, that is devising a compressed data structure to compactly represent RDF triples by guaranteeing, at the same time, fast pattern matching…

Information Retrieval · Computer Science 2022-02-08 Raffaele Perego , Giulio Ermanno Pibiri , Rossano Venturini

While scientists increasingly recognize the importance of metadata in describing their data, spreadsheets remain the preferred tool for supplying this information despite their limitations in ensuring compliance and quality. Various tools…

Digital Libraries · Computer Science 2023-12-15 Martin J. O'Connor , Marcos Martínez-Romero , Mete Ugur Akdogan , Josef Hardi , Mark A. Musen

Compressed file formats are the corner stone of efficient data storage and transmission, yet their potential for representation learning remains largely underexplored. We introduce TEMPEST (TransformErs froM comPressed rEpreSenTations), a…

Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge…

Databases · Computer Science 2023-03-07 David Ding , Ivan Carvalho , Ramon Lawrence

Unstructured data (e.g., video or text) is now commonly queried by using computationally expensive deep neural networks or human labelers to produce structured information, e.g., object types and positions in video. To accelerate queries,…

Databases · Computer Science 2022-01-07 Daniel Kang , John Guibas , Peter Bailis , Tatsunori Hashimoto , Matei Zaharia