English
Related papers

Related papers: A New Burrows Wheeler Transform Markov Distance

200 papers

We present a new semi-external algorithm that builds the Burrows--Wheeler transform variant of Bauer et al. (a.k.a., BCR BWT) in linear expected time. Our method uses compression techniques to reduce computational costs when the input is…

Data Structures and Algorithms · Computer Science 2023-08-15 Diego Díaz-Domínguez , Gonzalo Navarro

The Gromov-Wasserstein (GW) distance is frequently used in machine learning to compare distributions across distinct metric spaces. Despite its utility, it remains computationally intensive, especially for large-scale problems. Recently, a…

Machine Learning · Statistics 2024-10-01 Antoine Salmona , Julie Delon , Agnès Desolneux

The Burrows-Wheeler Transform (BWT) is an invertible text transformation that permutes symbols of a text according to the lexicographical order of its suffixes. BWT is the main component of popular lossless compression programs (such as…

Data Structures and Algorithms · Computer Science 2021-04-13 Dominik Kempa , Tomasz Kociumaka

Run-length encoding Burrows-Wheeler Transformed strings, resulting in Run-Length BWT (RLBWT), is a powerful tool for processing highly repetitive strings. We propose a new algorithm for online RLBWT working in run-compressed space, which…

Data Structures and Algorithms · Computer Science 2017-10-17 Tatsuya Ohno , Yoshimasa Takabatake , Tomohiro I , Hiroshi Sakamoto

The word mover's distance (WMD) is a fundamental technique for measuring the similarity of two documents. As the crux of WMD, it can take advantage of the underlying geometry of the word space by employing an optimal transport formulation.…

Machine Learning · Computer Science 2022-06-16 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Motivated by high-throughput single-cell cytometry data with applications to vaccine development and immunological research, we consider statistical clustering in large-scale data that contain multiple rare clusters. We propose a new…

Methodology · Statistics 2016-06-30 Lin Lin , Jia Li

A weight based dynamic compression method has recently been proposed, which is especially suitable for the encoding of files with locally skewed distributions. Its main idea is to assign larger weights to closer to be encoded symbols by…

Data Structures and Algorithms · Computer Science 2021-05-24 Aharon Fruchtman , Yoav Gross , Shmuel T. Klein , Dana Shapira

The Burrows-Wheeler Transform (BWT) has been an essential tool in text compression and indexing. First introduced in 1994, it went on to provide the backbone for the first encoding of the classic suffix tree data structure in space close to…

Data Structures and Algorithms · Computer Science 2020-02-19 Jason Bentley , Daniel Gibney , Sharma V. Thankachan

Determining the appropriate number of clusters in unsupervised learning is a central problem in statistics and data science. Traditional validity indices such as Calinski-Harabasz, Silhouette, and Davies-Bouldin-depend on centroid-based…

Machine Learning · Statistics 2025-10-17 Mohammed Baragilly , Hend Gabr

The Burrows-Wheeler Transform (BWT) is an efficient invertible text transformation algorithm with the properties of tending to group identical characters together in a run, and enabling search of the text. This transformation has extensive…

Human-Computer Interaction · Computer Science 2024-02-28 Lily Major , Dave Davies , Amanda Clare , Jacqueline W. Daykin , Benjamin Mora , Christine Zarges

The Burrows-Wheeler Transform (BWT) of a string is an invertible permutation of the string, which can be used for data compression and compact indexes for string pattern matching. Ganguly et al. [SODA, 2017] introduced the parameterized BWT…

Data Structures and Algorithms · Computer Science 2025-05-12 Shogen Kawanami , Kento Iseri , Tomohiro I

The Burrows-Wheeler Transform (BWT) is a word transformation introduced in 1994 for Data Compression. It has become a fundamental tool for designing self-indexing data structures, with important applications in several area in science and…

Data Structures and Algorithms · Computer Science 2019-07-05 Raffaele Giancarlo , Giovanni Manzini , Antonio Restivo , Giovanna Rosone , Marinella Sciortino

The Extended Burrows Wheeler transform (EBWT) helps to find the distance between two sequences. Implementation of an existing algorithm takes considerable amount of time for small size sequences. In this paper, we give a parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-02 Shashank Srikant

In 1994, Burrows and Wheeler developed a data compression algorithm which performs significantly better than Lempel-Ziv based algorithms. Since then, a lot of work has been done in order to improve their algorithm, which is based on a…

Data Structures and Algorithms · Computer Science 2007-05-23 Dragos Trinca

Long-term location tracking, where trajectory compression is commonly used, has gained high interest for many applications in transport, ecology, and wearable computing. However, state-of-the-art compression methods involve high space-time…

Data Structures and Algorithms · Computer Science 2014-12-09 Jiajun Liu , Kun Zhao , Philipp Sommer , Shuo Shang , Brano Kusy , Raja Jurdak

The Best-Worst Method (BWM) is a well-known distance based multi-criteria decision-making method used for computing the weights of decision criteria. This article examines a taxicab distance based model of the BWM, with the objective of…

Optimization and Control · Mathematics 2025-04-07 Harshit Ratandhara , Mohit Kumar

In the process of training a generative model, it becomes essential to measure the discrepancy between two high-dimensional probability distributions: the generative distribution and the ground-truth distribution of the observed dataset.…

Machine Learning · Statistics 2023-12-07 Seunghwan An , Sungchul Hong , Jong-June Jeon

The Burrows-Wheeler transform (BWT) is a permutation whose applications are prevalent in data compression and text indexing. The bijective BWT (BBWT) is a bijective variant of it. Although it is known that the BWT can be constructed in…

Data Structures and Algorithms · Computer Science 2021-04-23 Hideo Bannai , Juha Kärkkäinen , Dominik Köppl , Marcin Picatkowski

Burrows-Wheeler transform (BWT) is an invertible text transformation that, given a text $T$ of length $n$, permutes its symbols according to the lexicographic order of suffixes of $T$. BWT is one of the most heavily studied algorithms in…

Data Structures and Algorithms · Computer Science 2020-12-09 Dominik Kempa , Tomasz Kociumaka

The recent developments in machine learning have highlighted a conflict between online platforms and their users in terms of privacy. The importance of user privacy and the struggle for power over user data has been intensified as…

Machine Learning · Computer Science 2026-03-09 Charles Meyers , Aaron MacSween , Erik Elmroth , Tommy Löfstedt