English
Related papers

Related papers: Burrows Wheeler Transform on a Large Scale: Algori…

200 papers

While high-dimensional search-by-similarity techniques reached their maturity and in overall provide good performance, most of them are unable to cope with very large multimedia collections. The 'big data' challenge however has to be…

Information Retrieval · Computer Science 2015-02-02 Denis Shestakov , Diana Moise

Emerging Big Data analytics and machine learning applications require a significant amount of computational power. While there exists a plethora of large-scale data processing frameworks which thrive in handling the various complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-26 Jan S. Rellermeyer , Sobhan Omranian Khorasani , Dan Graur , Apourva Parthasarathy

The surge in generative AI workloads has created a need for scalable inference systems that can flexibly harness both GPUs and specialized accelerators while containing operational costs. This paper proposes a hardware-agnostic control loop…

Performance · Computer Science 2025-03-28 Yahav Biran , Imry Kissos

The Burrows-Wheeler transform (BWT) is integral to the FM-index, which is used extensively in text compression, indexing, pattern search, and bioinformatic problems as de novo assembly and read alignment. Thus, efficient construction of the…

Data Structures and Algorithms · Computer Science 2025-02-04 Enno Adler , Stefan Böttcher , Rita Hartel , Cederic Alexander Steininger

We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-08-25 Robert L Grossman , Yunhong Gu

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

Machine Learning · Computer Science 2024-07-03 Jin-Zhu Yu , Hiba Baroud

Powerful abstractions such as dataframes are only as efficient as their underlying runtime system. The de-facto distributed data processing framework, Apache Spark, is poorly suited for the modern cloud-based data-science workloads due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Alexandru Uta , Bogdan Ghit , Ankur Dave , Jan Rellermeyer , Peter Boncz

Large transformer models can highly improve Answer Sentence Selection (AS2) tasks, but their high computational costs prevent their use in many real-world applications. In this paper, we explore the following research question: How can we…

Computation and Language · Computer Science 2025-01-03 Yoshitomo Matsubara , Luca Soldaini , Eric Lind , Alessandro Moschitti

Many networks have event-driven dynamics (such as communication, social media and criminal networks), where the mean rate of the events occurring at a node in the network changes according to the occurrence of other events in the network.…

Social and Information Networks · Computer Science 2023-03-22 Santitissadeekorn N. , Delahaies S. , Lloyd D. J. B

In Machine Learning, the parent set identification problem is to find a set of random variables that best explain selected variable given the data and some predefined scoring function. This problem is a critical component to structure…

Artificial Intelligence · Computer Science 2019-01-09 Subhadeep Karan , Jaroslaw Zola

The Burrows-Wheeler Transform (BWT) is an efficient invertible text transformation algorithm with the properties of tending to group identical characters together in a run, and enabling search of the text. This transformation has extensive…

Human-Computer Interaction · Computer Science 2024-02-28 Lily Major , Dave Davies , Amanda Clare , Jacqueline W. Daykin , Benjamin Mora , Christine Zarges

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

Transformers are widely used deep learning architectures. Existing transformers are mostly designed for sequences (texts or time series), images or videos, and graphs. This paper proposes a novel transformer model for massive (up to a…

Machine Learning · Computer Science 2023-11-09 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Shigang Chen , Ronald Fick , Miles Medina , Christine Angelini

BigBench is the new standard (TPCx-BB) for benchmarking and testing Big Data systems. The TPCx-BB specification describes several business use cases -- queries -- which require a broad combination of data extraction techniques including…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-07 Nicolas Poggi , Alejandro Montero , David Carrera

Nowadays, the size of the Internet is experiencing rapid growth. As of December 2014, the number of global Internet websites has more than 1 billion and all kinds of information resources are integrated together on the Internet, however,the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-02 Qingpei Guo , Chao Xu , Yang Song

The increasing penetration of inverter-based resources (IBRs) is fundamentally reshaping power system dynamics and creating new challenges for stability assessment. Data-driven approaches, and in particular machine learning models, require…

Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are very computationally intensive and reach the hardware limit…

Machine Learning · Computer Science 2020-04-28 Fei Sun , Minghai Qin , Tianyun Zhang , Liu Liu , Yen-Kuang Chen , Yuan Xie

In the world of Big Data analytics, there is a series of tools aiming at simplifying programming applications to be executed on clusters. Although each tool claims to provide better programming, data and execution models, for which only…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-17 Claudia Misale , Maurizio Drocco , Marco Aldinucci , Guy Tremblay

Performing diagnostics in IT systems is an increasingly complicated task, and it is not doable in satisfactory time by even the most skillful operators. Systems and their architecture change very rapidly in response to business and user…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-21 Michał Zasadziński , Marc Solé , Alvaro Brandon , Victor Muntés-Mulero , David Carrera

Second order stationary models in time series analysis are based on the analysis of essential statistics whose computations follow a common pattern. In particular, with a map-reduce nomenclature, most of these operations can be modeled as…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-23 Francois Belletti , Evan Sparks , Michael Franklin , Alexandre M. Bayen