中文
相关论文

相关论文: Burrows Wheeler Transform on a Large Scale: Algori…

200 篇论文

While high-dimensional search-by-similarity techniques reached their maturity and in overall provide good performance, most of them are unable to cope with very large multimedia collections. The 'big data' challenge however has to be…

信息检索 · 计算机科学 2015-02-02 Denis Shestakov , Diana Moise

Emerging Big Data analytics and machine learning applications require a significant amount of computational power. While there exists a plethora of large-scale data processing frameworks which thrive in handling the various complexities of…

分布式、并行与集群计算 · 计算机科学 2019-06-26 Jan S. Rellermeyer , Sobhan Omranian Khorasani , Dan Graur , Apourva Parthasarathy

The surge in generative AI workloads has created a need for scalable inference systems that can flexibly harness both GPUs and specialized accelerators while containing operational costs. This paper proposes a hardware-agnostic control loop…

性能 · 计算机科学 2025-03-28 Yahav Biran , Imry Kissos

The Burrows-Wheeler transform (BWT) is integral to the FM-index, which is used extensively in text compression, indexing, pattern search, and bioinformatic problems as de novo assembly and read alignment. Thus, efficient construction of the…

数据结构与算法 · 计算机科学 2025-02-04 Enno Adler , Stefan Böttcher , Rita Hartel , Cederic Alexander Steininger

We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the…

分布式、并行与集群计算 · 计算机科学 2008-08-25 Robert L Grossman , Yunhong Gu

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

机器学习 · 计算机科学 2024-07-03 Jin-Zhu Yu , Hiba Baroud

Powerful abstractions such as dataframes are only as efficient as their underlying runtime system. The de-facto distributed data processing framework, Apache Spark, is poorly suited for the modern cloud-based data-science workloads due to…

分布式、并行与集群计算 · 计算机科学 2022-02-09 Alexandru Uta , Bogdan Ghit , Ankur Dave , Jan Rellermeyer , Peter Boncz

Large transformer models can highly improve Answer Sentence Selection (AS2) tasks, but their high computational costs prevent their use in many real-world applications. In this paper, we explore the following research question: How can we…

计算与语言 · 计算机科学 2025-01-03 Yoshitomo Matsubara , Luca Soldaini , Eric Lind , Alessandro Moschitti

Many networks have event-driven dynamics (such as communication, social media and criminal networks), where the mean rate of the events occurring at a node in the network changes according to the occurrence of other events in the network.…

社会与信息网络 · 计算机科学 2023-03-22 Santitissadeekorn N. , Delahaies S. , Lloyd D. J. B

In Machine Learning, the parent set identification problem is to find a set of random variables that best explain selected variable given the data and some predefined scoring function. This problem is a critical component to structure…

人工智能 · 计算机科学 2019-01-09 Subhadeep Karan , Jaroslaw Zola

The Burrows-Wheeler Transform (BWT) is an efficient invertible text transformation algorithm with the properties of tending to group identical characters together in a run, and enabling search of the text. This transformation has extensive…

人机交互 · 计算机科学 2024-02-28 Lily Major , Dave Davies , Amanda Clare , Jacqueline W. Daykin , Benjamin Mora , Christine Zarges

The advent of experimental science facilities-instruments and observatories, such as the Large Hadron Collider, the Laser Interferometer Gravitational Wave Observatory, and the upcoming Large Synoptic Survey Telescope-has brought about…

分布式、并行与集群计算 · 计算机科学 2019-02-12 E. A. Huerta , Roland Haas , Shantenu Jha , Mark Neubauer , Daniel S. Katz

Transformers are widely used deep learning architectures. Existing transformers are mostly designed for sequences (texts or time series), images or videos, and graphs. This paper proposes a novel transformer model for massive (up to a…

机器学习 · 计算机科学 2023-11-09 Wenchong He , Zhe Jiang , Tingsong Xiao , Zelin Xu , Shigang Chen , Ronald Fick , Miles Medina , Christine Angelini

BigBench is the new standard (TPCx-BB) for benchmarking and testing Big Data systems. The TPCx-BB specification describes several business use cases -- queries -- which require a broad combination of data extraction techniques including…

分布式、并行与集群计算 · 计算机科学 2020-07-07 Nicolas Poggi , Alejandro Montero , David Carrera

Nowadays, the size of the Internet is experiencing rapid growth. As of December 2014, the number of global Internet websites has more than 1 billion and all kinds of information resources are integrated together on the Internet, however,the…

分布式、并行与集群计算 · 计算机科学 2015-06-02 Qingpei Guo , Chao Xu , Yang Song

The increasing penetration of inverter-based resources (IBRs) is fundamentally reshaping power system dynamics and creating new challenges for stability assessment. Data-driven approaches, and in particular machine learning models, require…

Neural network models are widely used in solving many challenging problems, such as computer vision, personalized recommendation, and natural language processing. Those models are very computationally intensive and reach the hardware limit…

机器学习 · 计算机科学 2020-04-28 Fei Sun , Minghai Qin , Tianyun Zhang , Liu Liu , Yen-Kuang Chen , Yuan Xie

In the world of Big Data analytics, there is a series of tools aiming at simplifying programming applications to be executed on clusters. Although each tool claims to provide better programming, data and execution models, for which only…

分布式、并行与集群计算 · 计算机科学 2016-06-17 Claudia Misale , Maurizio Drocco , Marco Aldinucci , Guy Tremblay

Performing diagnostics in IT systems is an increasingly complicated task, and it is not doable in satisfactory time by even the most skillful operators. Systems and their architecture change very rapidly in response to business and user…

分布式、并行与集群计算 · 计算机科学 2018-09-21 Michał Zasadziński , Marc Solé , Alvaro Brandon , Victor Muntés-Mulero , David Carrera

Second order stationary models in time series analysis are based on the analysis of essential statistics whose computations follow a common pattern. In particular, with a map-reduce nomenclature, most of these operations can be modeled as…

分布式、并行与集群计算 · 计算机科学 2015-11-23 Francois Belletti , Evan Sparks , Michael Franklin , Alexandre M. Bayen