English
Related papers

Related papers: ByteStore: Hybrid Layouts for Main-Memory Column S…

200 papers

The past two decades have witnessed significant success in applying columnar storage to data warehousing and analytics. However, the rapid growth of machine learning poses new challenges. This paper presents Bullion, a columnar storage…

Databases · Computer Science 2024-11-20 Gang Liao , Ye Liu , Jianjun Chen , Daniel J. Abadi

The extensive use of HPC infrastructures and frameworks for running dataintensive applications has led to a growing interest in data partitioning techniques and strategies. In fact, application performance can be heavily affected by how…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-02 Riccardo Cantini , Fabrizio Marozzo , Alessio Orsino , Domenico Talia , Paolo Trunfio , Rosa M. Badia , Jorge Ejarque , Fernando Vazquez

Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate the metadata and data service and negatively impact other…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-01 Zhao Zhang , Lei Huang , Uri Manor , Linjing Fang , Gabriele Merlo , Craig Michoski , John Cazes , Niall Gaffney

Modern real-time business analytic consist of heterogeneous workloads (e.g, database queries, graph processing, and machine learning). These analytic applications need programming environments that can capture all aspects of the constituent…

Hardware Architecture · Computer Science 2019-05-27 Rekha Singhal , Nathan Zhang , Luigi Nardi , Muhammad Shahbaz , Kunle Olukotun

Read mapping is a fundamental, yet computationally-expensive step in many genomics applications. It is used to identify potential matches and differences between fragments (called reads) of a sequenced genome and an already known genome…

While reduction in feature size makes computation cheaper in terms of latency, area, and power consumption, performance of emerging data-intensive applications is determined by data movement. These trends have introduced the concept of…

Hardware Architecture · Computer Science 2018-03-19 Bahar Asgari , Saibal Mukhopadhyay , Sudhakar Yalamanchili

The Variable Block Row (VBR) format is an influential blocked sparse matrix format designed for matrices with shared sparsity structure between adjacent rows and columns. VBR groups adjacent rows and columns, storing the resulting blocks…

Data Structures and Algorithms · Computer Science 2023-10-13 Willow Ahrens , Erik G. Boman

We propose a general data structure CORoBTS for storing B-tree-like search trees dynamically in a cache-oblivious way combining the van Emde Boas memory layout with packed memory array. In the use of the vEB layout mostly search complexity…

Data Structures and Algorithms · Computer Science 2024-10-02 Lukáš Ondráček , Ondřej Mička

We propose Partition Dimensions Across (PDX), a data layout for vectors (e.g., embeddings) that, similar to PAX [6], stores multiple vectors in one block, using a vertical layout for the dimensions (Figure 1). PDX accelerates exact and…

Databases · Computer Science 2025-03-07 Leonardo Kuffo , Elena Krippner , Peter Boncz

Data store replication results in a fundamental trade-off between operation latency and data consistency. In this paper, we examine this trade-off in the context of quorum-replicated data stores. Under partial, or non-strict quorum…

As nowadays Machine Learning (ML) techniques are generating huge data collections, the problem of how to efficiently engineer their storage and operations is becoming of paramount importance. In this article we propose a new lossless…

Data Structures and Algorithms · Computer Science 2022-03-31 Paolo Ferragina , Travis Gagie , Dominik Köppl , Giovanni Manzini , Gonzalo Navarro , Manuel Striani , Francesco Tosoni

Read-optimized columnar databases use differential updates to handle writes by maintaining a separate write-optimized delta partition which is periodically merged with the read-optimized and compressed main partition. This merge process…

Modern large-scale services such as search engines, messaging platforms, and serverless functions, rely on key-value (KV) stores to maintain high performance at scale. When such services are deployed in constrained memory environments, they…

Databases · Computer Science 2025-08-07 Konstantinos Kanellis , Badrish Chandramouli , Ted Hart , Shivaram Venkataraman

We attempt to determine the best order and search algorithm to store $n$ comparable data items in an array, $A$, of length $n$ so that we can, for any query value, $x$, quickly find the smallest value in $A$ that is greater than or equal to…

Data Structures and Algorithms · Computer Science 2017-03-16 Paul-Virak Khuong , Pat Morin

Cloud key-value (KV) stores provide businesses with a cost-effective and adaptive alternative to traditional on-premise data management solutions. KV stores frequently consist of heterogeneous clusters, characterized by varying hardware…

Databases · Computer Science 2024-07-30 Alireza Heidari , Amirhossein Ahmadi , Zefeng Zhi , Wei Zhang

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

This paper describes a non-homogeneous distributed storage systems (DSS), where there is one super node which has a larger storage size and higher reliability and availability than the other storage nodes. We propose three distributed…

Information Theory · Computer Science 2012-08-13 Vo Tam Van , Chau Yuen , Jing Li

Various real-world applications rely on in-memory dynamic graphs that must efficiently handle frequent updates while supporting low-latency analytics on evolving structures. Achieving both objectives remains challenging due to the trade-off…

Databases · Computer Science 2026-03-13 Pengpeng Qiao , Zhiwei Zhang , Xinzhou Wang , Zhetao Li , Xiaochun Cao , Yang Cao

XML data warehouses form an interesting basis for decision-support applications that exploit complex data. However, native-XML database management systems (DBMSs) currently bear limited performances and it is necessary to research for ways…

Databases · Computer Science 2017-01-30 Hadj Mahboubi , Jérôme Darmont

This paper develops a memory-efficient approach for Sequential Pattern Mining (SPM), a fundamental topic in knowledge discovery that faces a well-known memory bottleneck for large data sets. Our methodology involves a novel hybrid trie data…

Databases · Computer Science 2024-07-30 Amin Hosseininasab , Willem-Jan van Hoeve , Andre A. Cire