English
Related papers

Related papers: BigSparse: High-performance external graph analyti…

200 papers

Various real-world applications rely on in-memory dynamic graphs that must efficiently handle frequent updates while supporting low-latency analytics on evolving structures. Achieving both objectives remains challenging due to the trade-off…

Databases · Computer Science 2026-03-13 Pengpeng Qiao , Zhiwei Zhang , Xinzhou Wang , Zhetao Li , Xiaochun Cao , Yang Cao

Sorting is at the core of many database operations, such as index creation, sort-merge joins, and user-requested output sorting. As GPUs are emerging as a promising platform to accelerate various operations, sorting on GPUs becomes a viable…

Databases · Computer Science 2017-05-22 Elias Stehle , Hans-Arno Jacobsen

Vector searches on large-scale datasets are critical to modern online services like web search and RAG, which necessity storing the datasets and their index on the secondary storage like SSD. In this paper, we are the first to characterize…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Rongxin Cheng , Yifan Peng , Xingda Wei , Hongrui Xie , Rong Chen , Sijie Shen , Haibo Chen

Streaming graph partitioners enable resource-efficient and massively scalable partitioning, but one-pass assignment heuristics are highly sensitive to stream order and often yield substantially higher edge cuts than in-memory methods. We…

Databases · Computer Science 2026-02-26 Linus Baumgärtner , Adil Chhabra , Marcelo Fonseca Faraj , Christian Schulz

Recently we create so much data (2.5 quintillion bytes every day) that 90% of the data in the world today has been created in the last two years alone [1]. This data comes from sensors used to gather traffic or climate information, posts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Afsin Akdogan , Hien To

Dynamic graphs model many real-world applications, and as their sizes grow, efficiently storing and updating them becomes critical. We present RadixGraph, a fast and memory-efficient data structure for dynamic graph storage. RadixGraph…

Databases · Computer Science 2026-01-23 Haoxuan Xie , Junfeng Liu , Siqiang Luo , Kai Wang

Motivated by the properties of unending real-world cybersecurity streams, we present a new graph streaming model: XStream. We maintain a streaming graph and its connected components at single-edge granularity. In cybersecurity graph…

Data Structures and Algorithms · Computer Science 2021-12-02 Jonathan W. Berry , Cynthia A Phillips , Alexandra M. Porter

In recent years, the graph partitioning problem gained importance as a mandatory preprocessing step for distributed graph processing on very large graphs. Existing graph partitioning algorithms minimize partitioning latency by assigning…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-31 Christian Mayer , Ruben Mayer , Muhammad Adnan Tariq , Heiko Geppert , Larissa Laich , Lukas Rieger , Kurt Rothermel

Graph analytics are vital in fields such as social networks, biomedical research, and graph neural networks (GNNs). However, traditional CPUs and GPUs struggle with the memory bottlenecks caused by large graph datasets and their…

Hardware Architecture · Computer Science 2024-11-25 Oluwole Jaiyeoba , Abdullah T. Mughrabi , Morteza Baradaran , Beenish Gul , Kevin Skadron

This paper presents a novel high speed clustering scheme for high dimensional data streams. Data stream clustering has gained importance in different applications, for example, in network monitoring, intrusion detection, and real-time…

Databases · Computer Science 2015-10-13 Irshad Ahmed , Irfan Ahmed , Waseem Shahzad

Given a stream of heterogeneous graphs containing different types of nodes and edges, how can we spot anomalous ones in real-time while consuming bounded memory? This problem is motivated by and generalizes from its application in security…

Social and Information Networks · Computer Science 2016-02-23 Emaad A. Manzoor , Sadegh Momeni , Venkat N. Venkatakrishnan , Leman Akoglu

With the increase of centralization of resources in IT-infrastructure and the growing amount of cloud services, database management systems (DBMS) will be more and more outsourced to Infrastructure-as-a-Service (IaaS) providers. The…

Cryptography and Security · Computer Science 2016-08-30 Timo Schindler , Christoph Skornia

The most commonly used method to tackle the graph partitioning problem in practice is the multilevel approach. During a coarsening phase, a multilevel graph partitioning algorithm reduces the graph size by iteratively contracting nodes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Henning Meyerhenke , Peter Sanders , Christian Schulz

Current graph systems can easily process billions of data, however when increased to exceed hundred billions, the performance decreases dramatically, time series data always be very huge, consequently computation on time series graphs still…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-25 Derong Tang

Graph Partitioning is widely used in many real-world applications such as fraud detection and social network analysis, in order to enable the distributed graph computing on large graphs. However, existing works fail to balance the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-07 Li Zeng , Haohan Huang , Binfan Zheng , Kang Yang , Shengcheng Shao , Jinhua Zhou , Jun Xie , Rongqian Zhao , Xin Chen

We introduce BriskStream, an in-memory data stream processing system (DSPSs) specifically designed for modern shared-memory multicore architectures. BriskStream's key contribution is an execution plan optimization paradigm, namely RLAS,…

Databases · Computer Science 2019-04-10 Shuhao Zhang , Jiong He , Amelie Chi Zhou , Bingsheng He

Edge-centric distributed computations have appeared as a recent technique to improve the shortcomings of think-like-a-vertex algorithms on large scale-free networks. In order to increase parallelism on this model, edge partitioning -…

Data Structures and Algorithms · Computer Science 2018-10-12 Sebastian Schlag , Christian Schulz , Daniel Seemaier , Darren Strash

As computer clusters become more common and the size of the problems encountered in the field of AI grows, there is an increasing demand for efficient parallel inference algorithms. We consider the problem of parallel inference on large…

Artificial Intelligence · Computer Science 2012-05-14 Joseph E. Gonzalez , Yucheng Low , Carlos E. Guestrin , David O'Hallaron

The availability of larger and larger graph datasets, growing exponentially over the years, has created several new algorithmic challenges to be addressed. Sequential approaches have become unfeasible, while interest on parallel and…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-26 Alessio Guerrieri , Alberto Montresor

This work consists of a study of a set of techniques and strategies related with algorithm's design, whose purpose is the resolution of problems on massive data sets, in an efficient way. This field is known as Algorithms for Big Data. In…

Data Structures and Algorithms · Computer Science 2017-08-29 Sergio García Prado