English
Related papers

Related papers: RapidStore: An Efficient Dynamic Graph Storage Sys…

200 papers

K-nearest neighbor search is one of the fundamental tasks in various applications and the hierarchical navigable small world (HNSW) has recently drawn attention in large-scale cloud services, as it easily scales up the database while…

Hardware Architecture · Computer Science 2022-07-13 Ji-Hoon Kim , Yeo-Reum Park , Jaeyoung Do , Soo-Young Ji , Joo-Young Kim

Dynamic graphs with ordered sequences of events between nodes are prevalent in real-world industrial applications such as e-commerce and social platforms. However, representation learning for dynamic graphs has posed great computational…

Machine Learning · Computer Science 2021-12-16 Xinshi Chen , Yan Zhu , Haowen Xu , Mengyang Liu , Liang Xiong , Muhan Zhang , Le Song

Subgraph listing is a fundamental problem in graph theory and has wide applications in areas like sociology, chemistry, and social networks. Modern graphs can usually be large-scale as well as highly dynamic, which challenges the efficiency…

Databases · Computer Science 2020-09-01 Xun Jian , Yue Wang , Xiayu Lei , Yanyan Shen , Lei Chen

Time-evolving large graph has received attention due to their participation in real-world applications such as social networks and PageRank calculation. It is necessary to partition a large-scale dynamic graph in a streaming manner to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-01 Md Anwarul Kaium Patwary , Saurabh Garg , Sudheer Kumar Battula , Byeong Kang

Graph Neural Network (GNN) models on streaming graphs entail algorithmic challenges to continuously capture its dynamic state, as well as systems challenges to optimize latency, memory, and throughput during both inference and training. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Rustam Guliyev , Aparajita Haldar , Hakan Ferhatosmanoglu

Processing, managing, and analyzing dynamic graphs are the cornerstone in multiple application domains including fraud detection, recommendation system, graph neural network training, etc. This demo presents GTX, a latch-free…

Databases · Computer Science 2024-05-03 Libin Zhou , Walid Aref

In this paper, we propose a generic concurrent directed graph (for shared memory architecture) that is concurrently being updated by threads adding/deleting vertices and edges. The graph is constructed by the composition of the well known…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Sathya Peri , Muktikanta Sa , Nandini Singhal

To effectively manage increasing knowledge graphs in various domains, a hot research topic, knowledge graph storage management, has emerged. Existing methods are classified to relational stores and native graph stores. Relational stores are…

Databases · Computer Science 2020-12-15 Zhixin Qi , Hongzhi Wang , Haoran Zhang

In a dynamic retrieval system, documents must be ingested as they arrive, and be immediately findable by queries. Our purpose in this paper is to describe an index structure and processing regime that accommodates that requirement for…

Information Retrieval · Computer Science 2023-01-12 Alistair Moffat , Joel Mackenzie

This study proposes a novel storage engine, SynchroStore, designed to address the inefficiency of update operations in columnar storage systems based on Log-Structured Merge Trees (LSM-Trees) under hybrid workload scenarios. While columnar…

Databases · Computer Science 2025-03-25 Yinan Zhang , Huiqi Hu , Xuan Zhou

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

Machine Learning · Computer Science 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graphs are widespread data structures used to model a wide variety of problems. The sheer amount of data to be processed has prompted the creation of a myriad of systems that help us cope with massive scale graphs. The pressure to deliver…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-09 Luis M. Vaquero , Felix Cuadrado , Matei Ripeanu

We study dynamic graph algorithms in the Massively Parallel Computation model, which was inspired by practical data processing systems. Our goal is to provide algorithms that can efficiently handle large batches of edge insertions and…

Data Structures and Algorithms · Computer Science 2021-01-12 Krzysztof Nowicki , Krzysztof Onak

Context: The growing size of graph-based modeling artifacts in model-driven engineering calls for techniques that enable efficient execution of graph queries. Incremental approaches based on the RETE algorithm provide an adequate solution…

Software Engineering · Computer Science 2024-07-08 Matthias Barkowsky , Holger Giese

Embedding large graphs in low dimensional spaces has recently attracted significant interest due to its wide applications such as graph visualization, link prediction and node classification. Existing methods focus on computing the…

Social and Information Networks · Computer Science 2018-05-30 Palash Goyal , Nitin Kamra , Xinran He , Yan Liu

The ability to handle large scale graph data is crucial to an increasing number of applications. Much work has been dedicated to supporting basic graph operations such as subgraph matching, reachability, regular expression matching, etc. In…

Databases · Computer Science 2012-05-31 Zhao Sun , Hongzhi Wang , Haixun Wang , Bin Shao , Jianzhong Li

Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate the metadata and data service and negatively impact other…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-01 Zhao Zhang , Lei Huang , Uri Manor , Linjing Fang , Gabriele Merlo , Craig Michoski , John Cazes , Niall Gaffney

Dataflow devices represent an avenue towards saving the control and data movement overhead of Load-Store Architectures. Various dataflow accelerators have been proposed, but how to efficiently schedule applications on such devices remains…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Tiziano De Matteis , Lukas Gianinazzi , Johannes de Fine Licht , Torsten Hoefler

Graph Neural Networks (GNNs) have achieved state-of-the-art (SOTA) performance in diverse domains. However, training GNNs on large-scale graphs poses significant challenges due to high memory demands and significant communication overhead…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Arefin Niam , M S Q Zulkar Nine

We study the dynamic connectivity problem for massive, dense graphs. Our goal is to build a system for dense graphs that simultaneously answers connectivity queries quickly, maintains a fast update throughput, and a uses a small amount of…

Data Structures and Algorithms · Computer Science 2025-09-19 Quinten De Man , Qamber Jafri , Daniel Delayo , Evan T. West , Michael A. Bender , David Tench