English
Related papers

Related papers: Hyperscaling Internet Graph Analysis with D4M on t…

200 papers

With the ever-increasing computational demand of DNN training workloads, distributed training has been widely adopted. A combination of data, model and pipeline parallelism strategy, called hybrid parallelism distributed training, is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-16 Guandong Lu , Runzhe Chen , Yakai Wang , Yangjie Zhou , Rui Zhang , Zheng Hu , Yanming Miao , Zhifang Cai , Li Li , Jingwen Leng , Minyi Guo

The increasing scale and wealth of inter-connected data, such as those accrued by social network applications, demand the design of new techniques and platforms to efficiently derive actionable knowledge from large-scale graphs. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-12-08 Abdullah Gharaibeh , Tahsin Reza , Elizeu Santos-Neto , Lauro Beltrao Costa , Scott Sallinen , Matei Ripeanu

Fast, incremental evolution of physics instrumentation raises the question of efficient software abstraction and transferability of algorithms across similar technologies. This contribution aims to provide an answer by introducing Track…

Instrumentation and Detectors · Physics 2024-01-08 Petr Mánek , Petr Burian , Eric David-Bosne , Petr Smolyanskiy , Benedikt Bergmann

There is a growing need for distributed graph processing systems that are capable of gracefully scaling to very large graph datasets. Unfortunately, this challenge has not been easily met due to the intense memory pressure imposed by…

Databases · Computer Science 2014-07-03 Yingyi Bu , Vinayak Borkar , Jianfeng Jia , Michael J. Carey , Tyson Condie

Large-scale distributed graph-parallel computing is challenging. On one hand, due to the irregular computation pattern and lack of locality, it is hard to express parallelism efficiently. On the other hand, due to the scale-free nature,…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-22 Jie Yan , Guangming Tan , Ninghui Sun

Phasor Measurement Units (PMUs) generate high-frequency, time-synchronized data essential for real-time power grid monitoring, yet the growing scale of PMU deployments creates significant challenges in latency, scalability, and reliability.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Nachiappan Chockalingam , Akshay Deshpande , Lokesh Butra , Ram Sekhar Bodala , Nitin Saksena , Adithya Parthasarathy , Balakrishna Pothineni , Akash Kumar Agarwal

Network traffic analysis increasingly uses complex machine learning models as the internet consolidates and traffic gets more encrypted. However, over high-bandwidth networks, flows can easily arrive faster than model inference rates. The…

Networking and Internet Architecture · Computer Science 2024-10-25 Shinan Liu , Ted Shaowang , Gerry Wan , Jeewon Chae , Jonatas Marques , Sanjay Krishnan , Nick Feamster

Live traffic analysis at the first aggregation point in the ISP network enables the implementation of complex traffic engineering policies but is limited by the scarce processing capabilities, especially for Deep Learning (DL) based…

Networking and Internet Architecture · Computer Science 2021-05-26 Massimo Gallo , Alessandro Finamore , Gwendal Simon , Dario Rossi

Many interesting datasets ubiquitous in machine learning and deep learning can be described via graphs. As the scale and complexity of graph-structured datasets increase, such as in expansive social networks, protein folding, chemical…

Machine Learning · Computer Science 2021-04-06 Matthew T. Dearing , Xiaoyan Wang

The last decades have seen a surge of interests in distributed computing thanks to advances in clustered computing and big data technology. Existing distributed algorithms typically assume {\it all the data are already in one place}, and…

Machine Learning · Computer Science 2019-05-07 Donghui Yan , Yingjie Wang , Jin Wang , Guodong Wu , Honggang Wang

The emergence of cloud computing has made dynamic provisioning of elastic capacity to applications on-demand. Cloud data centers contain thousands of physical servers hosting orders of magnitude more virtual machines that can be allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Kotagiri Ramamohanarao , Chris Leckie , Rodrigo N. Calheiros , Amir Vahid Dastjerdi , Steve Versteeg

Context: The combination of distributed stream processing with microservice architectures is an emerging pattern for building data-intensive software systems. In such systems, stream processing frameworks such as Apache Flink, Apache Kafka…

Software Engineering · Computer Science 2023-11-02 Sören Henning , Wilhelm Hasselbring

We introduce a new concept of a subgraph class called a superbubble for analyzing assembly graphs, and propose an efficient algorithm for detecting it. Most assembly algorithms utilize assembly graphs like the de Bruijn graph or the overlap…

Data Structures and Algorithms · Computer Science 2013-08-02 Taku Onodera , Kunihiko Sadakane , Tetsuo Shibuya

Distributed Denial-of-Service (DDoS) attacks represent a persistent threat to modern telecommunications networks: detecting and counteracting them is still a crucial unresolved challenge for network operators. DDoS attack detection is…

Networking and Internet Architecture · Computer Science 2021-11-05 Damu Ding , Marco Savi , Domenico Siracusa

Large Language Model (LLM) adapters enable low-cost model specialization, but introduce complex caching and scheduling challenges in distributed serving systems where hundreds of adapters must be hosted concurrently. While prior work has…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Ferran Agullo , Joan Oliveras , Chen Wang , Alberto Gutierrez-Torre , Olivier Tardieu , Alaa Youssef , Jordi Torres , Josep Ll. Berral

Real-world graphs, such as social networks, financial transactions, and recommendation systems, often demonstrate dynamic behavior. This phenomenon, known as graph stream, involves the dynamic changes of nodes and the emergence and…

Machine Learning · Computer Science 2023-05-16 Yanping Zheng , Zhewei Wei , Jiajun Liu

Comprehensive evaluation is one of the basis of experimental science. In High-Performance Graph Processing, a thorough evaluation of contributions becomes more achievable by supporting common input formats over different frameworks.…

Hardware Architecture · Computer Science 2025-10-29 Mohsen Koohi Esfahani , Marco D'Antonio , Syed Ibtisam Tauhidi , Thai Son Mai , Hans Vandierendonck

In-memory database query processing frequently involves substantial data transfers between the CPU and memory, leading to inefficiencies due to Von Neumann bottleneck. Processing-in-Memory (PIM) architectures offer a viable solution to…

Processing large-scale graph datasets is computationally intensive and time-consuming. Processor-centric CPU and GPU architectures, commonly used for graph applications, often face bottlenecks caused by extensive data movement between the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-11 Marzieh Barkhordar , Alireza Tabatabaeian , Mohammad Sadrosadati , Christina Giannoula , Juan Gomez Luna , Izzat El Hajj , Onur Mutlu , Alaa R. Alameldeen

Curating, processing, and combining large-scale medical imaging datasets from national studies is a non-trivial task due to the intense computation and data throughput required, variability of acquired data, and associated financial…