English
Related papers

Related papers: Generalizable Resource Allocation in Stream Proces…

200 papers

In the most popular distributed stream processing frameworks (DSPFs), programs are modeled as a directed acyclic graph. This model allows a DSPF to benefit from the parallelism power of distributed clusters. However, choosing the proper…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-03 Hamid Nasiri , Saeed Nasehi , Arman Divband , Maziar Goudarzi

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Several distributed frameworks have been developed to scale Graph Neural Networks (GNNs) on billion-size graphs. On several benchmarks, we observe that the graph partitions generated by these frameworks have heterogeneous data distributions…

Machine Learning · Computer Science 2023-11-07 Dhruv Deshmukh , Gagan Raj Gupta , Manisha Chawla , Vishwesh Jatala , Anirban Haldar

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the…

Data Structures and Algorithms · Computer Science 2019-02-19 Dmitrii Avdiukhin , Sergey Pupyrev , Grigory Yaroslavtsev

Graph Neural Networks (GNNs) offer a compact and computationally efficient way to learn embeddings and classifications on graph data. GNN models are frequently large, making distributed minibatch training necessary. The primary contribution…

Machine Learning · Computer Science 2024-04-22 Alok Tripathy , Katherine Yelick , Aydin Buluc

Graph pre-training has achieved remarkable success in recent years, delivering transferable representations for downstream adaptation. However, most existing methods are designed for either homogeneous or heterogeneous graphs, thereby…

Machine Learning · Computer Science 2026-05-28 Chundong Liang , Yongqi Huang , Dongxiao He , Peiyuan Li , Yawen Li , Di Jin , Weixiong Zhang

As with general graph processing systems, partitioning data over a cluster of machines improves the scalability of graph database management systems. However, these systems will incur additional network cost during the execution of a query…

Databases · Computer Science 2017-11-20 Hugo Firth , Paolo Missier , Jack Aiston

Graph processing has become an important part of various areas of computing, including machine learning, medical applications, social network analysis, computational sciences, and others. A growing amount of the associated graph processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-01 Maciej Besta , Marc Fischer , Vasiliki Kalavri , Michael Kapralov , Torsten Hoefler

Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning…

Machine Learning · Computer Science 2024-11-19 Dmytro Lopushanskyy , Borun Shi

Many real-world scenarios involve a team of agents that have to coordinate their policies to achieve a shared goal. Previous studies mainly focus on decentralized control to maximize a common reward and barely consider the coordination…

Multiagent Systems · Computer Science 2022-01-19 Jingqing Ruan , Yali Du , Xuantang Xiong , Dengpeng Xing , Xiyun Li , Linghui Meng , Haifeng Zhang , Jun Wang , Bo Xu

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

Distributed estimation and processing in networks modeled by graphs have received a great deal of interest recently, due to the benefits of decentralised processing in terms of performance and robustness to communications link failure…

Multiagent Systems · Computer Science 2016-11-29 C. T. Healy , R. C. de Lamare

Most research on novel techniques for 3D Medical Image Segmentation (MIS) is currently done using Deep Learning with GPU accelerators. The principal challenge of such technique is that a single input can easily cope computing resources, and…

Machine Learning · Computer Science 2021-11-01 Josep Lluis Berral , Oriol Aranda , Juan Luis Dominguez , Jordi Torres

Partitioning is a known problem in computer science and is critical in chip design workflows, as advancements in this area can significantly influence design quality and efficiency. Deep Learning (DL) techniques, particularly those…

Hardware Architecture · Computer Science 2024-09-04 Muhammad Hadir Khan , Bugra Onal , Eren Dogan , Matthew R. Guthaus

When facing graph signal processing tasks, the workhorse assumption is that the graph describing the support of the signals is known. However, in many relevant applications the available graph suffers from observation errors and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Samuel Rey , Victor M. Tenorio , Antonio G. Marques

Resource-constrained robots often suffer from energy inefficiencies, underutilized computational abilities due to inadequate task allocation, and a lack of robustness in dynamic environments, all of which strongly affect their performance.…

Robotics · Computer Science 2023-10-02 Dipam Patel , Phu Pham , Kshitij Tiwari , Aniket Bera

(Hyper)Graph decomposition is a family of problems that aim to break down large (hyper)graphs into smaller sub(hyper)graphs for easier analysis. The importance of this lies in its ability to enable efficient computation on large and complex…

Data Structures and Algorithms · Computer Science 2023-08-31 Marcelo Fonseca Faraj

Most algorithms for decentralized learning employ a consensus or diffusion mechanism to drive agents to a common solution of a global optimization problem. Generally this takes the form of linear averaging, at a rate of contraction…

Optimization and Control · Mathematics 2024-06-07 Aaron Fainman , Stefan Vlaski

We study embedding table placement for distributed recommender systems, which aims to partition and place the tables on multiple hardware devices (e.g., GPUs) to balance the computation and communication costs. Although prior work has…

Machine Learning · Computer Science 2022-10-06 Daochen Zha , Louis Feng , Qiaoyu Tan , Zirui Liu , Kwei-Herng Lai , Bhargav Bhushanam , Yuandong Tian , Arun Kejariwal , Xia Hu

Modern large language model-based reasoning systems frequently recompute similar reasoning steps across tasks, wasting computational resources, inflating inference latency, and limiting reproducibility. These inefficiencies underscore the…

Artificial Intelligence · Computer Science 2025-11-21 Yash Raj Singh