English
Related papers

Related papers: Heterogeneous MacroTasking (HeMT) for Parallel Pro…

200 papers

This paper addresses the problem of parallelizing computations to study non-linear dynamics in large networks of non-locally coupled oscillators using heterogeneous computing resources. The proposed approach can be applied to a variety of…

Chaotic Dynamics · Physics 2025-07-04 Oleksandr Sudakov , Volodymyr Maistrenko

Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Guy Goren , Shay Vargaftik , Yoram Moses

Load balancing, operator instance collocations and horizontal scaling are critical issues in Parallel Stream Processing Engines to achieve low data processing latency, optimized cluster utilization and minimized communication cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-12 Kasper Grud Skat Madsen , Yongluan Zhou , Jianneng Cao

In this paper, we~present a novel scheduling solution for a class of System-on-Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their…

Artificial Intelligence · Computer Science 2020-06-08 Tegg Taekyong Sung , Jeongsoo Ha , Jeewoo Kim , Alex Yahja , Chae-Bong Sohn , Bo Ryu

This paper presents a systematic review of mapping and scheduling strategies within the High-Performance Computing (HPC) compute continuum, with a particular emphasis on heterogeneous systems. It introduces a prototype workflow to establish…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Aasish Kumar Sharma , Julian Kunkel

The arrival of heterogeneous (or hybrid) multicore architectures has brought new performance trade-offs for applications, and efficiency opportunities to systems. They have also increased the challenges related to thread scheduling, as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-11 Yacine Idouar , Adrien Cassagne , Laércio Lima Pilla , Julien Sopena , Manuel Bouyer , Diane Orhan , Lionel Lacassagne , Dimitri Galayko , Denis Barthou , Christophe Jego

Multi-human multi-robot (MH-MR) systems have the ability to combine the potential advantages of robotic systems with those of having humans in the loop. Robotic systems contribute precision performance and long operation on repetitive tasks…

Multiagent Systems · Computer Science 2023-03-03 Tamzidul Mina , Shyam Sundar Kannan , Wonse Jo , Byung-Cheol Min

MPI applications matter. However, with the advent of many-core processors, traditional MPI applications are challenged to achieve satisfactory performance. This is due to the inability of these applications to respond to load imbalances, to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-20 Jan Ciesko , Pedro J. Martínez-Ferrer , Raúl Peñacoba Veigas , Xavier Teruel , Vicenç Beltran

An effective auto-scaling framework is essential for microservices to ensure performance stability and resource efficiency under dynamic workloads. As revealed by many prior studies, the key to efficient auto-scaling lies in accurately…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-25 Qin Hua , Dingyu Yang , Shiyou Qian , Jian Cao , Guangtao Xue , Minglu Li

Distributed data processing systems like MapReduce, Spark, and Flink are popular tools for analysis of large datasets with cluster resources. Yet, users often overprovision resources for their data processing jobs, while the resource usage…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-16 Lauritz Thamsen , Ilya Verbitskiy , Sasho Nedelkoski , Vinh Thuy Tran , Vinicius Meyer , Miguel G. Xavier , Odej Kao , Cesar A. F. De Rose

As one of the Coordinated Multipoint (CoMP) techniques, Joint Transmission (JT) can improve the overall system performance. In this paper, from the load balancing perspective, we study how the maximum load can be reduced by optimizing JT…

Information Theory · Computer Science 2017-06-23 Lei You , Lei Lei , Di Yuan

A parallel computer system is a collection of processing elements that communicate and cooperate to solve large computational problems efficiently. To achieve this, at first the large computational problem is partitioned into several tasks…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-09 Ardhendu Mandal , Subhas Chandra Pal

Asynchronous Many-Task (AMT) runtimes offer a productive alternative to the Message Passing Interface (MPI). However, the diverse AMT landscape makes fair comparisons challenging. Task Bench, proposed by Slaughter et al., addresses this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-16 Torben R. Lahnor , Mia Reitz , Jonas Posner , Patrick Diehl

In recent times, the emergence of Large Language Models (LLMs) has resulted in increasingly larger model size, posing challenges for inference on low-resource devices. Prior approaches have explored offloading to facilitate low-memory…

Performance · Computer Science 2024-03-05 Xuanlei Zhao , Bin Jia , Haotian Zhou , Ziming Liu , Shenggan Cheng , Yang You

Traffic load-balancing in datacenters alleviates hot spots and improves network utilization. In this paper, a stable in-network load-balancing algorithm is developed in the setting of software-defined networking. A control plane configures…

Networking and Internet Architecture · Computer Science 2016-12-07 Sucha Supittayapornpong , Michael J. Neely

Data load balancing is a challenging task in the P2P systems. Distributed hash table (DHT) abstraction, heterogeneous nodes, and non uniform distribution of objects are the reasons to cause load imbalance in structured P2P overlay networks.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-16 Seyed Iman Mirrezaei , Javad Shahparian

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

Machine Learning · Computer Science 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

Supercomputers have revolutionized how industries and scientific fields process large amounts of data. These machines group hundreds or thousands of computing nodes working together to execute time-consuming programs that require a large…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-24 João B. Fernandes , Ítalo A. S. de Assis , Idalmis M. S. Martins , Tiago Barros , Samuel Xavier-de-Souza

Heterogeneous multi core processors can offer diverse computing capabilities. The efficiency of Market Basket Analysis Algorithm can be improved with heterogeneous multi core processors. Market basket analysis algorithm utilises apriori…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-24 Aashiha Priyadarshni. L

Many important computational problems require utilization of high performance computing (HPC) systems that consist of multi-level structures combining higher and higher numbers of devices with various characteristics. Utilizing full power…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-21 Paweł Rościszewski