English
Related papers

Related papers: A Case for Fine-grain Coherence Specialization in …

200 papers

Edge intelligence has emerged as a promising strategy to deliver low-latency and ubiquitous services for mobile devices. Recent advances in fine-tuning mechanisms of foundation models have enabled edge intelligence by integrating low-rank…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Jingyi Wang , Zhongyuan Zhao , Qingtian Wang , Zexu Li , Yue Wang , Tony Q. S. Quek

As supercomputers' complexity has grown, the traditional boundaries between processor, memory, network, and accelerators have blurred, making a homogeneous computer model, in which the overall computer system is modeled as a continuous…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-10 Martin Karp , Niclas Jansson , Philipp Schlatter , Stefano Markidis

In autonomous driving, accurately interpreting the movements of other road users and leveraging this knowledge to forecast future trajectories is crucial. This is typically achieved through the integration of map data and tracked…

Robotics · Computer Science 2024-05-17 Tobias Demmler , Andreas Tamke , Thao Dang , Karsten Haug , Lars Mikelsons

The growing demand for computational resources in machine learning has made efficient resource allocation a critical challenge, especially in heterogeneous hardware clusters where devices vary in capability, age, and energy efficiency.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Ahmad Raeisi , Mahdi Dolati , Sina Darabi , Sadegh Talebi , Patrick Eugster , Ahmad Khonsari

Performance optimization is the art of continuous seeking a harmonious mapping between the application domain and hardware. Recent years have witnessed a surge of deep learning (DL) applications in industry. Conventional wisdom for…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-27 Guoping Long , Jun Yang , Wei Lin

Deploying deep neural networks on mobile devices is increasingly important but remains challenging due to limited computing resources. On the other hand, their unified memory architecture and narrower gap between CPU and GPU performance…

Machine Learning · Computer Science 2026-02-20 Zhuojin Li , Marco Paolieri , Leana Golubchik

The increasing parallelism of many-core systems demands for efficient strategies for the run-time system management. Due to the large number of cores the management overhead has a rising impact to the overall system performance. This work…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-11 Daniel Gregorek , Robert Schmidt , Alberto Garcia-Ortiz

In the past decade, high performance compute capabilities exhibited by heterogeneous GPGPU platforms have led to the popularity of data parallel programming languages such as CUDA and OpenCL. Such languages, however, involve a steep…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-17 Anirban Ghose , Siddharth Singh , Vivek Kulaharia , Lokesh Dokara , Srijeeta Maity , Soumyajit Dey

High-performance computing systems are more and more often based on accelerators. Computing applications targeting those systems often follow a host-driven approach in which hosts offload almost all compute-intensive sections of the code…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-15 E. Calore , A. Gabbana , S. F. Schifano , R. Tripiccione

In large-scale distributed computing clusters, such as Amazon EC2, there are several types of "system noise" that can result in major degradation of performance: bottlenecks due to limited communication bandwidth, latency due to straggler…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-21 Amirhossein Reisizadeh , Saurav Prakash , Ramtin Pedarsani , Amir Salman Avestimehr

This paper studies physical-layer security for a cache-enabled heterogeneous cellular network comprised of a macro base station and multiple small base stations (SBSs). We investigate a joint design on caching placement and file delivery…

Information Theory · Computer Science 2018-09-25 Tong-Xing Zheng , Hui-Ming Wang , Jinhong Yuan

The emergence of new, off-path smart network cards (SmartNICs), known generally as Data Processing Units (DPU), has opened a wide range of research opportunities. Of particular interest is the use of these and related devices in tandem with…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-04 Nathan Tibbetts , Sifat Ibtisum , Satish Puri

We propose a fine-grained hypergraph model for sparse matrix-matrix multiplication (SpGEMM), a key computational kernel in scientific computing and data analysis whose performance is often communication bound. This model correctly describes…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-18 Grey Ballard , Alex Druinsky , Nicholas Knight , Oded Schwartz

For several decades, the CPU has been the standard model to use in the majority of computing. While the CPU does excel in some areas, heterogeneous computing, such as reconfigurable hardware, is showing increasing potential in areas like…

Hardware Architecture · Computer Science 2021-04-21 Carl-Johannes Johnsen , Alberte Thegler , Kenneth Skovhede , Brian Vinter

Federated learning is an emerging research paradigm enabling collaborative training of machine learning models among different organizations while keeping data private at each institution. Despite recent progress, there remain fundamental…

Machine Learning · Computer Science 2022-04-15 Liangqiong Qu , Yuyin Zhou , Paul Pu Liang , Yingda Xia , Feifei Wang , Ehsan Adeli , Li Fei-Fei , Daniel Rubin

This report investigates enhancing semantic caching effectiveness by employing specialized, fine-tuned embedding models. Semantic caching relies on embedding similarity rather than exact key matching, presenting unique challenges in…

Adhesion is a fundamental phenomenon that plays a role in many engineering and biological applications. This paper concerns the use of machine learning to characterize the effective adhesive properties when a thin film is peeled from a…

Applied Physics · Physics 2023-09-04 Maximo Cravero Baraja , Kaushik Bhattacharya

Data movement is the dominating factor affecting performance and energy in modern computing systems. Consequently, many algorithms have been developed to minimize the number of I/O operations for common computing patterns. Matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Johannes de Fine Licht , Grzegorz Kwasniewski , Torsten Hoefler

The cost of data movement on parallel systems varies greatly with machine architecture, job partition, and nearby jobs. Performance models that accurately capture the cost of data movement provide a tool for analysis, allowing for…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-20 Amanda Bienz , Luke N. Olson , William D. Gropp , Shelby Lockhart

We study the optimal design of heterogeneous Coded Elastic Computing (CEC) where machines have varying computation speeds and storage. CEC introduced by Yang et al. in 2018 is a framework that mitigates the impact of elastic events, where…

Information Theory · Computer Science 2020-08-13 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji