English
Related papers

Related papers: Characterizing the Performance of Emerging Deep Le…

200 papers

Application-specific quantum computers offer the most efficient means to tackle problems intractable by classical computers. Realizing these architectures necessitates a deep understanding of quantum circuit properties and their…

As applications grow in capability, they also grow in complexity. This complexity in turn gets pushed into modules and libraries. In addition, hardware configurations become increasingly elaborate, too. These two trends make understanding,…

Software Engineering · Computer Science 2018-03-21 Ronny Brendel , Bert Wesarg , Ronny Tschüter , Matthias Weber , Thomas Ilsche , Sebastian Oeste

Future MPSoCs with 1000 or more processor cores on a chip require new means for resource-aware programming in order to deal with increasing imperfections such as process variation, fault rates, aging effects, and power as well as thermal…

Operating Systems · Computer Science 2013-04-23 Jürgen Teich , Wolfgang Schröder-Preikschat , Andreas Herkersdorf

In the past years, deep learning models have been successfully applied in several cognitive tasks. Originally inspired by neuroscience, these models are specific examples of differentiable programs. In this paper we define and motivate…

Machine Learning · Computer Science 2022-05-17 Adrián Hernández , Gilles Millerioux , José M. Amigó

Infrastructure as a Service (IaaS) clouds have become the predominant underlying infrastructure for the operation of modern and smart technology. IaaS clouds have proven to be useful for multiple reasons such as reduced costs, increased…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-13 Nivedhitha Duggi , Masoud Rafiei , Mohsen Amini Salehi

Can cloud computing infrastructures provide HPC-competitive performance for scientific applications broadly? Despite prolific related literature, this question remains open. Answers are crucial for designing future systems and democratizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-09 Giulia Guidi , Marquita Ellis , Aydin Buluc , Katherine Yelick , David Culler

In this work, we present a new benchmarking suite with new real-life inspired skewed workloads to test the performance of concurrent index data structures. We started this project to prepare workloads specifically for self-adjusting data…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-19 Vitaly Aksenov , Dmitry Ivanov , Ravil Galiev

We investigate and characterize the performance of an important class of operations on GPUs and Many Integrated Core (MIC) architectures. Our work is motivated by applications that analyze low-dimensional spatial datasets captured by high…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-05 George Teodoro , Tahsin Kurc , Jun Kong , Lee Cooper , Joel Saltz

This work provides the first study to explore the interaction of update propagation with and without fine-grained synchronization (push vs. pull), emerging coherence protocols (GPU vs. DeNovo coherence), and software-centric consistency…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-26 Giordano Salvador , Wesley H. Darvin , Muhammad Huzaifa , Johnathan Alsop , Matthew D. Sinclair , Sarita V. Adve

While modern parallel computing systems offer high performance, utilizing these powerful computing resources to the highest possible extent demands advanced knowledge of various hardware architectures and parallel programming models.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Suejb Memeti , Sabri Pllana , Alecio Binotto , Joanna Kolodziej , Ivona Brandic

A benchmark of 25 nonlinear optimization problems with domain-induced discontinuity is proposed to support the performance evaluation of global optimization algorithms under feasibility-scarce and structurally discontinuous landscapes.…

Optimization and Control · Mathematics 2026-04-23 Peicong Cheng , Makoto Yamashita

This report focuses on the architecture and performance of the Intelligence Processing Unit (IPU), a novel, massively parallel platform recently introduced by Graphcore and aimed at Artificial Intelligence/Machine Learning (AI/ML)…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-10 Zhe Jia , Blake Tillman , Marco Maggioni , Daniele Paolo Scarpazza

Graphs may be used to represent many different problem domains -- a concrete example is that of detecting communities in social networks, which are represented as graphs. With big data and more sophisticated applications becoming widespread…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-03 Miguel E. Coimbra , Alexandre P. Francisco , Luis Veiga

Big data powered Deep Learning (DL) and its applications have blossomed in recent years, fueled by three technological trends: a large amount of digitized data openly accessible, a growing number of DL software frameworks in open source and…

Performance · Computer Science 2019-08-20 Yanzhao Wu , Ling Liu , Calton Pu , Wenqi Cao , Semih Sahin , Wenqi Wei , Qi Zhang

Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains. Neural architecture searches, hyperparameter sweeps, and rapid prototyping consume immense resources that can prevent…

We define some of the programming and system-level challenges facing the application of quantum processing to high-performance computing. Alongside barriers to physical integration, prominent differences in the execution of quantum and…

Quantum Physics · Physics 2017-12-06 Keith A. Britt , Fahd A. Mohiyaddin , Travis S. Humble

Model merging has shown that multitask models can be created by directly combining the parameters of different models that are each specialized on tasks of interest. However, models trained independently on distinct tasks often exhibit…

Machine Learning · Computer Science 2026-03-17 Pratik Ramesh , George Stoica , Arun Iyer , Leshem Choshen , Judy Hoffman

The HPEC Graph Challenge is a collection of benchmarks representing complex workloads that test the hardware and software components of HPC systems, which traditional benchmarks, such as LINPACK, do not. The first benchmark, Subgraph…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-05 Siddharth Samsi , Dan Campbell , Emanuel Scoullos , Oded Green

Making threaded programs safe and easy to reason about is one of the chief difficulties in modern programming. This work provides an efficient execution model for SCOOP, a concurrency approach that provides not only data race freedom but…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-28 Scott West , Sebastian Nanz , Bertrand Meyer

Machine learning on graphs has made substantial progress across domains such as molecular property prediction and chip design. Yet benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent…