English
Related papers

Related papers: Scalable and Efficient Intra- and Inter-node Inter…

200 papers

The rapid growth of the size and complexity in deep neural networks has sharply increased computational demands, challenging their efficient deployment in real-world scenarios. Boolean networks, constructed with logic gates, offer a…

Machine Learning · Computer Science 2024-09-12 Youngsung Kim

As the size of artificial intelligence and machine learning (AI/ML) models and datasets grows, the memory bandwidth becomes a critical bottleneck. The paper presents a novel extended memory hierarchy that addresses some major memory…

Hardware Architecture · Computer Science 2025-05-20 Jordi Altayo , Paul Delestrac , David Novo , Simey Yang , Debjyoti Bhattacharjee , Francky Catthoor

Extreme-edge scientific applications use machine learning models to analyze sensor data and make real-time decisions. Their stringent latency and throughput requirements demand small batch sizes and require that model weights remain fully…

Hardware Architecture · Computer Science 2026-04-22 Zhenghua Ma , G Abarajithan , Dimitrios Danopoulos , Olivia Weng , Francesco Restuccia , Ryan Kastner

Emerging Big Data analytics and machine learning applications require a significant amount of computational power. While there exists a plethora of large-scale data processing frameworks which thrive in handling the various complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-26 Jan S. Rellermeyer , Sobhan Omranian Khorasani , Dan Graur , Apourva Parthasarathy

A new approach to designing processor accelerators is presented. A new computing model and a special kind of accelerator with dynamic (end-user programmable) architecture is suggested. The new model considers a processor, in which a newly…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-07 János Végh

Current trends in Data Center Interconnectivity are considered in the light of increasing traffic and under the constraint of limited cost and power consumption.

Networking and Internet Architecture · Computer Science 2019-08-29 Michael Eiselt , Annika Dochhan , Joerg-Peter Elbers

Computational science is changing to be data intensive. Super-Computers must be balanced systems; not just CPU farms but also petascale IO and networking arrays. Anyone building CyberInfrastructure should allocate resources to support a…

Databases · Computer Science 2007-05-23 Gordon Bell , Jim Gray , Alex Szalay

Nowadays most of the cloud applications process large amount of data to provide the desired results. Data volumes to be processed by cloud applications are growing much faster than computing power. This growth demands new strategies for…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-05 B. Thirumala Rao , N. V. Sridevi , V. Krishna Reddy , L. S. S. Reddy

In the current era of Big Data, data engineering has transformed into an essential field of study across many branches of science. Advancements in Artificial Intelligence (AI) have broadened the scope of data engineering and opened up new…

Along with the rapid developments in communication technologies and the surge in the use of mobile devices, a brand-new computation paradigm, Edge Computing, is surging in popularity. Meanwhile, Artificial Intelligence (AI) applications are…

Networking and Internet Architecture · Computer Science 2020-05-20 Shuiguang Deng , Hailiang Zhao , Weijia Fang , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

As supercomputers' complexity has grown, the traditional boundaries between processor, memory, network, and accelerators have blurred, making a homogeneous computer model, in which the overall computer system is modeled as a continuous…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-10 Martin Karp , Niclas Jansson , Philipp Schlatter , Stefano Markidis

Heterogeneity is becoming increasingly ubiquitous in modern large-scale computer systems. Developing good load balancing policies for systems whose resources have varying speeds is crucial in achieving low response times. Indeed, how best…

Performance · Computer Science 2020-06-26 Kristen Gardner , Jazeem Abdul Jaleel , Alexander Wickeham , Sherwin Doroudi

We examine the computational energy requirements of different systems driven by the geometrical scaling law, and increasing use of Artificial Intelligence or Machine Learning (AI-ML) over the last decade. With more scientific and technology…

Hardware Architecture · Computer Science 2022-11-30 Sadasivan Shankar , Albert Reuther

The increasing prominence of AI necessitates the deployment of inference platforms for efficient and effective management of AI pipelines and compute resources. As these pipelines grow in complexity, the demand for distributed serving rises…

Networking and Internet Architecture · Computer Science 2025-02-25 Mike Wong , Ulysses Butler , Emma Farkash , Praveen Tammana , Anirudh Sivaraman , Ravi Netravali

The rapidly increasing demands for computational throughput, bandwidth, and memory capacity fueled by breakthroughs in machine learning pose substantial challenges for conventional electronic computing platforms. For digital scaling to keep…

The interconnect is one of the most critical components in large scale computing systems, and its impact on the performance of applications is going to increase with the system size. In this paper, we will describe Slingshot, an…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-28 Daniele De Sensi , Salvatore Di Girolamo , Kim H. McMahon , Duncan Roweth , Torsten Hoefler

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu

The never-ending demand for high performance and energy efficiency is pushing designers towards an increasing level of heterogeneity and specialization in modern computing systems. In such systems, creating efficient memory architectures is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Stephanie Soldavini , Christian Pilato

Programmability, performance portability, and resource efficiency have emerged as critical challenges in harnessing complex and diverse architectures today to obtain high performance and energy efficiency. While there is abundant research,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-14 Nandita Vijaykumar

While advanced analysis of large dataset is in high demand, data sizes have surpassed capabilities of conventional software and hardware. Hadoop framework distributes large datasets over multiple commodity servers and performs parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-17 Woo-Hyun Lee , Hee-Gook Jun , Hyoung-Joo Kim