English
Related papers

Related papers: SGDRC: Software-Defined Dynamic Resource Control f…

200 papers

The demand for edge artificial intelligence to process event-based, complex data calls for hardware beyond conventional digital, von-Neumann architectures. Neuromorphic computing, using spiking neural networks (SNNs) with emerging…

Applied Physics · Physics 2025-09-08 Zhu Wang , Song Wang , Zhiyuan Du , Ruibin Mao , Yu Xiao , Hayden Kwok-Hay So , Peng Lin , Can Li

Deep neural networks (DNNs) have grown exponentially in size over the past decade, leaving only those who have massive datacenter-based resources with the ability to develop and train such models. One of the main challenges for the long…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-02 Youjie Li , Amar Phanishayee , Derek Murray , Jakub Tarnawski , Nam Sung Kim

Deep Neural Networks (DNNs) have achieved im- pressive accuracy in many application domains including im- age classification. Training of DNNs is an extremely compute- intensive process and is solved using variants of the stochastic…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-03 Sameer Kumar , Dheeraj Sreedhar , Vaibhav Saxena , Yogish Sabharwal , Ashish Verma

Brain-inspired Spiking Neural Networks (SNNs) have attracted attention for their event-driven characteristics and high energy efficiency. However, the temporal dependency and irregularity of spikes present significant challenges for…

Hardware Architecture · Computer Science 2025-06-11 Kainan Wang , Chengyi Yang , Chengting Yu , Yee Sin Ang , Bo Wang , Aili Wang

Deep neural networks (DNNs) have substantial computational requirements, which greatly limit their performance in resource-constrained environments. Recently, there are increasing efforts on optical neural networks and optical computing…

Machine Learning · Computer Science 2021-04-05 Yingjie Li , Ruiyang Chen , Berardi Sensale Rodriguez , Weilu Gao , Cunxi Yu

We propose overcoming the memory capacity limitation of GPUs with high-capacity Storage-Class Memory (SCM) and DRAM cache. By significantly increasing the memory capacity with SCM, the GPU can capture a larger fraction of the memory…

Hardware Architecture · Computer Science 2024-03-15 Jeongmin Hong , Sungjun Cho , Geonwoo Park , Wonhyuk Yang , Young-Ho Gong , Gwangsun Kim

Services with distributed and interdependent components are becoming a popular option for harnessing dispersed resources available on cloud and edge networks. However, effective deployment and management of these services, namely service…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-07 Farzad Mohammadi , Vahid Shah-Mansouri

With Dynamic Resource Management (DRM) the resources assigned to a job can be changed dynamically during its execution. From the system's perspective, DRM opens a new level of flexibility in resource allocation and job scheduling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-27 Dominik Huber , Martin Schreiber , Martin Schulz , Howard Pritchard , Daniel Holmes

Partitioned DNN inference is a promising approach for latency-sensitive intelligent services in edge networks, since it allows different parts of a model to be executed across end devices, edge servers, and the cloud. However, in a…

Networking and Internet Architecture · Computer Science 2026-04-29 Jinkun Zhang , Poonam Yadav

Deep Neural Networks (DNNs) have revolutionized numerous applications, but the demand for ever more performance remains unabated. Scaling DNN computations to larger clusters is generally done by distributing tasks in batch mode using…

Machine Learning · Computer Science 2020-06-23 Tong Geng , Tianqi Wang , Ang Li , Xi Jin , Martin Herbordt

As deep learning continues to advance and is applied to increasingly complex scenarios, the demand for concurrent deployment of multiple neural network models has arisen. This demand, commonly referred to as multi-tenant computing, is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Yongbo Yu , Fuxun Yu , Mingjia Zhang , Di Wang , Tolga Soyata , Chenchen Liu , Xiang Chen

The rise of LLMs has driven demand for private serverless deployments, characterized by moderate-sized models and infrequent requests. While existing serverless solutions follow exclusive GPU allocation, we take a step back to explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Chuhao Xu , Zijun Li , Quan Chen , Han Zhao , Xueyan Tang , Minyi Guo

Deep neural network (DNN) inference has become an important part of many data-center workloads. This has prompted focused efforts to design ever-faster deep learning accelerators such as GPUs and TPUs. However, an end-to-end DNN-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Ahmed F. AbouElhamayed , Susanne Balle , Deshanand Singh , Mohamed S. Abdelfattah

Convolutional Neural Networks (CNN) have been widely deployed in diverse application domains. There has been significant progress in accelerating both their training and inference using high-performance GPUs, FPGAs, and custom ASICs for…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-07 Guanwen Zhong , Akshat Dubey , Tan Cheng , Tulika Mitra

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation, and the vision of the Internet of Things fuel the interest in resource-efficient approaches. These approaches aim for a carefully…

Graph Neural Networks (GNNs) show strong promise for circuit analysis, but scaling to modern large-scale circuit graphs is limited by GPU memory and training cost, especially for deep models. We revisit deep GNNs for circuit graphs and show…

Machine Learning · Computer Science 2026-03-31 Yuebo Luo , Shiyang Li , Yifei Feng , Vishal Kancharla , Shaoyi Huang , Caiwen Ding

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

To keep pace with the rapid advancements in design complexity within modern computing systems, directed graph representation learning (DGRL) has become crucial, particularly for encoding circuit netlists, computational graphs, and…

Machine Learning · Computer Science 2024-10-10 Haoyu Wang , Yinan Huang , Nan Wu , Pan Li

To effectively control large-scale distributed systems online, model predictive control (MPC) has to swiftly solve the underlying high-dimensional optimization. There are multiple techniques applied to accelerate the solving process in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-30 Carmen Amo Alonso , Shih-Hao Tseng

With machine learning applications now spanning a variety of computational tasks, multi-user shared computing facilities are devoting a rapidly increasing proportion of their resources to such algorithms. Graph neural networks (GNNs), for…

High Energy Physics - Experiment · Physics 2023-12-13 Claire Savard , Nicholas Manganelli , Burt Holzman , Lindsey Gray , Alexx Perloff , Kevin Pedro , Kevin Stenson , Keith Ulmer