English
Related papers

Related papers: Hardware architecture and routing-aware training f…

200 papers

Training Convolutional Neural Networks (CNN) is a resource intensive task that requires specialized hardware for efficient computation. One of the most limiting bottleneck of CNN training is the memory cost associated with storing the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Tristan Hascoet , Quentin Febvre , Yasuo Ariki , Tetsuya Takiguchi

Memory is a critical design consideration in current data-intensive DNN accelerators, as it profoundly determines energy consumption, bandwidth requirements, and area costs. As DNN structures become more complex, a larger on-chip memory…

Hardware Architecture · Computer Science 2024-02-02 Zhanhong Tan , Zijian Zhu , Kaisheng Ma

Machine learning algorithms have made significant advances in many applications. However, their hardware implementation on the state-of-the-art platforms still faces several challenges and are limited by various factors, such as memory…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Xiaocong Du , Gokul Krishnan , Abinash Mohanty , Zheng Li , Gouranga Charan , Yu Cao

Global routing has been a historically challenging problem in electronic circuit design, where the challenge is to connect a large and arbitrary number of circuit components with wires without violating the design rules for the printed…

Machine Learning · Computer Science 2019-06-24 Haiguang Liao , Wentai Zhang , Xuliang Dong , Barnabas Poczos , Kenji Shimada , Levent Burak Kara

In the world of deep learning, Transformer models have become very significant, leading to improvements in many areas from understanding language to recognizing images, covering a wide range of applications. Despite their success, the…

Machine Learning · Computer Science 2024-07-19 Ghadeer Jaradat , Mohammed Tolba , Ghada Alsuhli , Hani Saleh , Mahmoud Al-Qutayri , Thanos Stouraitis , Baker Mohammad

Resource allocation has a direct and profound impact on the performance of vehicle-to-everything (V2X) networks. Considering the dynamic nature of vehicular environments, it is appealing to devise a decentralized strategy to perform…

Networking and Internet Architecture · Computer Science 2019-08-12 Liang Wang , Hao Ye , Le Liang , Geoffrey Ye Li

The growing demand for computational resources in machine learning has made efficient resource allocation a critical challenge, especially in heterogeneous hardware clusters where devices vary in capability, age, and energy efficiency.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Ahmad Raeisi , Mahdi Dolati , Sina Darabi , Sadegh Talebi , Patrick Eugster , Ahmad Khonsari

Deep Learning system architects strive to design a balanced system where the computational accelerator -- FPGA, GPU, etc, is not starved for data. Feeding training data fast enough to effectively keep the accelerator utilization high is…

Performance · Computer Science 2018-12-04 Christian Pinto , Yiannis Gkoufas , Andrea Reale , Seetharami Seelam , Steven Eliuk

The hardware-software co-optimization of neural network architectures is becoming a major stream of research especially due to the emergence of commercial neuromorphic chips such as the IBM Truenorth and Intel Loihi. Development of specific…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Roshan Gopalakrishnan , Yansong Chua , Ashish Jith Sreejith Kumar

Project and task scheduling under uncertainty remains a fundamental challenge in program and project management, where accurate estimation of task durations and dependencies is critical for delivering complex, multi project systems. The…

Machine Learning · Computer Science 2025-05-09 Azgar Ali Noor Ahamed

Spiking Neural Networks (SNNs) have emerged as a promising approach to improve the energy efficiency of machine learning models, as they naturally implement event-driven computations while avoiding expensive multiplication operations. In…

Neural and Evolutionary Computing · Computer Science 2024-10-31 Anagha Nimbekar , Prabodh Katti , Chen Li , Bashir M. Al-Hashimi , Amit Acharyya , Bipin Rajendran

Spiking Neural Networks (SNNs) offer a promising alternative to Artificial Neural Networks (ANNs) for deep learning applications, particularly in resource-constrained systems. This is largely due to their inherent sparsity, influenced by…

Hardware Architecture · Computer Science 2023-10-27 Ilkin Aliyev. Kama Svoboda , Tosiron Adegbija

Spiking neural networks have shown great promise for the design of low-power sensory-processing and edge-computing hardware platforms. However, implementing on-chip learning algorithms on such architectures is still an open challenge,…

Neural and Evolutionary Computing · Computer Science 2021-04-13 Matteo Cartiglia , Germain Haessig , Giacomo Indiveri

Sparse deep learning has reduced computation significantly, but its irregular non-zero data distribution complicates the data flow and hinders data reuse, increasing on-chip SRAM access and thus power consumption of the chip. This paper…

Hardware Architecture · Computer Science 2025-03-26 Kai-Chieh Hsu , Tian-Sheuan Chang

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

Machine learning applied to architecture design presents a promising opportunity with broad applications. Recent deep reinforcement learning (DRL) techniques, in particular, enable efficient exploration in vast design spaces where…

Hardware Architecture · Computer Science 2019-05-14 Ting-Ru Lin , Drew Penney , Massoud Pedram , Lizhong Chen

In this work we have extended AutoML inspired approaches to the exploration and optimization of neuromorphic architectures. Through the integration of a parallel asynchronous model-based search approach with a simulation framework to…

Neural and Evolutionary Computing · Computer Science 2023-02-28 Angel Yanguas-Gil , Sandeep Madireddy

Distributed AI systems face critical memory management challenges across computation, communication, and deployment layers. RRAM based in memory computing suffers from scalability limitations due to device non idealities and fixed array…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Zixuan Li , Chuanzhen Wang , Haotian Sun

Design space exploration is an important but costly step involved in the design/deployment of custom architectures to squeeze out maximum possible performance and energy efficiency. Conventionally, optimizations require iterative sampling…

Machine Learning · Computer Science 2021-08-20 Ananda Samajdar , Jan Moritz Joseph , Matthew Denton , Tushar Krishna

The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Chenggang Zhao , Chengqi Deng , Chong Ruan , Damai Dai , Huazuo Gao , Jiashi Li , Liyue Zhang , Panpan Huang , Shangyan Zhou , Shirong Ma , Wenfeng Liang , Ying He , Yuqing Wang , Yuxuan Liu , Y. X. Wei