中文
相关论文

相关论文: Improving Efficiency in Neural Network Accelerator…

200 篇论文

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

机器学习 · 计算机科学 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

Neural networks (NNs) are growing in importance and complexity. A neural network's performance (and energy efficiency) can be bound either by computation or memory resources. The processing-in-memory (PIM) paradigm, where computation is…

硬件体系结构 · 计算机科学 2023-03-28 Geraldo F. Oliveira , Juan Gómez-Luna , Saugata Ghose , Amirali Boroumand , Onur Mutlu

Hardware accelerators for neural networks have shown great promise for both performance and power. These accelerators are at their most efficient when optimized for a fixed functionality. But this inflexibility limits the longevity of the…

硬件体系结构 · 计算机科学 2019-10-25 Ayoosh Bansal , Chance Coats , Evan Lissoos , Benjamin Schreiber

Energy is an essential, but often forgotten aspect in large-scale federated systems. As most of the research focuses on tackling computational and statistical heterogeneity from the machine learning algorithms, the impact on the mobile…

分布式、并行与集群计算 · 计算机科学 2022-05-02 Cong Wang , Bin Hu , Hongyi Wu

Edge computing must be capable of executing computationally intensive algorithms, such as Deep Neural Networks (DNNs) while operating within a constrained computational resource budget. Such computations involve Matrix Vector…

硬件体系结构 · 计算机科学 2023-10-24 Arani Roy , Kaushik Roy

Many studies estimate energy consumption using proxy metrics like memory usage, FLOPs, and inference latency, with the assumption that reducing these metrics will also lower energy consumption in neural networks. This paper, however, takes…

机器学习 · 计算机科学 2025-04-14 Hoang-Loc La , Phuong Hoai Ha

While the accuracy of convolutional neural networks has achieved vast improvements by introducing larger and deeper network architectures, also the memory footprint for storing their parameters and activations has increased. This trend…

图像与视频处理 · 电气工程与系统科学 2021-04-07 Petar Jokic , Stephane Emery , Luca Benini

The energy consumed by running large deep neural networks (DNNs) on hardware accelerators is dominated by the need for lots of fast memory to store both states and weights. This large required memory is currently only economically viable…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Tobi Delbruck , Shih-Chii Liu

Deep neural networks (DNNs) have been successfully applied in various fields. A major challenge of deploying DNNs, especially on edge devices, is power consumption, due to the large number of multiply-and-accumulate (MAC) operations. To…

神经与进化计算 · 计算机科学 2023-11-28 Richard Petri , Grace Li Zhang , Yiran Chen , Ulf Schlichtmann , Bing Li

The inherent diversity of computation types within the deep neural network (DNN) models often requires a variety of specialized units in hardware processors, which limits computational efficiency, increasing both inference latency and power…

机器学习 · 计算机科学 2024-08-21 Ruiqi Sun , Siwei Ye , Jie Zhao , Xin He , Jianzhe Lin , Yiran Li , An Zou

Time series analysis is a key technique for extracting and predicting events in domains as diverse as epidemiology, genomics, neuroscience, environmental sciences, economics, and more. Matrix profile, the state-of-the-art algorithm to…

Deep Neural Networks (DNNs) are being heavily utilized in modern applications and are putting energy-constraint devices to the test. To bypass high energy consumption issues, approximate computing has been employed in DNN accelerators to…

机器学习 · 计算机科学 2022-07-26 Ourania Spantidi , Georgios Zervakis , Iraklis Anagnostopoulos , Jörg Henkel

Modern day computing increasingly relies on specialization to satiate growing performance and efficiency requirements. A core challenge in designing such specialized hardware architectures is how to perform mapping space search, i.e.,…

机器学习 · 计算机科学 2021-03-03 Kartik Hegde , Po-An Tsai , Sitao Huang , Vikas Chandra , Angshuman Parashar , Christopher W. Fletcher

During the last years, algorithms known as Convolutional Neural Networks (CNNs) had become increasingly popular, expanding its application range to several areas. In particular, the image processing field has experienced a remarkable…

硬件体系结构 · 计算机科学 2024-08-27 Federico Nicolas Peccia , Luciano Ferreyro , Alejandro Furfaro

Energy harvesting (EH) IoT devices that operate intermittently without batteries, coupled with advances in deep neural networks (DNNs), have opened up new opportunities for enabling sustainable smart applications. Nevertheless, implementing…

机器学习 · 计算机科学 2022-07-07 Sahidul Islam , Jieren Deng , Shanglin Zhou , Chen Pan , Caiwen Ding , Mimi Xie

Transmit antenna muting (TAM) in multiple-user multiple-input multiple-output (MU-MIMO) networks allows reducing the power consumption of the base station (BS) by properly utilizing only a subset of antennas in the BS. In this paper, we…

信号处理 · 电气工程与系统科学 2023-06-09 Nuwanthika Rajapaksha , Jafar Mohammadi , Stefan Wesemann , Thorsten Wild , Nandana Rajatheva

Deep neural networks (DNN) are increasingly being accelerated on application-specific hardware such as the Google TPU designed especially for deep learning. Timing speculation is a promising approach to further increase the energy…

机器学习 · 计算机科学 2018-07-03 Jeff Zhang , Siddharth Garg

The cost of moving data between the memory units and the compute units is a major contributor to the execution time and energy consumption of modern workloads in computing systems. At the same time, we are witnessing an enormous amount of…

硬件体系结构 · 计算机科学 2022-08-19 Gagandeep Singh

Neural networks are an increasingly attractive algorithm for natural language processing and pattern recognition. Deep networks with >50M parameters are made possible by modern GPU clusters operating at <50 pJ per op and more recently,…

The energy and latency of an accelerator running a deep neural network (DNN) depend on how the computation and data movement are scheduled in the accelerator (i.e., mapping), and picking an optimal mapping is essential to achieve…

硬件体系结构 · 计算机科学 2026-05-05 Michael Gilbert , Tanner Andrulis , Vivienne Sze , Joel S. Emer