中文
相关论文

相关论文: Mitigating Memory Wall Effects in CNN Engines with…

200 篇论文

In this paper we introduce ShiftCNN, a generalized low-precision architecture for inference of multiplierless convolutional neural networks (CNNs). ShiftCNN is based on a power-of-two weight representation and, as a result, performs only…

计算机视觉与模式识别 · 计算机科学 2017-06-09 Denis A. Gudovskiy , Luca Rigazio

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

机器学习 · 计算机科学 2020-01-31 Chao-Tsung Huang

Training deep neural networks (DNNs) requires significantly more computation and memory than inference, making runtime adaptation of DNNs challenging on resource-limited IoT platforms. We propose InstantFT, an FPGA-based method for…

机器学习 · 计算机科学 2025-06-10 Keisuke Sugiura , Hiroki Matsutani

Convolutional Neural Networks (CNNs) are widely used in deep learning applications, e.g. visual systems, robotics etc. However, existing software solutions are not efficient. Therefore, many hardware accelerators have been proposed…

机器学习 · 计算机科学 2021-09-08 Sasindu Wijeratne , Sandaruwan Jayaweera , Mahesh Dananjaya , Ajith Pasqual

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

机器学习 · 计算机科学 2022-01-03 Marcin Pietroń , Dominik Żurek

Custom dataflow Convolutional Neural Network (CNN) inference accelerators on FPGA are tailored to a specific CNN topology and store parameters in On-Chip Memory (OCM), resulting in high energy efficiency and low inference latency. However,…

硬件体系结构 · 计算机科学 2020-11-17 Lucian Petrica , Tobias Alonso , Mairin Kroes , Nicholas Fraser , Sorin Cotofana , Michaela Blott

Spectral-domain CNNs have been shown to be more efficient than traditional spatial CNNs in terms of reducing computation complexity. However they come with a `kernel explosion' problem that, even after compression (pruning), imposes a high…

硬件体系结构 · 计算机科学 2023-10-18 Yue Niu , Rajgopal Kannan , Ajitesh Srivastava , Viktor Prasanna

To achieve high accuracy, convolutional neural networks (CNNs) are increasingly growing in complexity and diversity in layer types and topologies. This makes it very challenging to efficiently deploy such networks on custom processor…

系统与控制 · 电气工程与系统科学 2024-06-21 Steven Colleman , Man Shi , Marian Verhelst

Convolutional neural networks (CNNs) have recently demonstrated superior quality for computational imaging applications. Therefore, they have great potential to revolutionize the image pipelines on cameras and displays. However, it is…

分布式、并行与集群计算 · 计算机科学 2019-10-15 Chao-Tsung Huang , Yu-Chun Ding , Huan-Ching Wang , Chi-Wen Weng , Kai-Ping Lin , Li-Wei Wang , Li-De Chen

Various hardware accelerators have been developed for energy-efficient and real-time inference of neural networks on edge devices. However, most training is done on high-performance GPUs or servers, and the huge memory and computing costs…

硬件体系结构 · 计算机科学 2021-04-21 Kaiqi Zhang , Cole Hawkins , Xiyuan Zhang , Cong Hao , Zheng Zhang

CNNs have been shown to maintain reasonable classification accuracy when quantized to lower precisions. Quantizing to sub 8-bit activations and weights can result in accuracy falling below an acceptable threshold. Techniques exist for…

分布式、并行与集群计算 · 计算机科学 2018-07-02 Philip Colangelo , Nasibeh Nasiri , Asit Mishra , Eriko Nurvitadhi , Martin Margala , Kevin Nealis

The challenges involved in executing neural networks (NNs) at the edge include providing diversity, flexibility, and sustainability. That implies, for instance, supporting evolving applications and algorithms energy-efficiently. Using…

硬件体系结构 · 计算机科学 2024-06-14 Federico Manca , Francesco Ratto , Francesca Palumbo

Convolutional Neural Networks (CNNs) have begun to permeate all corners of electronic society (from voice recognition to scene generation) due to their high accuracy and machine efficiency per operation. At their core, CNN computations are…

神经与进化计算 · 计算机科学 2018-04-19 Kartik Hegde , Jiyong Yu , Rohit Agrawal , Mengjia Yan , Michael Pellauer , Christopher W. Fletcher

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

机器学习 · 计算机科学 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Although state-of-the-art (SOTA) CNNs achieve outstanding performance on various tasks, their high computation demand and massive number of parameters make it difficult to deploy these SOTA CNNs onto resource-constrained devices. Previous…

计算机视觉与模式识别 · 计算机科学 2020-06-26 Shiyu Li , Edward Hanson , Hai Li , Yiran Chen

The recent research advances in deep learning have led to the development of small and powerful Convolutional Neural Network (CNN) architectures. Meanwhile Field Programmable Gate Arrays (FPGAs) has become a popular hardware target choice…

图像与视频处理 · 电气工程与系统科学 2020-06-17 Nazariy K. Shaydyuk , Eugene B. John

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

计算机视觉与模式识别 · 计算机科学 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

FPGA accelerators for lightweight neural convolutional networks (LWCNNs) have recently attracted significant attention. Most existing LWCNN accelerators focus on single-Computing-Engine (CE) architecture with local optimization. However,…

硬件体系结构 · 计算机科学 2024-12-17 Zhiyuan Zhao , Yihao Chen , Pengcheng Feng , Jixing Li , Gang Chen , Rongxuan Shen , Huaxiang Lu

Training Convolutional Neural Networks (CNN) is a resource intensive task that requires specialized hardware for efficient computation. One of the most limiting bottleneck of CNN training is the memory cost associated with storing the…

计算机视觉与模式识别 · 计算机科学 2019-10-25 Tristan Hascoet , Quentin Febvre , Yasuo Ariki , Tetsuya Takiguchi

Deep convolutional neural network (CNN) inference requires significant amount of memory and computation, which limits its deployment on embedded devices. To alleviate these problems to some extent, prior research utilize low precision…

机器学习 · 计算机科学 2017-03-10 Liangzhen Lai , Naveen Suda , Vikas Chandra