English
Related papers

Related papers: L2R-CIPU: Efficient CNN Computation with Left-to-R…

200 papers

This paper aims to accelerate the test-time computation of convolutional neural networks (CNNs), especially very deep CNNs that have substantially impacted the computer vision community. Unlike previous methods that are designed for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Xiangyu Zhang , Jianhua Zou , Kaiming He , Jian Sun

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

Recent efforts to improve the performance of neural network (NN) accelerators that meet today's application requirements have given rise to a new trend of logic-based NN inference relying on fixed-function combinational logic (FFCL). This…

Hardware Architecture · Computer Science 2023-04-14 Jingkai Hong , Arash Fayyazi , Amirhossein Esmaili , Mahdi Nazemi , Massoud Pedram

Deep learning techniques have become prominent in modern fault diagnosis for complex processes. In particular, convolutional neural networks (CNNs) have shown an appealing capacity to deal with multivariate time-series data by converting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Saif S. S. Al-Wahaibi , Qiugang Lu

We propose local binary convolution (LBC), an efficient alternative to convolutional layers in standard convolutional neural networks (CNN). The design principles of LBC are motivated by local binary patterns (LBP). The LBC layer comprises…

Machine Learning · Computer Science 2017-07-04 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien

Computation and Data Reuse is critical for the resource-limited Convolutional Neural Network (CNN) accelerators. This paper presents Universal Computation Reuse to exploit weight sparsity, repetition, and similarity simultaneously in a…

Hardware Architecture · Computer Science 2021-04-21 Alireza Khadem , Haojie Ye , Trevor Mudge

Recently ConvNets or convolutional neural networks (CNN) have come up as state-of-the-art classification and detection algorithms, achieving near-human performance in visual detection. However, ConvNet algorithms are typically very…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Bert Moons , Bert De Brabandere , Luc Van Gool , Marian Verhelst

A low-power precision-scalable processor for ConvNets or convolutional neural networks (CNN) is implemented in a 40nm technology. Its 256 parallel processing units achieve a peak 102GOPS running at 204MHz. To minimize energy consumption…

Hardware Architecture · Computer Science 2016-06-17 Bert Moons , Marian Verhelst

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

FPGA accelerators for lightweight neural convolutional networks (LWCNNs) have recently attracted significant attention. Most existing LWCNN accelerators focus on single-Computing-Engine (CE) architecture with local optimization. However,…

Hardware Architecture · Computer Science 2024-12-17 Zhiyuan Zhao , Yihao Chen , Pengcheng Feng , Jixing Li , Gang Chen , Rongxuan Shen , Huaxiang Lu

Tucker decomposition is one of the SOTA CNN model compression techniques. However, unlike the FLOPs reduction, we observe very limited inference time reduction with Tucker-compressed models using existing GPU software such as cuDNN. To this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-06 Lizhi Xiang , Miao Yin , Chengming Zhang , Aravind Sukumaran-Rajam , P. Sadayappan , Bo Yuan , Dingwen Tao

Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with single hardware units such as Graphics Processing Units (GPUs),…

Hardware Architecture · Computer Science 2026-05-04 Ali Emre Oztas , Mahir Demir , James Garside , Mikel Luj'an

Convolutional Neural Networks are extensively used in a wide range of applications, commonly including computer vision tasks like image and video classification, recognition, and segmentation. Recent research results demonstrate that…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Marco Carreras , Gianfranco Deriu , Luigi Raffo , Luca Benini , Paolo Meloni

Advanced compiler technology is crucial for enabling machine learning applications to run on novel hardware, but traditional compilers fail to deliver performance, popular auto-tuners have long search times and expert-optimized libraries…

Machine Learning · Computer Science 2023-11-09 Dejan Grubisic , Bram Wasti , Chris Cummins , John Mellor-Crummey , Aleksandar Zlateski

Neural Network designs are quite diverse, from VGG-style to ResNet-style, and from Convolutional Neural Networks to Transformers. Towards the design of efficient accelerators, many works have adopted a dataflow-based, inter-layer pipelined…

Machine Learning · Computer Science 2023-06-23 Zhewen Yu , Christos-Savvas Bouganis

Convolutional Neural Networks (CNNs) are one of the most successful deep machine learning technologies for processing image, voice and video data. CNNs require large amounts of processing capacity and memory, which can exceed the resources…

Neural and Evolutionary Computing · Computer Science 2017-08-17 James Garland , David Gregg

Large-scale deep convolutional neural networks (CNNs) are widely used in machine learning applications. While CNNs involve huge complexity, VLSI (ASIC and FPGA) chips that deliver high-density integration of computational resources are…

Machine Learning · Computer Science 2017-03-23 Xushen Han , Dajiang Zhou , Shihao Wang , Shinji Kimura

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji

The modern convolutional neural networks although achieve great results in solving complex computer vision tasks still cannot be effectively used in mobile and embedded devices due to the strict requirements for computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Nikolay Kozyrskiy , Anh-Huy Phan