English
Related papers

Related papers: L2R-CIPU: Efficient CNN Computation with Left-to-R…

200 papers

Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of…

Hardware Architecture · Computer Science 2021-04-13 Mario Fischer , Juergen Wassner

In order to handle modern convolutional neural networks (CNNs) efficiently, a hardware architecture of CNN inference accelerator is proposed to handle depthwise convolutions and regular convolutions, which are both essential building blocks…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Tse-Wei Chen , Wei Tao , Deyu Wang , Dongchao Wen , Kinya Osa , Masami Kato

Convolutional neural networks (CNNs) have shown exceptional performance for a range of medical imaging tasks. However, conventional CNNs are not able to explain their reasoning process, therefore limiting their adoption in clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Linde S. Hesse , Ana I. L. Namburete

Computing-in-memory (CIM) has attracted significant attentions in recent years due to its massive parallelism and low power consumption. However, current CIM designs suffer from large area overhead of small CIM macros and bad programmablity…

Hardware Architecture · Computer Science 2022-05-04 Shu-Hung Kuo , Tian-Sheuan Chang

We present a versatile GPU-based parallel version of Logistic Regression (LR), aiming to address the increasing demand for faster algorithms in binary classification due to large data sets. Our implementation is a direct translation of the…

Machine Learning · Computer Science 2023-08-22 Nechba Mohammed , Mouhajir Mohamed , Sedjari Yassine

On-device Deep Neural Network (DNN) inference consumes significant computing resources and development efforts. To alleviate that, we propose LUT-NN, the first system to empower inference by table lookup, to reduce inference cost. LUT-NN…

Machine Learning · Computer Science 2023-09-07 Xiaohu Tang , Yang Wang , Ting Cao , Li Lyna Zhang , Qi Chen , Deng Cai , Yunxin Liu , Mao Yang

Graph convolutional networks (GCNs) have shown remarkable learning capabilities when processing graph-structured data found inherently in many application areas. GCNs distribute the outputs of neural networks embedded in each vertex over…

Hardware Architecture · Computer Science 2022-05-18 Sumit K. Mandal , Gokul Krishnan , A. Alper Goksoy , Gopikrishnan Ravindran Nair , Yu Cao , Umit Y. Ogras

Deep neural networks (DNN) have shown superior performance in a variety of tasks. As they rapidly evolve, their escalating computation and memory demands make it challenging to deploy them on resource-constrained edge devices. Though…

Machine Learning · Computer Science 2021-09-07 Jiaqi Gu , Hanqing Zhu , Chenghao Feng , Mingjie Liu , Zixuan Jiang , Ray T. Chen , David Z. Pan

We report FPGA implementation results of low precision CNN convolution layers optimized for sparse and constant parameters. We describe techniques that amortizes the cost of common factor multiplication and automatically leverage dense hand…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-16 Thiam Khean Hah , Yeong Tat Liew , Jason Ong

Many architects believe that major improvements in cost-energy-performance must now come from domain-specific hardware. This paper evaluates a custom ASIC---called a Tensor Processing Unit (TPU)---deployed in datacenters since 2015 that…

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile…

Machine Learning · Computer Science 2019-01-28 Arash Ardakani , Zhengyun Ji , Sean C. Smithson , Brett H. Meyer , Warren J. Gross

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Graph convolutional networks (GCNs) have been introduced to effectively process non-euclidean graph data. However, GCNs incur large amounts of irregularity in computation and memory access, which prevents efficient use of traditional neural…

Machine Learning · Computer Science 2021-11-08 Zhuofu Tao , Chen Wu , Yuan Liang , Lei He

In recent years, convolutional neural networks (CNNs) have shown great performance in various fields such as image classification, pattern recognition, and multi-media compression. Two of the feature properties, local connectivity and…

Machine Learning · Computer Science 2018-07-24 Qianru Zhang , Meng Zhang , Tinghuan Chen , Zhifei Sun , Yuzhe Ma , Bei Yu

We propose a generalized convolutional neural network (CNN) architecture that first decomposes the input signal into subbands by an adaptive filter bank structure, and then uses convolutional layers to extract features from each subband…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Tiny Machine Learning (TinyML) is a novel research field aiming at integrating Machine Learning (ML) within embedded devices with limited memory, computation, and energy. Recently, a new branch of TinyML has emerged, focusing on integrating…

The rapid growth of microcontroller-based IoT devices has opened up numerous applications, from smart manufacturing to personalized healthcare. Despite the widespread adoption of energy-efficient microcontroller units (MCUs) in the Tiny…

Machine Learning · Computer Science 2024-09-26 Giorgos Armeniakos , Georgios Mentzos , Dimitrios Soudris

Low precision data representation is important to reduce storage size and memory access for convolutional neural networks (CNNs). Yet, existing methods have two major limitations: (1) requiring re-training to maintain accuracy for deep…

Signal Processing · Electrical Eng. & Systems 2020-03-10 Chen Wu , Mingyu Wang , Xinyuan Chu , Kun Wang , Lei He

With the increasing reliance of users on smart devices, bringing essential computation at the edge has become a crucial requirement for any type of business. Many such computations utilize Convolution Neural Networks (CNNs) to perform AI…

Machine Learning · Computer Science 2022-01-17 Tanmay Jain , Avaneesh , Rohit Verma , Rajeev Shorey

The automated Interstitial Lung Diseases (ILDs) classification technique is essential for assisting clinicians during the diagnosis process. Detecting and classifying ILDs patterns is a challenging problem. This paper introduces an…

Image and Video Processing · Electrical Eng. & Systems 2022-04-22 Masum Shah Junayed , Afsana Ahsan Jeny , Md Baharul Islam , Ikhtiar Ahmed , A F M Shahen Shah