English
Related papers

Related papers: Towards Effective Depthwise Convolutions on ARMv8 …

200 papers

Deep neural network (DNN) has emerged as the most important and popular artificial intelligent (AI) technique. The growth of model size poses a key energy efficiency challenge for the underlying computing platform. Thus, model compression…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Chunhua Deng , Siyu Liao , Yi Xie , Keshab K. Parhi , Xuehai Qian , Bo Yuan

In-memory computing is an emerging computing paradigm that could enable deeplearning inference at significantly higher energy efficiency and reduced latency. The essential idea is to map the synaptic weights corresponding to each layer to…

Machine Learning · Computer Science 2019-06-11 Martino Dazzi , Abu Sebastian , Pier Andrea Francese , Thomas Parnell , Luca Benini , Evangelos Eleftheriou

Deep convolutional neural networks contain tens of millions of parameters, making them impossible to work efficiently on embedded devices. We propose iterative approach of applying low-rank approximation to compress deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Maksym Kholiavchenko

A novel energy-efficient edge computing paradigm is proposed for real-time deep learning-based image upsampling applications. State-of-the-art deep learning solutions for image upsampling are currently trained using either resize or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Ian Colbert , Ken Kreutz-Delgado , Srinjoy Das

NVIDIA cuDNN is a low-level library that provides GPU kernels frequently used in deep learning. Specifically, cuDNN implements several equivalent convolution algorithms, whose performance and memory footprint may vary considerably,…

Machine Learning · Computer Science 2018-04-16 Yosuke Oyama , Tal Ben-Nun , Torsten Hoefler , Satoshi Matsuoka

Due to the nonlinearity of artificial neural networks, designing topologies for deep convolutional neural networks (CNN) is a challenging task and often only heuristic approach, such as trial and error, can be applied. An evolutionary…

Neural and Evolutionary Computing · Computer Science 2018-09-11 Honglei Zhang , Serkan Kiranyaz , Moncef Gabbouj

The widespread integration of embedded systems across various industries has facilitated seamless connectivity among devices and bolstered computational capabilities. Despite their extensive applications, embedded systems encounter…

Cryptography and Security · Computer Science 2024-04-16 Sreenitha Kasarapu , Sathwika Bavikadi , Sai Manoj Pudukotai Dinakarrao

The majority of the research on the quantization of Deep Neural Networks (DNNs) is focused on reducing the precision of tensors visible by high-level frameworks (e.g., weights, activations, and gradients). However, current hardware still…

Machine Learning · Computer Science 2024-01-26 Yaniv Blumenfeld , Itay Hubara , Daniel Soudry

Deploying deep neural networks on edge devices is often limited by the memory traffic and compute cost of dense linear operators. While quaternion neural networks improve parameter efficiency by coupling multiple channels through Hamilton…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Vladimir Frants , Sos Agaian , Karen Panetta

After the tremendous success of convolutional neural networks in image classification, object detection, speech recognition, etc., there is now rising demand for deployment of these compute-intensive ML models on tightly power constrained…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Lukas Cavigelli , Luca Benini

It has been shown that increasing model depth improves the quality of neural machine translation. However, different architectural variants to increase model depth have been proposed, and so far, there has been no thorough comparative…

Computation and Language · Computer Science 2017-07-25 Antonio Valerio Miceli Barone , Jindřich Helcl , Rico Sennrich , Barry Haddow , Alexandra Birch

At the core of any inference procedure in deep neural networks are dot product operations, which are the component that require the highest computational resources. A common approach to reduce the cost of inference is to reduce its memory…

Machine Learning · Computer Science 2018-12-19 Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

Convolutional neural networks (CNNs) are used in many embedded applications, from industrial robotics and automation systems to biometric identification on mobile devices. State-of-the-art classification is typically achieved by large…

Machine Learning · Computer Science 2020-05-22 Yuan Wen , Andrew Anderson , Valentin Radu , Michael F. P. O'Boyle , David Gregg

Binary Convolutional Neural Networks (CNNs) can significantly reduce the number of arithmetic operations and the size of memory storage, which makes the deployment of CNNs on mobile or embedded systems more promising. However, the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Baozhou Zhu , Zaid Al-Ars , Wei Pan

Energy efficiency of hardware accelerators of deep neural networks (DNN) can be improved by introducing approximate arithmetic circuits. In order to quantify the error introduced by using these circuits and avoid the expensive hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-03 Filip Vaverka , Vojtech Mrazek , Zdenek Vasicek , Lukas Sekanina

The state-of-the-art approaches employ approximate computing to reduce the energy consumption of DNN hardware. Approximate DNNs then require extensive retraining afterwards to recover from the accuracy loss caused by the use of approximate…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Vojtech Mrazek , Zdenek Vasicek , Lukas Sekanina , Muhammad Abdullah Hanif , Muhammad Shafique

This paper introduces an adaptive convolutional neural network (CNN) architecture capable of automating various topology optimization (TO) problems with diverse underlying physics. The proposed architecture has an encoder-decoder-type…

Computational Engineering, Finance, and Science · Computer Science 2024-04-19 Khaish Singh Chadha , Prabhat Kumar

ConvNets, through their architecture, only enforce invariance to translation. In this paper, we introduce a new class of deep convolutional architectures called Non-Parametric Transformation Networks (NPTNs) which can learn \textit{general}…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Dipan K. Pal , Marios Savvides

Though CNNs are highly parallel workloads, in the absence of efficient on-chip memory reuse techniques, an accelerator for them quickly becomes memory bound. In this paper, we propose a CNN accelerator design for inference that is able to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-26 Kingshuk Majumder , Shubham Nema , Uday Bondhugula

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue