English
Related papers

Related papers: smallNet: Implementation of a convolutional layer …

200 papers

IoT Edge intelligence requires Convolutional Neural Network (CNN) inference to take place in the edge devices itself. ARM big.LITTLE architecture is at the heart of prevalent commercial edge devices. It comprises of single-ISA heterogeneous…

Machine Learning · Computer Science 2021-02-03 Siqi Wang , Gayathri Ananthanarayanan , Yifan Zeng , Neeraj Goel , Anuj Pathania , Tulika Mitra

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

Computational complexity and storage requirements are crucial factors influencing the performance and efficiency of convolutional neural networks (CNNs) in resource-constrained environments. This paper presents a high-performance embedded…

Model compression and hardware acceleration are essential for the resource-efficient deployment of deep neural networks. Modern object detectors have highly interconnected convolutional layers with concatenations. In this work, we study how…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Svetlana Pavlitska , Oliver Bagge , Federico Peccia , Toghrul Mammadov , J. Marius Zöllner

Deep models have achieved significant process on single image super-resolution (SISR) tasks, in particular large models with large kernel ($3\times3$ or more). However, the heavy computational footprint of such models prevents their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu

Deep learning has significantly advanced the state of the art in artificial intelligence, gaining wide popularity from both industry and academia. Special interest is around Convolutional Neural Networks (CNN), which take inspiration from…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 R. Tapiador , A. Rios-Navarro , A. Linares-Barranco , Minkyu Kim , Deepak Kadetotad , Jae-sun Seo

Vision network designs, including Convolutional Neural Networks and Vision Transformers, have significantly advanced the field of computer vision. Yet, their complex computations pose challenges for practical deployments, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Ao Wang , Hui Chen , Zijia Lin , Jungong Han , Guiguang Ding

Deep Convolutional Neural Networks have become a Swiss knife in solving critical artificial intelligence tasks. However, deploying deep CNN models for latency-critical tasks remains to be challenging because of the complex nature of CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Chuanhao Zhuge , Xinheng Liu , Xiaofan Zhang , Sudeep Gummadi , Jinjun Xiong , Deming Chen

Research has shown that convolutional neural networks contain significant redundancy, and high classification accuracy can be obtained even when weights and activations are reduced from floating point to binary values. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-12-22 Yaman Umuroglu , Nicholas J. Fraser , Giulio Gambardella , Michaela Blott , Philip Leong , Magnus Jahre , Kees Vissers

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

There are a plethora of applications that demand high throughput and low latency algorithms leveraging machine learning methods. This need for real time processing can be seen in industries ranging from developing neural network based…

Machine Learning · Computer Science 2020-04-14 Yash Akhauri

Deep learning has witnessed the extensive utilization across a wide spectrum of domains, including fine-grained few-shot learning (FGFSL) which heavily depends on deep backbones. Nonetheless, shallower deep backbones such as ConvNet-4, are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chaofei Qi , Chao Ye , Zhitai Liu , Weiyang Lin , Jianbin Qiu

Convolutional Neural Networks (CNNs) are rapidly gaining popularity in varied fields. Due to their increasingly deep and computationally heavy structures, it is difficult to deploy them on energy constrained mobile applications. Hardware…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-10 Akanksha Baranwal , Ishan Bansal , Roopal Nahar , K. Madhava Krishna

Convolution layers are prevalent in many classes of deep neural networks, including Convolutional Neural Networks (CNNs) which provide state-of-the-art results for tasks like image recognition, neural machine translation and speech…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-22 Evangelos Georganas , Sasikanth Avancha , Kunal Banerjee , Dhiraj Kalamkar , Greg Henry , Hans Pabst , Alexander Heinecke

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

Convolutional Neural Networks (CNNs) have been utilised in many image and video processing applications. The convolution operator, also known as a spatial filter, is usually a linear operation, but this linearity compromises essential…

Hardware Architecture · Computer Science 2024-09-10 Nelson Campos , Eran Edirisinghe , Salva Chesnokov , Daniel Larkin

In this paper, we present two image classification models on the Tiny ImageNet dataset. We built two very different networks from scratch based on the idea of Densely Connected Convolution Networks. The architecture of the networks is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Zoheb Abai , Nishad Rajmalwar

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Training large and highly accurate deep learning (DL) models is computationally costly. This cost is in great part due to the excessive number of trained parameters, which are well-known to be redundant and compressible for the execution…

Machine Learning · Computer Science 2019-04-11 Mojan Javaheripi , Bita Darvish Rouhani , Farinaz Koushanfar

Convolutional neural networks (CNNs) have been widely employed in many applications such as image classification, video analysis and speech recognition. Being compute-intensive, CNN computations are mainly accelerated by GPUs with high…

Hardware Architecture · Computer Science 2016-11-09 Dong Wang , Jianjing An , Ke Xu