English
Related papers

Related papers: High Performance Convolution Using Sparsity and Pa…

200 papers

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

Neural and Evolutionary Computing · Computer Science 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

Deep learning time-series processing often relies on convolutional neural networks with overlapping windows. This overlap allows the network to produce an output faster than the window length. However, it introduces additional computations.…

Machine Learning · Computer Science 2024-08-07 Christodoulos Kechris , Jonathan Dan , Jose Miranda , David Atienza

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

We consider the optimization of deep convolutional neural networks (CNNs) such that they provide good performance while having reduced complexity if deployed on either conventional systems with spatial-domain convolution or lower-complexity…

Computer Vision and Pattern Recognition · Computer Science 2019-02-25 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

Automated cell detection and localization from microscopy images are significant tasks in biomedical research and clinical practice. In this paper, we design a new cell detection and localization algorithm that combines deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Yao Xue , Gilbert Bigras , Judith Hugh , Nilanjan Ray

For crowded scenes, the accuracy of object-based computer vision methods declines when the images are low-resolution and objects have severe occlusions. Taking counting methods for example, almost all the recent state-of-the-art counting…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Di Kang , Zheng Ma , Antoni B. Chan

With the increasing demand to deploy convolutional neural networks (CNNs) on mobile platforms, the sparse kernel approach was proposed, which could save more parameters than the standard convolution while maintaining accuracy. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Kun Wan , Boyuan Feng , Shu Yang , Yufei Ding

Recent advances in generalized image understanding have seen a surge in the use of deep convolutional neural networks (CNN) across a broad range of image-based detection, classification and prediction tasks. Whilst the reported performance…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Matt Poyser , Amir Atapour-Abarghouei , Toby P. Breckon

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

Image based localization is one of the important problems in computer vision due to its wide applicability in robotics, augmented reality, and autonomous systems. There is a rich set of methods described in the literature how to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Pulak Purkait , Cheng Zhao , Christopher Zach

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well…

Machine Learning · Computer Science 2020-07-01 Ze-Feng Gao , Song Cheng , Rong-Qiang He , Z. Y. Xie , Hui-Hai Zhao , Zhong-Yi Lu , Tao Xiang

The success of convolutional neural networks (CNNs) in computer vision applications has been accompanied by a significant increase of computation and memory costs, which prohibits its usage on resource-limited environments such as mobile or…

Computer Vision and Pattern Recognition · Computer Science 2019-03-25 Shaohui Lin , Rongrong Ji , Yuchao Li , Cheng Deng , Xuelong Li

Convolutional neural network (CNN) inference on mobile devices demands efficient hardware acceleration of low-precision (INT8) general matrix multiplication (GEMM). Exploiting data sparsity is a common approach to further accelerate GEMM…

Hardware Architecture · Computer Science 2020-10-14 Zhi-Gang Liu , Paul N. Whatmough , Matthew Mattina

Convolutional neural networks (CNNs) are computationally intensive and often accelerated using crossbar-based in-memory computing (IMC) architectures. However, large convolutional layers must be partitioned across multiple crossbars,…

Hardware Architecture · Computer Science 2025-12-01 Shuai Dong , Junyi Yang , Ye Ke , Hongyang Shang , Arindam Basu

Image inpainting has earned substantial progress, owing to the encoder-and-decoder pipeline, which is benefited from the Convolutional Neural Networks (CNNs) with convolutional downsampling to inpaint the masked regions semantically from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Haipeng Liu , Yang Wang , Biao Qian , Yong Rui , Meng Wang

Convolutional Neural Networks (CNNs) use pooling to decrease the size of activation maps. This process is crucial to increase the receptive fields and to reduce computational requirements of subsequent convolutions. An important feature of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Alexandros Stergiou , Ronald Poppe , Grigorios Kalliatakis

Deep Convolutional Sparse Coding (D-CSC) is a framework reminiscent of deep convolutional neural networks (DCNNs), but by omitting the learning of the dictionaries one can more transparently analyse the role of the activation function and…

Machine Learning · Computer Science 2021-06-02 Michael Murray , Jared Tanner

The convolution computation is widely used in many fields, especially in CNNs. Because of the rapid growth of the training data in CNNs, GPUs have been used for the acceleration, and memory-efficient algorithms are focused because of thier…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-02 Qiong Chang , Masaki Onishi , Tsutomu Maruyama

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji