English
Related papers

Related papers: $ShiftwiseConv:$ Small Convolutional Kernel with L…

200 papers

Joint image filters are used to transfer structural details from a guidance picture used as a prior to a target image, in tasks such as enhancing spatial resolution and suppressing noise. Previous methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Beomjun Kim , Jean Ponce , Bumsub Ham

Convolution neural network demonstrates great capability for multiple tasks, such as image classification and many others. However, much resource is required to train a network. Hence much effort has been made to accelerate neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Fuyuan Lyu , Shien Zhu , Weichen Liu

In standard Convolutional Neural Networks (CNNs), the receptive fields of artificial neurons in each layer are designed to share the same size. It is well-known in the neuroscience community that the receptive field size of visual cortical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Xiang Li , Wenhai Wang , Xiaolin Hu , Jian Yang

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

Model compression and acceleration are attracting increasing attentions due to the demand for embedded devices and mobile applications. Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by…

Machine Learning · Computer Science 2020-08-21 Jinhua Liang , Tao Zhang , Guoqing Feng

Deep convolutional neural networks (CNNs) used in practice employ potentially hundreds of layers and $10$,$000$s of nodes. Such network sizes entail significant computational complexity due to the large number of convolutions that need to…

Machine Learning · Statistics 2018-03-15 Thomas Wiatowski , Philipp Grohs , Helmut Bölcskei

With the inspiration of vision transformers, the concept of depth-wise convolution revisits to provide a large Effective Receptive Field (ERF) using Large Kernel (LK) sizes for medical image segmentation. However, the segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Ho Hin Lee , Quan Liu , Shunxing Bao , Qi Yang , Xin Yu , Leon Y. Cai , Thomas Li , Yuankai Huo , Xenofon Koutsoukos , Bennett A. Landman

CNN architectures are generally heavy on memory and computational requirements which makes them infeasible for embedded systems with limited hardware resources. We propose dual convolutional kernels (DualConv) for constructing lightweight…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Jiachen Zhong , Junying Chen , Ajmal Mian

The support vector machine (SVM) and deep learning (e.g., convolutional neural networks (CNNs)) are the two most famous algorithms in small and big data, respectively. Nonetheless, smaller datasets may be very important, costly, and not…

Machine Learning · Computer Science 2020-02-19 Wei-Chang Yeh

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann

Convolutional Neural Networks (CNNs) are generally prone to noise interruptions, i.e., small image noise can cause drastic changes in the output. To suppress the noise effect to the final predication, we enhance CNNs by replacing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Qiufu Li , Linlin Shen , Sheng Guo , Zhihui Lai

This paper presents a module, Spatial Cross-scale Convolution (SCSC), which is verified to be effective in improving both CNNs and Transformers. Nowadays, CNNs and Transformers have been successful in a variety of tasks. Especially for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Xijun Wang , Xiaojie Chu , Chunrui Han , Xiangyu Zhang

Convolutional Neural Networks have dramatically improved in recent years, surpassing human accuracy on certain problems and performance exceeding that of traditional computer vision algorithms. While the compute pattern in itself is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Michaela Blott , Thomas B. Preusser , Nicholas Fraser , Giulio Gambardella , Kenneth OBrien , Yaman Umuroglu , Miriam Leeser

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Convolutional layers are the core building blocks of Convolutional Neural Networks (CNNs). In this paper, we propose to augment a convolutional layer with an additional depthwise convolution, where each input channel is convolved with a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Jinming Cao , Yangyan Li , Mingchao Sun , Ying Chen , Dani Lischinski , Daniel Cohen-Or , Baoquan Chen , Changhe Tu

Deep learning, in particular Convolutional Neural Network (CNN), has achieved promising results in face recognition recently. However, it remains an open question: why CNNs work well and how to design a 'good' architecture. The existing…

Computer Vision and Pattern Recognition · Computer Science 2015-04-10 Guosheng Hu , Yongxin Yang , Dong Yi , Josef Kittler , William Christmas , Stan Z. Li , Timothy Hospedales

Many deep neural networks are built by using stacked convolutional layers of fixed and single size (often 3$\times$3) kernels. This paper describes a method for training the size of convolutional kernels to provide varying size kernels in a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 F. Boray Tek , İlker Çam , Deniz Karlı

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Chun-Fu Chen , Quanfu Fan , Neil Mallinar , Tom Sercu , Rogerio Feris

Deep learning models have shown their superior performance in various vision tasks. However, the lack of precisely interpreting kernels in convolutional neural networks (CNNs) is becoming one main obstacle to wide applications of deep…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jia-Xin Zhuang , Wanying Tao , Jianfei Xing , Wei Shi , Ruixuan Wang , Wei-shi Zheng

The objective of this paper is the effective transfer of the Convolutional Neural Network (CNN) feature in image search and classification. Systematically, we study three facts in CNN transfer. 1) We demonstrate the advantage of using…

Computer Vision and Pattern Recognition · Computer Science 2016-04-04 Liang Zheng , Yali Zhao , Shengjin Wang , Jingdong Wang , Qi Tian