English
Related papers

Related papers: Adaptive Signal Variances: CNN Initialization Thro…

200 papers

The deep Convolutional Neural Network (CNN) is the state-of-the-art solution for large-scale visual recognition. Following basic principles such as increasing the depth and constructing highway connections, researchers have manually…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Lingxi Xie , Alan Yuille

We present a baseline convolutional neural network (CNN) structure and image preprocessing methodology to improve facial expression recognition algorithm using CNN. To analyze the most efficient network structure, we investigated four…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Minchul Shin , Munsang Kim , Dong-Soo Kwon

In this paper, we propose a novel convolutional neural network (CNN) for image denoising, which uses exponential linear unit (ELU) as the activation function. We investigate the suitability by analyzing ELU's connection with trainable…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Tianyang Wang , Zhengrui Qin , Michelle Zhu

Modern convolutional networks are not shift-invariant, as small input shifts or translations can cause drastic changes in the output. Commonly used downsampling methods, such as max-pooling, strided-convolution, and average-pooling, ignore…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Richard Zhang

Convolutional Neural Networks (CNNs) are typically constructed by stacking multiple building blocks, each of which contains a normalization layer such as batch normalization (BN) and a rectified linear function such as ReLU. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Wenqi Shao , Shitao Tang , Xingang Pan , Ping Tan , Xiaogang Wang , Ping Luo

Deep convolutional neural networks (CNN) have shown their promise as a universal representation for recognition. However, global CNN activations lack geometric invariance, which limits their robustness for classification and matching of…

Computer Vision and Pattern Recognition · Computer Science 2014-09-10 Yunchao Gong , Liwei Wang , Ruiqi Guo , Svetlana Lazebnik

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Jae Woong Soh , Nam Ik Cho

Graph neural networks (GNN) extends deep learning to graph-structure dataset. Similar to Convolutional Neural Networks (CNN) using on image prediction, convolutional and pooling layers are the foundation to success for GNN on graph…

Machine Learning · Computer Science 2023-02-28 Lingjie Kong , Yun Liao

We present Feature-Align CNN (FA-CNN), a prototype CNN architecture with intrinsic class attribution through end-to-end feature alignment. Our intuition is that the use of unordered operations such as Linear and Conv2D layers cause…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Parniyan Farvardin , David Chapman

Deep learning applications have achieved great success in numerous real-world applications. Deep learning models, especially Convolution Neural Networks (CNN) are often prototyped using FPGA because it offers high power efficiency and…

Machine Learning · Computer Science 2022-02-22 Adewale Adeyemo , Travis Sandefur , Tolulope A. Odetola , Syed Rafay Hasan

Within the world of machine learning there exists a wide range of different methods with respective advantages and applications. This paper seeks to present and discuss one such method, namely Convolutional Neural Networks (CNNs). CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Lars Lien Ankile , Morgan Feet Heggland , Kjartan Krange

Inspired by the success of Convolutional Neural Networks (CNNs) for supervised prediction in images, we design the Deconvolutional Generative Model (DGM), a new probabilistic generative model whose inference calculations correspond to those…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Tan Nguyen , Nhat Ho , Ankit Patel , Anima Anandkumar , Michael I. Jordan , Richard G. Baraniuk

Convolutional neural networks (CNN) have led to many state-of-the-art results spanning through various fields. However, a clear and profound theoretical understanding of the forward pass, the core algorithm of CNN, is still lacking. In…

Machine Learning · Statistics 2017-02-02 Vardan Papyan , Yaniv Romano , Michael Elad

A basic operation in Convolutional Neural Networks (CNNs) is spatial resizing of feature maps. This is done either by strided convolution (donwscaling) or transposed convolution (upscaling). Such operations are limited to a fixed filter…

Machine Learning · Computer Science 2020-06-22 Assaf Shocher , Ben Feinstein , Niv Haim , Michal Irani

During the last decade, Convolutional Neural Networks (CNNs) have become the de facto standard for various Computer Vision and Machine Learning operations. CNNs are feed-forward Artificial Neural Networks (ANNs) with alternating…

Signal Processing · Electrical Eng. & Systems 2019-05-10 Serkan Kiranyaz , Onur Avci , Osama Abdeljaber , Turker Ince , Moncef Gabbouj , Daniel J. Inman

Superior performance and ease of implementation have fostered the adoption of Convolutional Neural Networks (CNNs) for a wide array of inference and reconstruction tasks. CNNs implement three basic blocks: convolution, pooling and pointwise…

Machine Learning · Computer Science 2018-03-07 Fernando Gama , Antonio G. Marques , Alejandro Ribeiro , Geert Leus

Deep Convolutional Neural Networks (CNNs) have significantly advanced deep learning, driving breakthroughs in computer vision, natural language processing, medical diagnosis, object detection, and speech recognition. Architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Saddam Hussain Khan , Rashid Iqbal

The growing interest in satellite imagery has triggered the need for efficient mechanisms to extract valuable information from these vast data sources, providing deeper insights. Even though deep learning has shown significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Wadii Boulila , Eman Alshanqiti , Ayyub Alzahem , Anis Koubaa , Nabil Mlaiki

We present a novel architectural enhancement of Channel Boosting in a deep convolutional neural network (CNN). This idea of Channel Boosting exploits both the channel dimension of CNN (learning from multiple input channels) and Transfer…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Asifullah Khan , Anabia Sohail , Amna Ali

Convolutional neural networks (CNNs) with convolutional and pooling operations along the frequency axis have been proposed to attain invariance to frequency shifts of features. However, this is inappropriate with regard to the fact that…

Computation and Language · Computer Science 2016-08-24 Hwaran Lee , Geonmin Kim , Ho-Gyeong Kim , Sang-Hoon Oh , Soo-Young Lee