English
Related papers

Related papers: Feature-based Attention in Convolutional Neural Ne…

200 papers

We propose Sequential Feature Filtering Classifier (FFC), a simple but effective classifier for convolutional neural networks (CNNs). With sequential LayerNorm and ReLU, FFC zeroes out low-activation units and preserves high-activation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Minseok Seo , Jaemin Lee , Jongchan Park , Dong-Geol Choi

Convolutional neural network (CNN) has led to significant progress in object detection. In order to detect the objects in various sizes, the object detectors often exploit the hierarchy of the multi-scale feature maps called feature…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Jin Hyeok Yoo , Dongsuk Kum , Jun Won Choi

Convolutional neural networks (CNNs) have been recently used for a variety of histology image analysis. However, availability of a large dataset is a major prerequisite for training a CNN which limits its use by the computational pathology…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Ruqayya Awan , Navid Alemi Koohbanani , Muhammad Shaban , Anna Lisowska , Nasir Rajpoot

Successful training of convolutional neural networks is often associated with sufficiently deep architectures composed of high amounts of features. These networks typically rely on a variety of regularization and pruning techniques to…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Martin Mundt , Tobias Weis , Kishore Konda , Visvanathan Ramesh

Majority of the recent approaches for text-independent speaker recognition apply attention or similar techniques for aggregation of frame-level feature descriptors generated by a deep neural network (DNN) front-end. In this paper, we…

Sound · Computer Science 2019-10-22 Sarthak Yadav , Atul Rai

In this paper we propose a novel deep learning-based algorithm for biomedical image segmentation which uses a sequential attention mechanism able to shift the focus of attention across the image in a selective way, allowing subareas which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Shohei Hayashi , Bisser Raytchev , Toru Tamaki , Kazufumi Kaneda

In recent years, convolutional neural networks (CNNs) have been applied successfully in many fields. However, such deep neural models are still regarded as black box in most tasks. One of the fundamental issues underlying this problem is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Dawei Dai , Yutang Li , Huanan Bao , Sy Xia , Guoyin Wang , Xiaoli Ma

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

In this paper, we propose an end-to-end feature fusion at-tention network (FFA-Net) to directly restore the haze-free image. The FFA-Net architecture consists of three key components: 1) A novel Feature Attention (FA) module combines…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Xu Qin , Zhilin Wang , Yuanchao Bai , Xiaodong Xie , Huizhu Jia

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by CNNs calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-06 Kamel Abdelouahab , Maxime Pelcat , Jocelyn Serot , François Berry

In this paper, we propose a novel training strategy for convolutional neural network(CNN) named Feature Mining, that aims to strengthen the network's learning of the local feature. Through experiments, we find that semantic contained in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Tianshu Xie , Xuan Cheng , Xiaomin Wang , Minghui Liu , Jiali Deng , Ming Liu

Recently Convolutional Neural Networks (CNNs) have been shown to achieve state-of-the-art performance on various classification tasks. In this paper, we present for the first time a place recognition technique based on CNN models, by…

Computer Vision and Pattern Recognition · Computer Science 2014-11-07 Zetao Chen , Obadiah Lam , Adam Jacobson , Michael Milford

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

The performance of convolutional neural networks (CNNs) can be improved by adjusting the interrelationship between channels with attention mechanism. However, attention mechanism in recent advance has not fully utilized spatial information…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 YuTao Shen , Ying Wen

With the development of feed-forward models, the default model for sequence modeling has gradually evolved to replace recurrent networks. Many powerful feed-forward models based on convolutional networks and attention mechanism were…

Computation and Language · Computer Science 2023-10-17 Hongyan Hao , Yan Wang , Siqiao Xue , Yudi Xia , Jian Zhao , Furao Shen

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

When the trained physician interprets medical images, they understand the clinical importance of visual features. By applying cognitive attention, they apply greater focus onto clinically relevant regions while disregarding unnecessary…

Image and Video Processing · Electrical Eng. & Systems 2021-09-06 Adrit Rao , Jongchan Park , Sanghyun Woo , Joon-Young Lee , Oliver Aalami

Underwater image processing and analysis have been a hotspot of study in recent years, as more emphasis has been focused to underwater monitoring and usage of marine resources. Compared with the open environment, underwater image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Muhammad Hamza , Ammar Hawbani , Sami Ul Rehman , Xingfu Wang , Liang Zhao