English
Related papers

Related papers: CNNtention: Can CNNs do better with Attention?

200 papers

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

Convolutional layers are an integral part of many deep neural network solutions in computer vision. Recent work shows that replacing the standard convolution operation with mechanisms based on self-attention leads to improved performance on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Souvik Kundu , Hesham Mostafa , Sharath Nittur Sridhar , Sairam Sundaresan

Convolutional neural networks (CNNs) were inspired by early findings in the study of biological vision. They have since become successful tools in computer vision and state-of-the-art models of both neural activity and behavior on visual…

Neurons and Cognition · Quantitative Biology 2020-02-11 Grace W. Lindsay

In recent years, the convolutional neural networks (CNNs) have received a lot of interest in the side-channel community. The previous work has shown that CNNs have the potential of breaking the cryptographic algorithm protected with masking…

Cryptography and Security · Computer Science 2020-09-21 Minhui Jin , Mengce Zheng , Honggang Hu , Nenghai Yu

Convolutional neural network (CNN) has drawn increasing interest in visual tracking owing to its powerfulness in feature extraction. Most existing CNN-based trackers treat tracking as a classification problem. However, these trackers are…

Computer Vision and Pattern Recognition · Computer Science 2017-05-02 Heng Fan , Haibin Ling

Algorithmic image-based diagnosis and prognosis of neurodegenerative diseases on longitudinal data has drawn great interest from computer vision researchers. The current state-of-the-art models for many image classification tasks are based…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Jie Zhang , Qingyang Li , Richard J. Caselli , Jieping Ye , Yalin Wang

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

Convolutional neural networks have enabled major progresses in addressing pixel-level prediction tasks such as semantic segmentation, depth estimation, surface normal prediction and so on, benefiting from their powerful capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Guanglei Yang , Paolo Rota , Xavier Alameda-Pineda , Dan Xu , Mingli Ding , Elisa Ricci

During the last decade, Convolutional Neural Networks (CNNs) have become the de facto standard for various Computer Vision and Machine Learning operations. CNNs are feed-forward Artificial Neural Networks (ANNs) with alternating…

Signal Processing · Electrical Eng. & Systems 2019-05-10 Serkan Kiranyaz , Onur Avci , Osama Abdeljaber , Turker Ince , Moncef Gabbouj , Daniel J. Inman

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Convolutional neural networks are basic structures using jet images as input for the jet tagging problems. However, what they have learned during the training process is always difficult to understand just through feature maps. Inspired by…

High Energy Physics - Phenomenology · Physics 2020-09-02 Jing Li , Hao Sun

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang

This paper presents the development and evaluation of a custom Convolutional Neural Network (CustomCNN) created to study how architectural design choices affect multi-domain image classification tasks. The network uses residual connections,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Shamik Shafkat Avro , Nazira Jesmin Lina , Shahanaz Sharmin

Convolutional neural network-based medical image classifiers have been shown to be especially susceptible to adversarial examples. Such instabilities are likely to be unacceptable in the future of automated diagnoses. Though statistical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Isaac Wasserman

Convolutional Neural Network(CNN) has been widely used for image recognition with great success. However, there are a number of limitations of the current CNN based image recognition paradigm. First, the receptive field of CNN is generally…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Dong-Qing Zhang

Deep neural networks (DNN) have revolutionized the field of natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN), the two main types of DNN architectures, are widely explored to handle…

Computation and Language · Computer Science 2017-02-08 Wenpeng Yin , Katharina Kann , Mo Yu , Hinrich Schütze

Object classification is a significant task in computer vision. It has become an effective research area as an important aspect of image processing and the building block of image localization, detection, and scene parsing. Object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Md. Mohsin Kabir , Abu Quwsar Ohi , Md. Saifur Rahman , M. F. Mridha

Many current methods to interpret convolutional neural networks (CNNs) use visualization techniques and words to highlight concepts of the input seemingly relevant to a CNN's decision. The methods hypothesize that the recognition of these…

Machine Learning · Computer Science 2017-11-23 Ning Xie , Md Kamruzzaman Sarker , Derek Doran , Pascal Hitzler , Michael Raymer

Deep neural network models have recently draw lots of attention, as it consistently produce impressive results in many computer vision tasks such as image classification, object detection, etc. However, interpreting such model and show the…

Machine Learning · Computer Science 2019-01-30 Shipeng Xie , Da Chen , Rong Zhang , Hui Xue

Dynamic Textures (DTs) are sequences of images of moving scenes that exhibit certain stationarity properties in time such as smoke, vegetation and fire. The analysis of DT is important for recognition, segmentation, synthesis or retrieval…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Vincent Andrearczyk , Paul F. Whelan