English
Related papers

Related papers: Self-Attention Capsule Networks for Object Classif…

200 papers

Audio classification is considered as a challenging problem in pattern recognition. Recently, many algorithms have been proposed using deep neural networks. In this paper, we introduce a new attention-based neural network architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Haoye Lu , Haolong Zhang , Amit Nayak

Capsule networks (CapsNets) were introduced to address convolutional neural networks limitations, learning object-centric representations that are more robust, pose-aware, and interpretable. They organize neurons into groups called…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Riccardo Renzulli

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

Attention mechanisms have raised significant interest in the research community, since they promise significant improvements in the performance of neural network architectures. However, in any specific problem, we still lack a principled…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Rafael Pedro , Arlindo L. Oliveira

Microscopic image segmentation is a challenging task, wherein the objective is to assign semantic labels to each pixel in a given microscopic image. While convolutional neural networks (CNNs) form the foundation of many existing frameworks,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mustansar Fiaz , Moein Heidari , Rao Muhammad Anwer , Hisham Cholakkal

Recently, numerous studies have been conducted on supervised learning-based image denoising methods. However, these methods rely on large-scale noisy-clean image pairs, which are difficult to obtain in practice. Denoising methods with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Young-Joo Han , Ha-Jin Yu

While self-attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Xu Ma , Jingda Guo , Sihai Tang , Zhinan Qiao , Qi Chen , Qing Yang , Song Fu

Capsule networks were proposed as an alternative approach to Convolutional Neural Networks (CNNs) for learning object-centric representations, which can be leveraged for improved generalization and sample complexity. Unlike CNNs, capsule…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Fabio De Sousa Ribeiro , Kevin Duarte , Miles Everett , Georgios Leontidis , Mubarak Shah

Object detection in challenging situations such as scale variation, occlusion, and truncation depends not only on feature details but also on contextual information. Most previous networks emphasize too much on detailed feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Wenchi Ma , Yuanwei Wu , Zongbo Wang , Guanghui Wang

Existing face super-resolution (SR) methods mainly assume the input image to be noise-free. Their performance degrades drastically when applied to real-world scenarios where the input image is always contaminated by noise. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Jingwei Xin , Nannan Wang , Xinrui Jiang , Jie Li , Xinbo Gao , Zhifeng Li

Although deep convolutional neural networks achieve state-of-the-art performance across nearly all image classification tasks, their decisions are difficult to interpret. One approach that offers some level of interpretability by design is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Gamaleldin F. Elsayed , Simon Kornblith , Quoc V. Le

Shape completion, the problem of inferring the complete geometry of an object given a partial point cloud, is an important problem in robotics and computer vision. This paper proposes the Graph Attention Shape Completion Network (GASCN), a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Haojie Huang , Ziyi Yang , Robert Platt

Depth estimation is a traditional computer vision task, which plays a crucial role in understanding 3D scene geometry. Recently, deep-convolutional-neural-networks based methods have achieved promising results in the monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Yuru Chen , Haitao Zhao , Zhengwei Hu

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

The aim of this work is to introduce simplicial attention networks (SANs), i.e., novel neural architectures that operate on data defined on simplicial complexes leveraging masked self-attentional layers. Hinging on formal arguments from…

Machine Learning · Computer Science 2022-03-29 L. Giusti , C. Battiloro , P. Di Lorenzo , S. Sardellitti , S. Barbarossa

Segmenting medical images accurately and reliably is important for disease diagnosis and treatment. It is a challenging task because of the wide variety of objects' sizes, shapes, and scanning modalities. Recently, many convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-01-17 Ange Lou , Shuyue Guan , Hanseok Ko , Murray Loew

Visual attention brings significant progress for Convolution Neural Networks (CNNs) in various applications. In this paper, object-based attention in human visual cortex inspires us to introduce a mechanism for modification of activations…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Saeed Masoudnia , Melika Kheirieh , Abdol-Hossein Vahabie , Babak Nadjar Araabi

Convolutional neural networks (CNNs) have been shown to be state-of-the-art models for visual cortical neurons. Cortical neurons in the primary visual cortex are sensitive to contextual information mediated by extensive horizontal and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Isaac Lin , Tianye Wang , Shang Gao , Shiming Tang , Tai Sing Lee

Recently, a series of works in computer vision have shown promising results on various image and video understanding tasks using self-attention. However, due to the quadratic computational and memory complexities of self-attention, these…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Zhuoran Shen , Irwan Bello , Raviteja Vemulapalli , Xuhui Jia , Ching-Hui Chen

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang