English
Related papers

Related papers: Hard-Attention for Scalable Image Classification

200 papers

The encoder-decoder network is widely used to learn deep feature representations from pixel-wise annotations in biomedical image analysis. Under this structure, the performance profoundly relies on the effectiveness of feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Weinan Song , Yuan Liang , Jiawei Yang , Kun Wang , Lei He

We present a novel high frequency residual learning framework, which leads to a highly efficient multi-scale network (MSNet) architecture for mobile and embedded vision problems. The architecture utilizes two networks: a low resolution…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Bowen Cheng , Rong Xiao , Jianfeng Wang , Thomas Huang , Lei Zhang

Recently, very deep convolutional neural networks (CNNs) have shown outstanding performance in object recognition and have also been the first choice for dense classification problems such as semantic segmentation. However, repeated…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Guosheng Lin , Anton Milan , Chunhua Shen , Ian Reid

Deep neural networks demonstrate to have a high performance on image classification tasks while being more difficult to train. Due to the complexity and vanishing gradient problem, it normally takes a lot of time and more computational…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Mohammad Sadegh Ebrahimi , Hossein Karkeh Abadi

Thresholding--the pruning of nodes or edges based on their properties or weights--is an essential preprocessing tool for extracting interpretable structure from complex network data, yet existing methods face several key limitations.…

Social and Information Networks · Computer Science 2025-10-07 Adam Schroeder , Russell Funk , Jingyi Guan , Taylor Okonek , Lori Ziegelmeier

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

Incorporating multi-scale features in fully convolutional neural networks (FCNs) has been a key element to achieving state-of-the-art performance on semantic image segmentation. One common way to extract multi-scale features is to feed…

Computer Vision and Pattern Recognition · Computer Science 2016-06-03 Liang-Chieh Chen , Yi Yang , Jiang Wang , Wei Xu , Alan L. Yuille

We propose a novel architecture for object classification, called Self-Attention Capsule Networks (SACN). SACN is the first model that incorporates the Self-Attention mechanism as an integral layer within the Capsule Network (CapsNet).…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Assaf Hoogi , Brian Wilcox , Yachee Gupta , Daniel L. Rubin

This paper has proposed a new baseline deep learning model of more benefits for image classification. Different from the convolutional neural network(CNN) practice where filters are trained by back propagation to represent different…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Yifei Li , Kuangyan Song , Yiming Sun , Liao Zhu

Although deep convolutional neural networks (CNNs) have obtained outstanding performance in image superresolution (SR), their computational cost increases geometrically as CNN models get deeper and wider. Meanwhile, the features of…

Image and Video Processing · Electrical Eng. & Systems 2019-12-02 Seongmin Hwang , Gwanghuyn Yu , Cheolkon Jung , Jinyoung Kim

Applying convolutional neural networks to large images is computationally expensive because the amount of computation scales linearly with the number of image pixels. We present a novel recurrent neural network model that is capable of…

Machine Learning · Computer Science 2014-06-25 Volodymyr Mnih , Nicolas Heess , Alex Graves , Koray Kavukcuoglu

Whole-Slide Imaging allows for the capturing and digitization of high-resolution images of histological specimen. An automated analysis of such images using deep learning models is therefore of high demand. The transformer architecture has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Firas Khader , Jakob Nikolas Kather , Tianyu Han , Sven Nebelung , Christiane Kuhl , Johannes Stegmaier , Daniel Truhn

Microscopic image segmentation is a challenging task, wherein the objective is to assign semantic labels to each pixel in a given microscopic image. While convolutional neural networks (CNNs) form the foundation of many existing frameworks,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Mustansar Fiaz , Moein Heidari , Rao Muhammad Anwer , Hisham Cholakkal

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Recent non-local self-attention methods have proven to be effective in capturing long-range dependencies for semantic segmentation. These methods usually form a similarity map of RC*C (by compressing spatial dimensions) or RHW*HW (by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Qi Song , Jie Li , Chenghong Li , Hao Guo , Rui Huang

Humans can effectively find salient regions in complex scenes. Self-attention mechanisms were introduced into Computer Vision (CV) to achieve this. Attention Augmented Convolutional Network (AANet) is a mixture of convolution and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Runqing Zhang , Tianshu Zhu

In recent years, hypercomplex-inspired neural networks (HCNNs) have been used to improve deep learning architectures due to their ability to enable channel-based weight sharing, treat colors as a single entity, and improve representational…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Nazmul Shahadat , Anthony S. Maida

Heterogeneous network data with rich nodal information become increasingly prevalent across multidisciplinary research, yet accurately modeling complex nodal heterogeneity and simultaneously selecting influential nodal attributes remains an…

Methodology · Statistics 2026-04-14 Zhaoyu Xing , Xiufan Yu

With the continuous development of neural networks for computer vision tasks, more and more network architectures have achieved outstanding success. As one of the most advanced neural network architectures, DenseNet shortcuts all feature…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Rui-Yang Ju , Ting-Yu Lin , Jia-Hao Jian , Jen-Shiun Chiang , Wei-Bin Yang