English
Related papers

Related papers: Focal Attention Networks: optimising attention for…

200 papers

Deep learning achieves excellent performance in many domains, so we not only apply it to the navel orange semantic segmentation task to solve the two problems of distinguishing defect categories and identifying the stem end and blossom end,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Xiaoye Sun , Gongyan Li , Shaoyun Xu

The attention mechanism has been proven effective on various visual tasks in recent years. In the semantic segmentation task, the attention mechanism is applied in various methods, including the case of both Convolution Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zheng Yuan , Jie Zhang , Yude Wang , Shiguang Shan , Xilin Chen

Since radiologists have different training and clinical experiences, they may provide various segmentation annotations for a lung nodule. Conventional studies choose a single annotation as the learning target by default, but they waste…

Image and Video Processing · Electrical Eng. & Systems 2022-06-08 Han Yang , Lu Shen , Mengke Zhang , Qiuli Wang

The trade-off between feature representation power and spatial localization accuracy is crucial for the dense classification/semantic segmentation of aerial images. High-level features extracted from the late layers of a neural network are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Lei Ding , Hao Tang , Lorenzo Bruzzone

We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Xiaoqin Zhang , Yang Wang

The complexity of scene parsing grows with the number of object and scene classes, which is higher in unrestricted open scenes. The biggest challenge is to model the spatial relation between scene elements while succeeding in identifying…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Vivek Singh , Shailza Sharma , Fabio Cuzzolin

Attention plays a critical role in human visual experience. Furthermore, it has recently been demonstrated that attention can also play an important role in the context of applying artificial neural networks to a variety of tasks from…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Sergey Zagoruyko , Nikos Komodakis

Automated detection of curvilinear structures, e.g., blood vessels or nerve fibres, from medical and biomedical images is a crucial early step in automatic image interpretation associated to the management of many diseases. Precise…

Image and Video Processing · Electrical Eng. & Systems 2020-10-20 Lei Mou , Yitian Zhao , Huazhu Fu , Yonghuai Liu , Jun Cheng , Yalin Zheng , Pan Su , Jianlong Yang , Li Chen , Alejandro F Frang , Masahiro Akiba , Jiang Liu

Incorporating modern computer vision techniques into clinical protocols shows promise in improving skin lesion segmentation. The U-Net architecture has been a key model in this area, iteratively improved to address challenges arising from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Tariq M Khan , Dawn Lin , Shahzaib Iqbal , Erik Meijering

We present Attention Zoom, a modular and model-agnostic spatial attention mechanism designed to improve feature extraction in convolutional neural networks (CNNs). Unlike traditional attention approaches that require architecture-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Daniel DeAlcala , Aythami Morales , Julian Fierrez , Ruben Tolosana

Change detection, i.e. identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Foivos I. Diakogiannis , François Waldner , Peter Caccetta

Identifying biomarkers in medical images is vital for a wide range of biotech applications. However, recent Transformer and CNN based methods often struggle with variations in morphology and staining, which limits their feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Saad Wazir , Daeyoung Kim

To address the limitations of Transformer decoders in capturing edge details, recognizing local textures and modeling spatial continuity, this paper proposes a novel decoder framework specifically designed for medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Fan Zhang , Zhiwei Gu , Hua Wang

Multimodal learning, integrating histology images and genomics, promises to enhance precision oncology with comprehensive views at microscopic and molecular levels. However, existing methods may not sufficiently model the shared or…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Huahui Yi , Xiaofei Wang , Kang Li , Chao Li

Segmentation is a fundamental task in medical image analysis. However, most existing methods focus on primary region extraction and ignore edge information, which is useful for obtaining accurate segmentation. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Zhijie Zhang , Huazhu Fu , Hang Dai , Jianbing Shen , Yanwei Pang , Ling Shao

Motivated by the increasing popularity of attention mechanisms, we observe that popular convolutional (conv.) attention models like Squeeze-and-Excite (SE) and Convolutional Block Attention Module (CBAM) rely on expensive multi-layer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Majedaldein Almahasneh , Xianghua Xie , Adeline Paiement

The attention mechanism can refine the extracted feature maps and boost the classification performance of the deep network, which has become an essential technique in computer vision and natural language processing. However, the memory and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Rui Li , Shunyi Zheng , Chenxi Duan , Jianlin Su , Ce Zhang

Although convolutional neural networks (CNNs) are promoting the development of medical image semantic segmentation, the standard model still has some shortcomings. First, the feature mapping from the encoder and decoder sub-networks in the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yutong Cai , Yong Wang

In this paper, to remedy this deficiency, we propose a Linear Attention Mechanism which is approximate to dot-product attention with much less memory and computational costs. The efficient design makes the incorporation between attention…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Rui Li , Jianlin Su , Chenxi Duan , Shunyi Zheng

The AI-based assisted diagnosis programs have been widely investigated on medical ultrasound images. Complex scenario of ultrasound image, in which the coupled interference of internal and external factors is severe, brings a unique…

Image and Video Processing · Electrical Eng. & Systems 2025-10-15 Gongping Chen , Lei Zhao , Xiaotao Yin , Liang Cui , Jianxun Zhang , Yu Dai , Ningning Liu