中文
相关论文

相关论文: Focal Attention Networks: optimising attention for…

200 篇论文

Self-attention networks have shown remarkable progress in computer vision tasks such as image classification. The main benefit of the self-attention mechanism is the ability to capture long-range feature interactions in attention-maps.…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Andong Tan , Duc Tam Nguyen , Maximilian Dax , Matthias Nießner , Thomas Brox

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

图像与视频处理 · 电气工程与系统科学 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang

Lung segmentation in chest X-ray images is a critical task in medical image analysis, enabling accurate diagnosis and treatment of various lung diseases. In this paper, we propose a novel approach for lung segmentation by integrating…

图像与视频处理 · 电气工程与系统科学 2024-05-22 Mohammad Ali Labbaf Khaniki , Nazanin Mahjourian , Mohammad Manthouri

Accurately segmenting blood vessels in retinal fundus images is crucial in the early screening, diagnosing, and evaluating some ocular diseases, yet it poses a nontrivial uncertainty for the segmentation task due to various factors such as…

图像与视频处理 · 电气工程与系统科学 2023-06-29 Yuanyuan Peng , Pengpeng Luan , Zixu Zhang

Spatial attention has been introduced to convolutional neural networks (CNNs) for improving both their performance and interpretability in visual tasks including image classification. The essence of the spatial attention is to learn a…

图像与视频处理 · 电气工程与系统科学 2020-08-03 Linchuan Xu , Jun Huang , Atsushi Nitanda , Ryo Asaoka , Kenji Yamanishi

This paper delves into the challenges and advancements in the field of medical image segmentation, particularly focusing on breast cancer diagnosis. The authors propose a novel Transformer-based segmentation model that addresses the…

图像与视频处理 · 电气工程与系统科学 2024-09-20 Weijie He , Runyuan Bao , Yiru Cang , Jianjun Wei , Yang Zhang , Jiacheng Hu

The quadratic computation complexity of self-attention has been a persistent challenge when applying Transformer models to vision tasks. Linear attention, on the other hand, offers a much more efficient alternative with its linear…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Dongchen Han , Xuran Pan , Yizeng Han , Shiji Song , Gao Huang

Recent studies on mobile network design have demonstrated the remarkable effectiveness of channel attention (e.g., the Squeeze-and-Excitation attention) for lifting model performance, but they generally neglect the positional information,…

计算机视觉与模式识别 · 计算机科学 2021-03-05 Qibin Hou , Daquan Zhou , Jiashi Feng

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

计算与语言 · 计算机科学 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

Attention mechanism of late has been quite popular in the computer vision community. A lot of work has been done to improve the performance of the network, although almost always it results in increased computational complexity. In this…

计算机视觉与模式识别 · 计算机科学 2021-08-12 Abhinav Sagar

Deep learning-based medical image segmentation technology aims at automatic recognizing and annotating objects on the medical image. Non-local attention and feature learning by multi-scale methods are widely used to model network, which…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Bo Wang , Lei Wang , Junyang Chen , Zhenghua Xu , Thomas Lukasiewicz , Zhigang Fu

Segmentation of macro and microvascular structures in fundoscopic retinal images plays a crucial role in the detection of multiple retinal and systemic diseases, yet it is a difficult problem to solve. Most neural network approaches face…

图像与视频处理 · 电气工程与系统科学 2022-06-30 Shikhar Mohan , Saumik Bhattacharya , Sayantari Ghosh

Attention mechanisms, which enable a neural network to accurately focus on all the relevant elements of the input, have become an essential component to improve the performance of deep neural networks. There are mainly two attention…

计算机视觉与模式识别 · 计算机科学 2021-02-02 Qing-Long Zhang Yu-Bin Yang

In this paper, we present a so-called interlaced sparse self-attention approach to improve the efficiency of the \emph{self-attention} mechanism for semantic segmentation. The main idea is that we factorize the dense affinity matrix as the…

计算机视觉与模式识别 · 计算机科学 2019-07-31 Lang Huang , Yuhui Yuan , Jianyuan Guo , Chao Zhang , Xilin Chen , Jingdong Wang

Semantic segmentation of remote sensing images plays an important role in a wide range of applications including land resource management, biosphere monitoring and urban planning. Although the accuracy of semantic segmentation in remote…

图像与视频处理 · 电气工程与系统科学 2021-09-21 Rui Li , Shunyi Zheng , Chenxi Duan , Ce Zhang , Jianlin Su , P. M. Atkinson

While self-attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2020-07-13 Xu Ma , Jingda Guo , Sihai Tang , Zhinan Qiao , Qi Chen , Qing Yang , Song Fu

In convolutional neural network based medical image segmentation, the periphery of foreground regions representing malignant tissues may be disproportionately assigned as belonging to the background class of healthy tissues…

计算机视觉与模式识别 · 计算机科学 2020-08-10 Mou-Cheng Xu , Neil P. Oxtoby , Daniel C. Alexander , Joseph Jacob

Purpose Medical imaging diagnosis faces challenges, including low-resolution images due to machine artifacts and patient movement. This paper presents the Frequency-Guided U-Net (GFNet), a novel approach for medical image segmentation that…

图像与视频处理 · 电气工程与系统科学 2024-05-03 Haytham Al Ewaidat , Youness El Brag , Ahmad Wajeeh Yousef E'layan , Ali Almakhadmeh

Super-resolving medical images can help physicians in providing more accurate diagnostics. In many situations, computed tomography (CT) or magnetic resonance imaging (MRI) techniques capture several scans (modes) during a single…

The so-called "attention" is an efficient mechanism to improve the performance of convolutional neural networks. It uses contextual information to recalibrate the input to strengthen the propagation of informative features. However, the…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Yu Xue , Ziming Yuan , Ferrante Neri