English
Related papers

Related papers: Beyond Self-Attention: Deformable Large Kernel Att…

200 papers

Automatic segmentation of multiple organs and tumors from 3D medical images such as magnetic resonance imaging (MRI) and computed tomography (CT) scans using deep learning methods can aid in diagnosing and treating cancer. However, organs…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Hao Li , Yang Nan , Javier Del Ser , Guang Yang

Visual Attention Networks (VAN) with Large Kernel Attention (LKA) modules have been shown to provide remarkable performance, that surpasses Vision Transformers (ViTs), on a range of vision-based tasks. However, the depth-wise convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Kin Wai Lau , Lai-Man Po , Yasar Abbas Ur Rehman

Attention mechanisms have significantly advanced visual models by capturing global context effectively. However, their reliance on large-scale datasets and substantial computational resources poses challenges in data-scarce and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Chenghao Li , Chaoning Zhang , Boheng Zeng , Yi Lu , Pengbo Shi , Qingzi Chen , Jirui Liu , Lingyun Zhu , Yang Yang , Heng Tao Shen

Accurate medical image segmentation is of utmost importance for enabling automated clinical decision procedures. However, prevailing supervised deep learning approaches for medical image segmentation encounter significant challenges due to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Sanaz Karimijafarbigloo , Reza Azad , Amirhossein Kazerouni , Yury Velichko , Ulas Bagci , Dorit Merhof

While originally designed for natural language processing tasks, the self-attention mechanism has recently taken various computer vision areas by storm. However, the 2D nature of images brings three challenges for applying self-attention in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Meng-Hao Guo , Cheng-Ze Lu , Zheng-Ning Liu , Ming-Ming Cheng , Shi-Min Hu

Convolutional neural networks (CNNs) and vision transformers (ViTs) are widely employed for medical image segmentation, but they are still challenged by their intrinsic characteristics. CNNs are limited from capturing varying-scaled…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Deep learning-based medical image segmentation technology aims at automatic recognizing and annotating objects on the medical image. Non-local attention and feature learning by multi-scale methods are widely used to model network, which…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bo Wang , Lei Wang , Junyang Chen , Zhenghua Xu , Thomas Lukasiewicz , Zhigang Fu

Brain tumor segmentation models have aided diagnosis in recent years. However, they face MRI complexity and variability challenges, including irregular shapes and unclear boundaries, leading to noise, misclassification, and incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruoxin Wang , Tianyi Tang , Haiming Du , Yuxuan Cheng , Yu Wang , Lingjie Yang , Xiaohui Duan , Yunfang Yu , Yu Zhou , Donglong Chen

Hierarchical transformers have achieved significant success in medical image segmentation due to their large receptive field and capabilities of effectively leveraging global long-range contextual information. Convolutional neural networks…

Image and Video Processing · Electrical Eng. & Systems 2024-10-18 Jin Yang , Peijie Qiu , Yichi Zhang , Daniel S. Marcus , Aristeidis Sotiras

Despite the notable success of current Parameter-Efficient Fine-Tuning (PEFT) methods across various domains, their effectiveness on medical datasets falls short of expectations. This limitation arises from two key factors: (1) medical…

Computational Engineering, Finance, and Science · Computer Science 2025-09-03 Ziquan Zhu , Si-Yuan Lu , Tianjin Huang , Lu Liu , Zhe Liu

Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Yufeng Jiang , Zongxi Li , Xiangyan Chen , Haoran Xie , Jing Cai

Deep neural networks face several challenges in hyperspectral image classification, including insufficient utilization of joint spatial-spectral information, gradient vanishing with increasing depth, and overfitting. To enhance feature…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guandong Li , Mengxia Ye

The multi-scale receptive field and large kernel attention (LKA) module have been shown to significantly improve performance in the lightweight image super-resolution task. However, existing lightweight super-resolution (SR) methods seldom…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Fangwei Hao , Jiesheng Wu , Haotian Lu , Ji Du , Jing Xu , Xiaoxuan Xu

Multi-organ segmentation is one of most successful applications of deep learning in medical image analysis. Deep convolutional neural nets (CNNs) have shown great promise in achieving clinically applicable image segmentation performance on…

Image and Video Processing · Electrical Eng. & Systems 2020-12-18 Hao Tang , Xingwei Liu , Kun Han , Shanlin Sun , Narisu Bai , Xuming Chen , Huang Qian , Yong Liu , Xiaohui Xie

Semantic segmentation of remote sensing images is a fundamental task in geospatial research. However, widely used Convolutional Neural Networks (CNNs) and Transformers have notable drawbacks: CNNs may be limited by insufficient remote…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xuezhi Xiang , Yibo Ning , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Transformer-based neural networks have surpassed promising performance on many biomedical image segmentation tasks due to a better global information modeling from the self-attention mechanism. However, most methods are still designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Zheyuan Zhang , Ulas Bagci

Super-resolving medical images can help physicians in providing more accurate diagnostics. In many situations, computed tomography (CT) or magnetic resonance imaging (MRI) techniques capture several scans (modes) during a single…

Medical image segmentation requires models that preserve fine anatomical boundaries while remaining practical for clinical deployment. Transformers capture long-range dependencies but incur quadratic attention cost, whereas CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Hongbo Zheng , Afshin Bozorgpour , Dorit Merhof , Minjia Zhang

Proper segmentation of organs-at-risk is important for radiation therapy, surgical planning, and diagnostic decision-making in medical image analysis. While deep learning-based segmentation architectures have made significant progress, they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Riad Hassan , M. Rubaiyat Hossain Mondal , Sheikh Iqbal Ahamed , Fahad Mostafa , Md Mostafijur Rahman

Real-time semantic segmentation presents the dual challenge of designing efficient architectures that capture large receptive fields for semantic understanding while also refining detailed contours. Vision transformers model long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Ping-Mao Huang , I-Tien Chao , Ping-Chia Huang , Jia-Wei Liao , Yung-Yu Chuang
‹ Prev 1 2 3 10 Next ›