English
Related papers

Related papers: Beyond Self-Attention: Deformable Large Kernel Att…

200 papers

Vision Transformers are at the heart of the current surge of interest in foundation models for histopathology. They process images by breaking them into smaller patches following a regular grid, regardless of their content. Yet, not all…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Clément Grisi , Geert Litjens , Jeroen van der Laak

Automatic extraction of liver and tumor from CT volumes is a challenging task due to their heterogeneous and diffusive shapes. Recently, 2D and 3D deep convolutional neural networks have become popular in medical image segmentation tasks…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Qiangguo Jin , Zhaopeng Meng , Changming Sun , Leyi Wei , Ran Su

Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoxiao Wu , Xiaowei Chen , Zhenguo Gao , Shulei Qu , Yuanyuan Qiu

Breast ultrasound imaging is a valuable tool for early breast cancer detection, but automated tumor segmentation is challenging due to inherent noise, variations in scale of lesions, and fuzzy boundaries. To address these challenges, we…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Muhammad Azeem Aslam , Asim Naveed , Nisar Ahmed

Convolutional neural networks (CNNs) have been not only widespread but also achieved noticeable results on numerous applications including image classification, restoration, and generation. Although the weight-sharing property of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Min-Cheol Sagong , Yoon-Jae Yeo , Seung-Won Jung , Sung-Jea Ko

Transformer-based encoder-decoder models have achieved remarkable success in image-to-image transfer tasks, particularly in image restoration. However, their high computational complexity-manifested in elevated FLOPs and parameter…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Yongheng Zhang , Danfeng Yan

Medical image segmentation plays a pivotal role in automated diagnostic and treatment planning systems. In this work, we present DAUNet, a novel lightweight UNet variant that integrates Deformable V2 Convolutions and Parameter-Free…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Adnan Munir , Muhammad Shahid Jabbar , Shujaat Khan

Convolutional neural networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they have not demonstrated sufficiently accurate and robust results for clinical use. In addition, they are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Guotai Wang , Wenqi Li , Maria A. Zuluaga , Rosalind Pratt , Premal A. Patel , Michael Aertsen , Tom Doel , Anna L. David , Jan Deprest , Sebastien Ourselin , Tom Vercauteren

Self-attention mechanism has been a key factor in the recent progress of Vision Transformer (ViT), which enables adaptive feature extraction from global contexts. However, existing self-attention methods either adopt sparse global attention…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Xuran Pan , Tianzhu Ye , Zhuofan Xia , Shiji Song , Gao Huang

Medical image segmentation plays an important role in various clinical applications; however, existing deep learning models face trade-offs between efficiency and accuracy. Convolutional Neural Networks (CNNs) capture local details well but…

Image and Video Processing · Electrical Eng. & Systems 2025-10-20 Saqib Qamar , Mohd Fazil , Parvez Ahmad , Shakir Khan , Abu Taha Zamani

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

Lumbar disc degeneration, a progressive structural wear and tear of lumbar intervertebral disc, is regarded as an essential role on low back pain, a significant global health concern. Automated lumbar spine geometry reconstruction from MR…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Linchen Qian , Jiasong Chen , Linhai Ma , Timur Urakov , Weiyong Gu , Liang Liang

Semantic segmentation tasks naturally require high-resolution information for pixel-wise segmentation and global context information for class prediction. While existing vision transformers demonstrate promising performance, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yu-Huan Wu , Shi-Chen Zhang , Yun Liu , Le Zhang , Xin Zhan , Daquan Zhou , Jiashi Feng , Ming-Ming Cheng , Liangli Zhen

Transformer-based large language models (LLMs) exhibit impressive performance in generative tasks but also introduce significant challenges in real-world serving due to inefficient use of the expensive, computation-optimized accelerators.…

Machine Learning · Computer Science 2025-04-11 Shaoyuan Chen , Wencong Xiao , Yutong Lin , Mingxing Zhang , Yingdi Shan , Jinlei Jiang , Kang Chen , Yongwei Wu

Hyperspectral imagery is rich in spatial and spectral information. Using 3D-CNN can simultaneously acquire features of spatial and spectral dimensions to facilitate classification of features, but hyperspectral image information spectral…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Guandong Li , Chunju Zhang

Transformer-based models have made remarkable progress in image restoration (IR) tasks. However, the quadratic complexity of self-attention in Transformer hinders its applicability to high-resolution images. Existing methods mitigate this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Yuang Ai , Huaibo Huang , Tao Wu , Qihang Fan , Ran He

Segmentation of certain hollow organs, such as the bladder, is especially hard to automate due to their complex geometry, vague intensity gradients in the soft tissues, and a tedious manual process of the data annotation routine. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Elizaveta Lazareva , Oleg Rogov , Olga Shegai , Denis Larionov , Dmitry V. Dylov

Background and Objective: In the realm of ophthalmic imaging, accurate vascular segmentation is paramount for diagnosing and managing various eye diseases. Contemporary deep learning-based vascular segmentation models rival human accuracy…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Zhihao Zhao , Yinzheng Zhao , Junjie Yang , Quanmin Liang , Daniel Zapp , Kai Huang , M. Ali Nasseri

Transformers have been extensively studied in medical image segmentation to build pairwise long-range dependence. Yet, relatively limited well-annotated medical image data makes transformers struggle to extract diverse global features,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-13 Xian Lin , Zengqiang Yan , Xianbo Deng , Chuansheng Zheng , Li Yu

Characteristics such as low contrast and significant organ shape variations are often exhibited in medical images. The improvement of segmentation performance in medical imaging is limited by the generally insufficient adaptive capabilities…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Hejun Huang , Zuguo Chen , Ying Zou , Ming Lu , Chaoyang Chen