English
Related papers

Related papers: Efficient Folded Attention for 3D Medical Image Re…

200 papers

Multi-scale deformable attention (MSDA) is a flexible and powerful feature extraction mechanism for visual tasks, but its random-access grid sampling strategy poses significant optimization challenges, especially on domain-specific…

Performance · Computer Science 2025-05-21 Chenghuan Huang , Zhigeng Xu , Chong Sun , Chen Li , Ziyang Ma

Processing 3D data efficiently has always been a challenge. Spatial operations on large-scale point clouds, stored as sparse data, require extra cost. Attracted by the success of transformers, researchers are using multi-head attention for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Mahdi Saleh , Yige Wang , Nassir Navab , Benjamin Busam , Federico Tombari

Deep neural networks face several challenges in hyperspectral image classification, including insufficient utilization of joint spatial-spectral information, gradient vanishing with increasing depth, and overfitting. To enhance feature…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guandong Li , Mengxia Ye

Automatic medical image segmentation has wide applications for disease diagnosing. However, it is much more challenging than natural optical image segmentation due to the high-resolution of medical images and the corresponding huge…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Ziqiang Li , Rentuo Tao , Qianrun Wu , Bin Li

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

In this paper, we propose a computational efficient end-to-end training deep neural network (CEDNN) model and spatial attention maps based on difference images. Firstly, the difference image is generated by image processing. Then five…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jing Chen , Chenhui Wang , Kejun Wang , Meichen Liu

The accurate segmentation of multiple types of lesions from adjacent tissues in medical images is significant in clinical practice. Convolutional neural networks (CNNs) based on the coarse-to-fine strategy have been widely used in this…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Xiangyu Zhao , Peng Zhang , Fan Song , Chenbin Ma , Guangda Fan , Yangyang Sun , Youdan Feng , Guanglei Zhang

Current state-of-the-art medical image segmentation methods prioritize accuracy but often at the expense of increased computational demands and larger model sizes. Applying these large-scale models to the relatively limited scale of medical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jiahui Zhong , Wenhong Tian , Yuanlun Xie , Zhijia Liu , Jie Ou , Taoran Tian , Lei Zhang

The AI-based assisted diagnosis programs have been widely investigated on medical ultrasound images. Complex scenario of ultrasound image, in which the coupled interference of internal and external factors is severe, brings a unique…

Image and Video Processing · Electrical Eng. & Systems 2025-10-15 Gongping Chen , Lei Zhao , Xiaotao Yin , Liang Cui , Jianxun Zhang , Yu Dai , Ningning Liu

Deformable image registration is crucial for aligning medical images in a nonlinear fashion across different modalities, allowing for precise spatial correspondence between varying anatomical structures. This paper presents NestedMorph, a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Gurucharan Marthi Krishna Kumar , Janine Mendola , Amir Shmuel

Diffusion models have recently gained state of the art performance on many image generation tasks. However, most models require significant computational resources to achieve this. This becomes apparent in the application of medical image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Karan Jain , Mohammad Nayeem Teli

Remarkable effectiveness of the channel or spatial attention mechanisms for producing more discernible feature representation are illustrated in various computer vision tasks. However, modeling the cross-channel relationships with channel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Daliang Ouyang , Su He , Guozhong Zhang , Mingzhu Luo , Huaiyong Guo , Jian Zhan , Zhijie Huang

Transformer-based methods have demonstrated impressive results in medical image restoration, attributed to the multi-head self-attention (MSA) mechanism in the spatial dimension. However, the majority of existing Transformers conduct…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Zhiwen Yang , Haowei Chen , Ziniu Qian , Yang Zhou , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

The Segment Anything Model (SAM) has advanced interactive segmentation but is limited by the high computational cost on high-resolution images. This requires downsampling to meet GPU constraints, sacrificing the fine-grained details needed…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 You Huang , Wenbin Lai , Jiayi Ji , Liujuan Cao , Shengchuan Zhang , Rongrong Ji

Multi-scale deformable attention (MSDeformAttn) has emerged as a key mechanism in various vision tasks, demonstrating explicit superiority attributed to multi-scale grid-sampling. However, this newly introduced operator incurs irregular…

Hardware Architecture · Computer Science 2024-03-19 Yansong Xu , Dongxu Lyu , Zhenyu Li , Zilong Wang , Yuzhou Chen , Gang Wang , Zhican Wang , Haomin Li , Guanghui He

Deep learning-based medical image segmentation technology aims at automatic recognizing and annotating objects on the medical image. Non-local attention and feature learning by multi-scale methods are widely used to model network, which…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Bo Wang , Lei Wang , Junyang Chen , Zhenghua Xu , Thomas Lukasiewicz , Zhigang Fu

Accurate and real-time surgical instrument segmentation is important in the endoscopic vision of robot-assisted surgery, and significant challenges are posed by frequent instrument-tissue contacts and continuous change of observation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Fangbo Qin , Shan Lin , Yangming Li , Randall A. Bly , Kris S. Moe , Blake Hannaford

In recent years, attention mechanisms have been exploited in single image super-resolution (SISR), achieving impressive reconstruction results. However, these advancements are still limited by the reliance on simple training strategies and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yuxuan Jiang , Chengxi Zeng , Siyue Teng , Fan Zhang , Xiaoqing Zhu , Joel Sole , David Bull

Combining information from multi-view images is crucial to improve the performance and robustness of automated methods for disease diagnosis. However, due to the non-alignment characteristics of multi-view images, building correlation and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Di Liu , Yunhe Gao , Qilong Zhangli , Ligong Han , Xiaoxiao He , Zhaoyang Xia , Song Wen , Qi Chang , Zhennan Yan , Mu Zhou , Dimitris Metaxas

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil