English
Related papers

Related papers: Multi-dimension Transformer with Attention-based F…

200 papers

Accurate and real-time surgical instrument segmentation is important in the endoscopic vision of robot-assisted surgery, and significant challenges are posed by frequent instrument-tissue contacts and continuous change of observation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Fangbo Qin , Shan Lin , Yangming Li , Randall A. Bly , Kris S. Moe , Blake Hannaford

Combining information from multi-view images is crucial to improve the performance and robustness of automated methods for disease diagnosis. However, due to the non-alignment characteristics of multi-view images, building correlation and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Di Liu , Yunhe Gao , Qilong Zhangli , Ligong Han , Xiaoxiao He , Zhaoyang Xia , Song Wen , Qi Chang , Zhennan Yan , Mu Zhou , Dimitris Metaxas

Transformer has achieved great success in computer vision, while how to split patches in an image remains a problem. Existing methods usually use a fixed-size patch embedding which might destroy the semantics of objects. To address this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Zhiyang Chen , Yousong Zhu , Chaoyang Zhao , Guosheng Hu , Wei Zeng , Jinqiao Wang , Ming Tang

Transformer-based methods have shown impressive performance in image restoration tasks, such as image super-resolution and denoising. However, we find that these networks can only utilize a limited spatial range of input information through…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiangyu Chen , Xintao Wang , Wenlong Zhang , Xiangtao Kong , Yu Qiao , Jiantao Zhou , Chao Dong

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Although purely transformer-based architectures showed promising performance in many computer vision tasks, many hybrid models consisting of CNN and transformer blocks are introduced to fit more specialized tasks. Nevertheless, despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yousef Yeganeh , Azade Farshad , Peter Weinberger , Seyed-Ahmad Ahmadi , Ehsan Adeli , Nassir Navab

We propose Masked-Attention Transformers for Surgical Instrument Segmentation (MATIS), a two-stage, fully transformer-based method that leverages modern pixel-wise attention mechanisms for instrument segmentation. MATIS exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Nicolás Ayobi , Alejandra Pérez-Rondón , Santiago Rodríguez , Pablo Arbeláez

Although transformer has achieved great progress on computer vision tasks, the scale variation in dense image prediction is still the key challenge. Few effective multi-scale techniques are applied in transformer and there are two main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Zekun Li , Yufan Liu , Bing Li , Weiming Hu , Kebin Wu , Pei Wang

Medical image segmentation is a crucial task in the field of medical image analysis. Harmonizing the convolution and multi-head self-attention mechanism is a recent research focus in this field, with various combination methods proposed.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Lichao Wang , Jiahao Huang , Xiaodan Xing , Guang Yang

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning, where accurate boundary delineation is essential for precise lesion localization, organ identification, and quantitative assessment. In recent…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Peiting Tian , Xi Chen , Haixia Bi , Fan Li

Precise segmentation of medical images is fundamental for extracting critical clinical information, which plays a pivotal role in enhancing the accuracy of diagnoses, formulating effective treatment plans, and improving patient outcomes.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Jintong Hu , Siyan Chen , Zhiyi Pan , Sen Zeng , Wenming Yang

Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However, many existing vision transformer (ViT) works simply inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Leijie Wu , Song Guo , Yaohong Ding , Junxiao Wang , Wenchao Xu , Richard Yida Xu , Jie Zhang

Ophthalmic image segmentation serves as a critical foundation for ocular disease diagnosis. Although fully convolutional neural networks (CNNs) are commonly employed for segmentation, they are constrained by inductive biases and face…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Zunjie Xiao , Xiaoqing Zhang , Risa Higashita , Jiang Liu

Deep neural networks are commonly used for automated medical image segmentation, but models will frequently struggle to generalize well across different imaging modalities. This issue is particularly problematic due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Malo de Boisredon , Eugene Vorontsov , William Trung Le , Samuel Kadoury

Manually inspecting polyps from a colonoscopy for colorectal cancer or performing a biopsy on skin lesions for skin cancer are time-consuming, laborious, and complex procedures. Automatic medical image segmentation aims to expedite this…

Image and Video Processing · Electrical Eng. & Systems 2023-06-27 Akib Mohammed Khan , Alif Ashrafee , Fahim Shahriar Khan , Md. Bakhtiar Hasan , Md. Hasanul Kabir

Objects with complex structures pose significant challenges to existing instance segmentation methods that rely on boundary or affinity maps, which are vulnerable to small errors around contacting pixels that cause noticeable connectivity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zudi Lin , Donglai Wei , Aarush Gupta , Xingyu Liu , Deqing Sun , Hanspeter Pfister

Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentation(FSS) has the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-27 Yao Huang , Jianming Liu

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

An efficient and effective decoding mechanism is crucial in medical image segmentation, especially in scenarios with limited computational resources. However, these decoding mechanisms usually come with high computational costs. To address…

Image and Video Processing · Electrical Eng. & Systems 2024-05-14 Md Mostafijur Rahman , Mustafa Munir , Radu Marculescu

Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Zhenkun Lu , Chaoyin She , Wei Wang , Qinghua Huang