English
Related papers

Related papers: TCSAFormer: Efficient Vision Transformer with Toke…

200 papers

Vision Transformer (ViT) has made significant advancements in computer vision, thanks to its token mixer's sophisticated ability to capture global dependencies between all tokens. However, the quadratic growth in computational demands as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Guoan Xu , Wenfeng Huang , Wenjing Jia , Jiamao Li , Guangwei Gao , Guo-Jun Qi

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature of convolution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Moein Heidari , Amirhossein Kazerouni , Milad Soltany , Reza Azad , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

Medical image recognition serves as a key way to aid in clinical diagnosis, enabling more accurate and timely identification of diseases and abnormalities. Vision transformer-based approaches have proven effective in handling various…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zunhui Xia , Hongxing Li , Libin Lan

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

Vision transformers have achieved great successes in many computer vision tasks. Most methods generate vision tokens by splitting an image into a regular and fixed grid and treating each cell as a token. However, not all regions are equally…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Wang Zeng , Sheng Jin , Wentao Liu , Chen Qian , Ping Luo , Wanli Ouyang , Xiaogang Wang

Vision Transformer and its variants have demonstrated great potential in various computer vision tasks. But conventional vision transformers often focus on global dependency at a coarse level, which suffer from a learning challenge on…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunhao Wang , Huixin Sun , Xiaodi Wang , Bin Zhang , Chao Li , Ying Xin , Baochang Zhang , Errui Ding , Shumin Han

Transformers are widely used in computer vision areas and have achieved remarkable success. Most state-of-the-art approaches split images into regular grids and represent each grid region with a vision token. However, fixed token…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wang Zeng , Sheng Jin , Lumin Xu , Wentao Liu , Chen Qian , Wanli Ouyang , Ping Luo , Xiaogang Wang

Recent Few-Shot Learning (FSL) methods put emphasis on generating a discriminative embedding features to precisely measure the similarity between support and query sets. Current CNN-based cross-attention approaches generate discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jinxiang Lai , Siqian Yang , Wenlong Wu , Tao Wu , Guannan Jiang , Xi Wang , Jun Liu , Bin-Bin Gao , Wei Zhang , Yuan Xie , Chengjie Wang

Medical image segmentation involves identifying and separating object instances in a medical image to delineate various tissues and structures, a task complicated by the significant variations in size, shape, and density of these features.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Sina Ghorbani Kolahi , Seyed Kamal Chaharsooghi , Toktam Khatibi , Afshin Bozorgpour , Reza Azad , Moein Heidari , Ilker Hacihaliloglu , Dorit Merhof

Medical segmentation plays an important role in clinical applications like radiation therapy and surgical guidance, but acquiring clinically acceptable results is difficult. In recent years, progress has been witnessed with the success of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Xin Zhang , Dongdong Meng , Sheng Li

Incorporating modern computer vision techniques into clinical protocols shows promise in improving skin lesion segmentation. The U-Net architecture has been a key model in this area, iteratively improved to address challenges arising from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Tariq M Khan , Dawn Lin , Shahzaib Iqbal , Erik Meijering

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra

Currently, convolutional neural networks (CNN) (e.g., U-Net) have become the de facto standard and attained immense success in medical image segmentation. However, as a downside, CNN based methods are a double-edged sword as they fail to…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Reza Azad , Moein Heidari , Yuli Wu , Dorit Merhof

This paper delves into the challenges and advancements in the field of medical image segmentation, particularly focusing on breast cancer diagnosis. The authors propose a novel Transformer-based segmentation model that addresses the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Weijie He , Runyuan Bao , Yiru Cang , Jianjun Wei , Yang Zhang , Jiacheng Hu

Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace the self-attention mechanism in vision transformers with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

Accurate segmentation of organs and lesions in medical images is essential for clinical applications including diagnosis, prognosis, and treatment planning. While Vision Transformers (ViTs) have shown impressive segmentation performance,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Jin Yang , Xiaobing Yu , Peijie Qiu

We present a method that achieves state-of-the-art results on challenging (few-shot) layout-to-image generation tasks by accurately modeling textures, structures and relationships contained in a complex scene. After compressing RGB images…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Zuopeng Yang , Daqing Liu , Chaoyue Wang , Jie Yang , Dacheng Tao

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Phuong-Nam Tran , Nhat Truong Pham , Duc Ngoc Minh Dang , Eui-Nam Huh , Choong Seon Hong