English
Related papers

Related papers: Swin3D: A Pretrained Transformer Backbone for 3D I…

200 papers

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ze Liu , Yutong Lin , Yue Cao , Han Hu , Yixuan Wei , Zheng Zhang , Stephen Lin , Baining Guo

Vision transformers have attracted much attention from computer vision researchers as they are not restricted to the spatial inductive bias of ConvNets. However, although Transformer-based backbones have achieved much progress on ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Yizhou Yu

Spiking Neural Networks (SNNs) provide an energy-efficient way to extract 3D spatio-temporal features. Point clouds are sparse 3D spatial data, which suggests that SNNs should be well-suited for processing them. However, when applying SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Xuerui Qiu , Man Yao , Jieyuan Zhang , Yuhong Chou , Ning Qiao , Shibo Zhou , Bo Xu , Guoqi Li

We propose spatial semantic embedding network (SSEN), a simple, yet efficient algorithm for 3D instance segmentation using deep metric learning. The raw 3D reconstruction of an indoor environment suffers from occlusions, noise, and is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Dongsu Zhang , Junha Chun , Sang Kyun Cha , Young Min Kim

This paper proposes the first pure Transformer structure inversion network called SwinStyleformer, which can compensate for the shortcomings of the CNNs inversion framework by handling long-range dependencies and learning the global…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawei Mao , Guangyi Zhao , Xuesong Yin , Yuanqi Chang

We present Token-UNet, adopting the TokenLearner and TokenFuser modules to encase Transformers into UNets. While Transformers have enabled global interactions among input elements in medical imaging, current computational challenges hinder…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Louis Fabrice Tshimanga , Andrea Zanola , Federico Del Pup , Manfredo Atzori

Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Ailiang Lin , Bingzhi Chen , Jiayu Xu , Zheng Zhang , Guangming Lu

Semantic segmentation of brain tumors is a fundamental medical image analysis task involving multiple MRI imaging modalities that can assist clinicians in diagnosing the patient and successively studying the progression of the malignant…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Ali Hatamizadeh , Vishwesh Nath , Yucheng Tang , Dong Yang , Holger Roth , Daguang Xu

Automated segmentation of the vertebral column in Computed Tomography (CT) scans is a prerequisite for pathological assessment and surgical planning. However, state-of-the-art methods, particularly those based on Transformers or large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 K S Nithurshen , Saurabh J. Shigwan

This paper presents an efficient multi-scale vision Transformer, called ResT, that capably served as a general-purpose backbone for image recognition. Unlike existing Transformer methods, which employ standard Transformer blocks to tackle…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Qinglong Zhang , Yubin Yang

This study proposes a 3D semantic segmentation method for the spine based on the improved SwinUNETR to improve segmentation accuracy and robustness. Aiming at the complex anatomical structure of spinal images, this paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yanlin Xiang , Qingyuan He , Ting Xu , Ran Hao , Jiacheng Hu , Hanchao Zhang

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Mingrui Ma , Tao Wang , Lei Song , Weijie Wang , Guixia Liu

Accurately estimating the 6D pose of objects is crucial for many applications, such as robotic grasping, autonomous driving, and augmented reality. However, this task becomes more challenging in poor lighting conditions or when dealing with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhujun Li , Ioannis Stamos

Arbitrary text appearance poses a great challenge in scene text recognition tasks. Existing works mostly handle with the problem in consideration of the shape distortion, including perspective distortions, line curvature or other style…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chengwei Zhang , Yunlu Xu , Zhanzhan Cheng , Shiliang Pu , Yi Niu , Fei Wu , Futai Zou

Compressed Image Super-resolution has achieved great attention in recent years, where images are degraded with compression artifacts and low-resolution artifacts. Since the complex hybrid distortions, it is hard to restore the distorted…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Bingchen Li , Xin Li , Yiting Lu , Sen Liu , Ruoyu Feng , Zhibo Chen

Recently, Transformer-based architectures have been explored for speaker embedding extraction. Although the Transformer employs the self-attention mechanism to efficiently model the global interaction between token embeddings, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Mufan Sang , Yong Zhao , Gang Liu , John H. L. Hansen , Jian Wu

Incorporating various mass shapes and sizes in training deep learning architectures has made breast mass segmentation challenging. Moreover, manual segmentation of masses of irregular shapes is time-consuming and error-prone. Though Deep…

Image and Video Processing · Electrical Eng. & Systems 2022-11-17 Sharif Amit Kamran , Khondker Fariha Hossain , Alireza Tavakkoli , George Bebis , Sal Baker

Instance segmentation performance in remote sensing images (RSIs) is significantly affected by two issues: how to extract accurate boundaries of objects from remote imaging through the dynamic atmosphere, and how to integrate the mutual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Dawen Yu , Shunping Ji

Semantic Segmentation is a crucial component in the perception systems of many applications, such as robotics and autonomous driving that rely on accurate environmental perception and understanding. In literature, several approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Ran Cheng , Ryan Razani , Yuan Ren , Liu Bingbing