English
Related papers

Related papers: iSegFormer: Interactive Segmentation via Transform…

200 papers

Leveraging information across diverse modalities is known to enhance performance on multimodal segmentation tasks. However, effectively fusing information from different modalities remains challenging due to the unique characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qingqiao Hu , Daoan Zhang , Jiebo Luo , Zhenyu Gong , Benedikt Wiestler , Jianguo Zhang , Hongwei Bran Li

Transformers have been extensively studied in medical image segmentation to build pairwise long-range dependence. Yet, relatively limited well-annotated medical image data makes transformers struggle to extract diverse global features,…

Image and Video Processing · Electrical Eng. & Systems 2023-09-13 Xian Lin , Zengqiang Yan , Xianbo Deng , Chuansheng Zheng , Li Yu

Segmentation maps of medical images annotated by medical experts contain rich spatial information. In this paper, we propose to decompose annotation maps to learn disentangled and richer feature transforms for segmentation problems in…

Image and Video Processing · Electrical Eng. & Systems 2019-06-10 Yizhe Zhang , Michael T. C. Ying , Danny Z. Chen

The use of multimodal data in assisted diagnosis and segmentation has emerged as a prominent area of interest in current research. However, one of the primary challenges is how to effectively fuse multimodal features. Most of the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xinxin Fan , Lin Liu , Haoran Zhang

Accurate and automated lesion segmentation in Positron Emission Tomography / Computed Tomography (PET/CT) imaging is essential for cancer diagnosis and therapy planning. This paper presents a Swin Transformer UNet 3D (SwinUNet3D) framework…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Shovini Guha , Dwaipayan Nandi

This paper demonstrates the feasibility of transformer-based split inference for real-time video object detection over dynamic 5G AI-RAN networks. We extend throughput-aware adaptive splitting from CNNs to a Swin Transformer backbone and…

Networking and Internet Architecture · Computer Science 2026-04-28 Tam Thanh Nguyen , Yong Hao Pua , Tuan Van Ngo , Mao V. Ngo , Jihong Park , Binbin Chen , Tony Q. S. Quek

Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into…

Finetuning a pretrained backbone in the encoder part of an image transformer network has been the traditional approach for the semantic segmentation task. However, such an approach leaves out the semantic context that an image provides…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Jitesh Jain , Anukriti Singh , Nikita Orlov , Zilong Huang , Jiachen Li , Steven Walton , Humphrey Shi

Polyp segmentation is still known as a difficult problem due to the large variety of polyp shapes, scanning and labeling modalities. This prevents deep learning model to generalize well on unseen data. However, Transformer-based approach…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Mai Nguyen , Tung Thanh Bui , Quan Van Nguyen , Thanh Tung Nguyen , Toan Van Pham

Convolutional neural networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they have not demonstrated sufficiently accurate and robust results for clinical use. In addition, they are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Guotai Wang , Wenqi Li , Maria A. Zuluaga , Rosalind Pratt , Premal A. Patel , Michael Aertsen , Tom Doel , Anna L. David , Jan Deprest , Sebastien Ourselin , Tom Vercauteren

While some studies have proven that Swin Transformer (Swin) with window self-attention (WSA) is suitable for single image super-resolution (SR), the plain WSA ignores the broad regions when reconstructing high-resolution images due to a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haram Choi , Jeongmin Lee , Jihoon Yang

Accurate segmentation of medical images is crucial for diagnostic purposes, including cell segmentation, tumor identification, and organ localization. Traditional convolutional neural network (CNN)-based approaches struggled to achieve…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Daniya Najiha Abdul Kareem , Mustansar Fiaz , Noa Novershtern , Hisham Cholakkal

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

Recent transformer-based approaches have demonstrated excellent performance in 3D human pose estimation. However, they have a holistic view and by encoding global relationships between all the joints, they do not capture the local…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Soroush Mehraban , Vida Adeli , Babak Taati

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Guoan Xu , Juncheng Li , Guangwei Gao , Huimin Lu , Jian Yang , Dong Yue

Feature pyramids have been widely adopted in convolutional neural networks and transformers for tasks in medical image segmentation. However, existing models generally focus on the Encoder-side Transformer for feature extraction. We further…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hongyi Cai , Mohammad Mahdinur Rahman , Wenzhen Dong , Jingyu Wu

In this paper, we present an automated approach for segmenting multiple sclerosis (MS) lesions from multi-modal brain magnetic resonance images. Our method is based on a deep end-to-end 2D convolutional neural network (CNN) for slice-based…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Shahab Aslani , Michael Dayan , Loredana Storelli , Massimo Filippi , Vittorio Murino , Maria A Rocca , Diego Sona

Semantic segmentation based on sparse annotation has advanced in recent years. It labels only part of each object in the image, leaving the remainder unlabeled. Most of the existing approaches are time-consuming and often necessitate a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hui Su , Yue Ye , Wei Hua , Lechao Cheng , Mingli Song

Automatic medical image segmentation via convolutional neural networks (CNNs) has shown promising results. However, they may not always be robust enough for clinical use. Sub-optimal segmentation would require clinician's to manually…

Image and Video Processing · Electrical Eng. & Systems 2021-10-26 Helena Williams , João Pedrosa , Laura Cattani , Susanne Housmans , Tom Vercauteren , Jan Deprest , Jan D'hooge