English
Related papers

Related papers: A Simple and Robust Framework for Cross-Modality M…

200 papers

This work presents a simple vision transformer design as a strong baseline for object localization and instance segmentation tasks. Transformers recently demonstrate competitive performance in image classification tasks. To adopt ViT to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Wuyang Chen , Xianzhi Du , Fan Yang , Lucas Beyer , Xiaohua Zhai , Tsung-Yi Lin , Huizhong Chen , Jing Li , Xiaodan Song , Zhangyang Wang , Denny Zhou

Semantic segmentation is crucial for medical image analysis, enabling precise disease diagnosis and treatment planning. However, many advanced models employ complex architectures, limiting their use in resource-constrained clinical…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Le-Anh Tran , Chung Nguyen Tran , Nhan Cach Dang , Anh Le Van Quoc , Jordi Carrabina , David Castells-Rufas , Minh Son Nguyen

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Automated medical image segmentation is becoming increasingly crucial to modern clinical practice, driven by the growing demand for precise diagnosis, the push towards personalized treatment plans, and the advancements in machine learning…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Tan-Hanh Pham , Xianqi Li , Kim-Doang Nguyen

The success of deep convolutional neural networks is partially attributed to the massive amount of annotated training data. However, in practice, medical data annotations are usually expensive and time-consuming to be obtained. Considering…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Kang Li , Lequan Yu , Shujun Wang , Pheng-Ann Heng

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang

Computed tomography (CT) segmentation models often contain classes that are not currently supported by magnetic resonance imaging (MRI) segmentation models. In this study, we show that a simple image inversion technique can significantly…

Image and Video Processing · Electrical Eng. & Systems 2025-09-25 Hartmut Häntze , Lina Xu , Maximilian Rattunde , Leonhard Donle , Felix J. Dorfner , Alessa Hering , Lisa C. Adams , Keno K. Bressem

Medical image segmentation has made significant progress in recent years. Deep learning-based methods are recognized as data-hungry techniques, requiring large amounts of data with manual annotations. However, manual annotation is expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yi Lin , Yufan Chen , Kwang-Ting Cheng , Hao Chen

Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these cases, the model needs…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu

Text-guided medical segmentation enhances segmentation accuracy by utilizing clinical reports as auxiliary information. However, existing methods typically rely on unaligned image and text encoders, which necessitate complex interaction…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Gaoren Lin , Huangxuan Zhao , Yuan Xiong , Lefei Zhang , Bo Du , Wentao Zhu

Deep learning has been widely used in medical image segmentation and other aspects. However, the performance of existing medical image segmentation models has been limited by the challenge of obtaining sufficient high-quality labeled data…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Zihan Li , Yunxiang Li , Qingde Li , Puyang Wang , Dazhou Guo , Le Lu , Dakai Jin , You Zhang , Qingqi Hong

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

Cross-modal alignment Learning integrates information from different modalities like text, image, audio and video to create unified models. This approach develops shared representations and learns correlations between modalities, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Bilal Faye , Hanane Azzag , Mustapha Lebbah

One of the common and promising deep learning approaches used for medical image segmentation is transformers, as they can capture long-range dependencies among the pixels by utilizing self-attention. Despite being successful in medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Md Motiur Rahman , Shiva Shokouhmand , Smriti Bhatt , Miad Faezipour

In the wake of Masked Image Modeling (MIM), a diverse range of plain, non-hierarchical Vision Transformer (ViT) models have been pre-trained with extensive datasets, offering new paradigms and significant potential for semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Yuanduo Hong , Jue Wang , Weichao Sun , Huihui Pan

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Canxuan Gang

Universal Image Segmentation is not a new concept. Past attempts to unify image segmentation in the last decades include scene parsing, panoptic segmentation, and, more recently, new panoptic architectures. However, such panoptic…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Jitesh Jain , Jiachen Li , MangTik Chiu , Ali Hassani , Nikita Orlov , Humphrey Shi

Image translation across domains for unpaired datasets has gained interest and great improvement lately. In medical imaging, there are multiple imaging modalities, with very different characteristics. Our goal is to use cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2022-02-07 Leo Segre , Or Hirschorn , Dvir Ginzburg , Dan Raviv