English
Related papers

Related papers: A Fully Transformer Based Multimodal Framework for…

200 papers

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

The rapid advancements in large language models (LLMs) have unlocked their potential for multimodal tasks, where text and visual data are processed jointly. However, applying LLMs to medical imaging, particularly for chest X-rays (CXR),…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Nicholas Evans , Stephen Baker , Miles Reed

Deep learning, especially convolutional neural networks (CNNs) and Transformer architectures, have become the focus of extensive research in medical image segmentation, achieving impressive results. However, CNNs come with inductive biases…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Xiao Liu , Peng Gao , Tao Yu , Fei Wang , Ru-Yue Yuan

This study addresses the essential task of medical image segmentation, which involves the automatic identification and delineation of anatomical structures and pathological regions in medical images. Accurate segmentation is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Seyedeh Sahar Taheri Otaghsara , Reza Rahmanzadeh

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R

To ensure safe clinical integration, deep learning models must provide more than just high accuracy; they require dependable uncertainty quantification. While current Medical Vision Transformers perform well, they frequently struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-04-13 Mohammed Maaz Sibhai , Abedalrhman Alkhateeb , Saad B. Ahmed

Accurate segmentation for medical images is important for clinical diagnosis. Existing automatic segmentation methods are mainly based on fully supervised learning and have an extremely high demand for precise annotations, which are very…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yuanpeng Liu , Qinglei Hui , Zhiyi Peng , Shaolin Gong , Dexing Kong

Whole-slide images (WSIs) from cancer patients contain rich information that can be used for medical diagnosis or to follow treatment progress. To automate their analysis, numerous deep learning methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Lucas Sancéré , Noémie Moreau , Katarzyna Bozek

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

We introduce MedCondDiff, a diffusion-based framework for multi-organ medical image segmentation that is efficient and anatomically grounded. The model conditions the denoising process on semantic priors extracted by a Pyramid Vision…

Image and Video Processing · Electrical Eng. & Systems 2025-12-02 Ruirui Huang , Jiacheng Li

Unsupervised domain adaptation for medical image segmentation remains a significant challenge due to substantial domain shifts across imaging modalities, such as CT and MRI. While recent vision-language representation learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Computed Tomography (CT) based precise prostate segmentation for treatment planning is challenging due to (1) the unclear boundary of the prostate derived from CT's poor soft tissue contrast and (2) the limitation of convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2023-07-20 Chengyin Li , Yao Qiang , Rafi Ibn Sultan , Hassan Bagher-Ebadian , Prashant Khanduri , Indrin J. Chetty , Dongxiao Zhu

Multimodal learning has been demonstrated to enhance performance across various clinical tasks, owing to the diverse perspectives offered by different modalities of data. However, existing multimodal segmentation methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-02-04 Shiyun Chen , Li Lin , Pujin Cheng , ZhiCheng Jin , JianJian Chen , HaiDong Zhu , Kenneth K. Y. Wong , Xiaoying Tang

Medical imaging provides critical evidence for clinical diagnosis, treatment planning, and surgical decisions, yet most existing imaging models are narrowly focused and require multiple specialized networks, limiting their generalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Guoxin Wang , Jun Zhao , Xinyi Liu , Yanbo Liu , Xuyang Cao , Chao Li , Zhuoyun Liu , Qintian Sun , Fangru Zhou , Haoqiang Xing , Zhenhong Yang

In this paper, we introduce a novel semi-supervised learning framework tailored for medical image segmentation. Central to our approach is the innovative Multi-scale Text-aware ViT-CNN Fusion scheme. This scheme adeptly combines the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yixing Lu , Zhaoxin Fan , Min Xu

Multimodal positron emission tomography-computed tomography (PET-CT) is used routinely in the assessment of cancer. PET-CT combines the high sensitivity for tumor detection with PET and anatomical information from CT. Tumor segmentation is…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

Transformer models have demonstrated the capability to produce highly accurate segmentation of organs and tumors. However, model training requires high-quality curated datasets to ensure robust generalization to unseen datasets. Hence, we…

Breast-conserving surgery (BCS) aims to completely remove malignant lesions while maximizing healthy tissue preservation. Intraoperative margin assessment is essential to achieve a balance between thorough cancer resection and tissue…

Image and Video Processing · Electrical Eng. & Systems 2026-01-16 Pouya Afshin , David Helminiak , Tongtong Lu , Tina Yen , Julie M. Jorns , Mollie Patton , Bing Yu , Dong Hye Ye

For 3D medical image (e.g. CT and MRI) segmentation, the difficulty of segmenting each slice in a clinical case varies greatly. Previous research on volumetric medical image segmentation in a slice-by-slice manner conventionally use the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenxuan Wang , Chen Chen , Jing Wang , Sen Zha , Yan Zhang , Jiangyun Li

Accurate detection and segmentation of brain tumors from magnetic resonance imaging (MRI) are essential for diagnosis, treatment planning, and clinical monitoring. While convolutional architectures such as U-Net have long been the backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Arman Behnam