English
Related papers

Related papers: Uni-Encoder Meets Multi-Encoders: Representation B…

200 papers

Brain metastasis segmentation poses a significant challenge in medical imaging due to the complex presentation and variability in size and location of metastases. In this study, we first investigate the impact of different imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Yousef Sadegheih , Dorit Merhof

Segmentation is one of the most significant steps in image processing. Segmenting an image is a technique that makes it possible to separate a digital image into various areas based on the different characteristics of pixels in the image.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-20 Sina Derakhshandeh , Ali Mahloojifar

Intracranial tumors are groups of cells that usually grow uncontrollably. One out of four cancer deaths is due to brain tumors. Early detection and evaluation of brain tumors is an essential preventive medical step that is performed by…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Zahra Sobhaninia , Safiyeh Rezaei , Nader Karimi , Ali Emami , Shadrokh Samavi

Integrating the different data modalities of cancer patients can significantly improve the predictive performance of patient survival. However, most existing methods ignore the simultaneous utilization of rich semantic features at different…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Liangrui Pan , Yijun Peng , Yan Li , Yiyi Liang , Liwen Xu , Qingchun Liang , Shaoliang Peng

Brain tumors analysis is important in timely diagnosis and effective treatment to cure patients. Tumor analysis is challenging because of tumor morphology like size, location, texture, and heteromorphic appearance in the medical images. In…

Image and Video Processing · Electrical Eng. & Systems 2022-02-14 Mirza Mumtaz Zahoor , Shahzad Ahmad Qureshi , Saddam Hussain Khan , Asifullah Khan

Brain tumors, particularly glioblastoma, continue to challenge medical diagnostics and treatments globally. This paper explores the application of deep learning to multi-modality magnetic resonance imaging (MRI) data for enhanced brain…

Image and Video Processing · Electrical Eng. & Systems 2023-08-15 Chiranjeewee Prasad Koirala , Sovesh Mohapatra , Advait Gosai , Gottfried Schlaug

Positron Emission Tomography (PET) and Computer Tomography (CT) are routinely used together to detect tumors. PET/CT segmentation models can automate tumor delineation, however, current multimodal models do not fully exploit the…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Zdravko Marinov , Simon Reiß , David Kersting , Jens Kleesiek , Rainer Stiefelhagen

We introduce Med-CTX, a fully transformer based multimodal framework for explainable breast cancer ultrasound segmentation. We integrate clinical radiology reports to boost both performance and interpretability. Med-CTX achieves exact…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Enobong Adahada , Isabel Sassoon , Kate Hone , Yongmin Li

Recently, deep learning methods have achieved state-of-the-art performance in many medical image segmentation tasks. Many of these are based on convolutional neural networks (CNNs). For such methods, the encoder is the key part for global…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hao Li , Dewei Hu , Han Liu , Jiacheng Wang , Ipek Oguz

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

Robust and generalizable segmentation of brain tumors on multi-parametric magnetic resonance imaging (MRI) remains difficult because tumor types differ widely. The BraTS 2025 Lighthouse Challenge benchmarks segmentation methods on diverse…

In medical applications, the same anatomical structures may be observed in multiple modalities despite the different image characteristics. Currently, most deep models for multimodal segmentation rely on paired registered images. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Wenguang Yuan , Jia Wei , Jiabing Wang , Qianli Ma , Tolga Tasdizen

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Haowen Pang , Weiyan Guo , Chuyang Ye

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

Learning a robust Variational Autoencoder (VAE) is a fundamental step for many deep learning applications in medical image analysis, such as MRI synthesizes. Existing brain VAEs predominantly focus on single-modality data (i.e., T1-weighted…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Mingjie Li , Edward Kim , Yue Zhao , Ehsan Adeli , Kilian M. Pohl

Transformer, which can benefit from global (long-range) information modeling using self-attention mechanisms, has been successful in natural language processing and 2D image classification recently. However, both local and global features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wenxuan Wang , Chen Chen , Meng Ding , Jiangyun Li , Hong Yu , Sen Zha

Motivated by the need for advanced solutions in the segmentation and inpainting of glioma-affected brain regions in multi-modal magnetic resonance imaging (MRI), this study presents an integrated approach leveraging the strengths of…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Ramy A. Zeineldin , Franziska Mathis-Ullrich

Multimodal brain tumor segmentation challenge (BraTS) brings together researchers to improve automated methods for 3D MRI brain tumor segmentation. Tumor segmentation is one of the fundamental vision tasks necessary for diagnosis and…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Andriy Myronenko , Ali Hatamizadeh

Magnetic resonance imaging (MRI) is critically important for brain mapping in both scientific research and clinical studies. Precise segmentation of brain tumors facilitates clinical diagnosis, evaluations, and surgical planning. Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 Rui Nian , Guoyao Zhang , Yao Sui , Yuqi Qian , Qiuying Li , Mingzhang Zhao , Jianhui Li , Ali Gholipour , Simon K. Warfield

Magnetic resonance imaging (MRI) is a powerful and versatile imaging technique, offering a wide spectrum of information about the anatomy by employing different acquisition modalities. However, in the clinical workflow, it is impractical to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yicheng Wu , Tao Song , Zhonghua Wu , Jin Ye , Zongyuan Ge , Wenjia Bai , Zhaolin Chen , Jianfei Cai