English
Related papers

Related papers: Uni-Encoder Meets Multi-Encoders: Representation B…

200 papers

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

Simultaneous segmentation and detection of liver tumors (hemangioma and hepatocellular carcinoma (HCC)) by using multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for the clinical diagnosis. However, it is still a…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Jianfeng Zhao , Dengwang Li , Shuo Li

A key challenge in learning from multimodal biological data is missing modalities, where data from one or more modalities are absent for some patients. Existing approaches either exclude patients with missing modalities, impute missing…

Machine Learning · Computer Science 2026-05-19 Sina Tabakhi , Chen , Chen , Haiping Lu

Skin cancer segmentation poses a significant challenge in medical image analysis. Numerous existing solutions, predominantly CNN-based, face issues related to a lack of global contextual understanding. Alternatively, some approaches resort…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Shehan Perera , Yunus Erzurumlu , Deepak Gulati , Alper Yilmaz

Automatic segmentation of breast tumors from the ultrasound images is essential for the subsequent clinical diagnosis and treatment plan. Although the existing deep learning-based methods have achieved significant progress in automatic…

Image and Video Processing · Electrical Eng. & Systems 2023-10-24 Xing Yang , Jian Zhang , Qijian Chen , Li Wang , Lihui Wang

Medical image segmentation plays an essential role in developing computer-assisted diagnosis and therapy systems, yet still faces many challenges. In the past few years, the popular encoder-decoder architectures based on CNNs (e.g., U-Net)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Guoping Xu , Xingrong Wu , Xuan Zhang , Xinwei He

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Brain tumor segmentation remains a challenge in medical image segmentation tasks. With the application of transformer in various computer vision tasks, transformer blocks show the capability of learning long-distance dependency in global…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Liqun Huang , Long Chen , Baihai Zhang , Senchun Chai

The use of diverse modalities, such as omics, medical images, and clinical data can not only improve the performance of prognostic models but also deepen an understanding of disease mechanisms and facilitate the development of novel…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Maria Boyko , Aleksandra Beliaeva , Dmitriy Kornilov , Alexander Bernstein , Maxim Sharaev

A major challenge in brain tumor treatment planning and quantitative evaluation is determination of the tumor extent. The noninvasive magnetic resonance imaging (MRI) technique has emerged as a front-line diagnostic tool for brain tumors…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Guang Yang , Fangde Liu , Yuanhan Mo , Yike Guo

We propose a novel, simple and effective method to integrate lesion prior and a 3D U-Net for improving brain tumor segmentation. First, we utilize the ground-truth brain tumor lesions from a group of patients to generate the heatmaps of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Po-Yu Kao , Jefferson W. Chen , B. S. Manjunath

Multi-modal medical image fusion is traditionally optimized for human visual perception, aiming to maximize generic contrast and structural fidelity. However, when these visually pleasing fused images are deployed in automated clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yuchen Guo , Junli Gong , Hongmin Cai , Yiu-ming Cheung , Weifeng Su

Molecular representation learning is fundamental for many drug related applications. Most existing molecular pre-training models are limited in using single molecular modality, either SMILES or graph representation. To effectively leverage…

Machine Learning · Computer Science 2024-11-05 Shikun Feng , Lixin Yang , Yanwen Huang , Yuyan Ni , Weiying Ma , Yanyan Lan

Accurate classification of brain tumors from magnetic resonance imaging (MRI) plays a critical role in early diagnosis and effective treatment planning. In this study, we propose a deep learning framework based on Vision Transformers (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Faisal Ahmed

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

This work introduces a novel framework for brain tumor segmentation leveraging pre-trained GANs and Unet architectures. By combining a global anomaly detection module with a refined mask generation network, the proposed model accurately…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Qifei Cui , Xinyu Lu

Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shenghao Zhu , Yifei Chen , Weihong Chen , Yuanhan Wang , Chang Liu , Shuo Jiang , Feiwei Qin , Changmiao Wang

Brain lesion segmentation plays an essential role in neurological research and diagnosis. As brain lesions can be caused by various pathological alterations, different types of brain lesions tend to manifest with different characteristics…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Xinru Zhang , Ni Ou , Berke Doga Basaran , Marco Visentin , Mengyun Qiao , Renyang Gu , Cheng Ouyang , Yaou Liu , Paul M. Matthew , Chuyang Ye , Wenjia Bai

Brain tumor analysis in MRI images is a significant and challenging issue because misdiagnosis can lead to death. Diagnosis and evaluation of brain tumors in the early stages increase the probability of successful treatment. However, the…

Image and Video Processing · Electrical Eng. & Systems 2021-12-30 Zahra Sobhaninia , Nader Karimi , Pejman Khadivi , Shadrokh Samavi

Brain tumors require an assessment to ensure timely diagnosis and effective patient treatment. Morphological factors such as size, location, texture, and variable appearance complicate tumor inspection. Medical imaging presents challenges,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Md. Zahid Hasan , Abdullah Tamim , D. M. Asadujjaman , Md. Mahfujur Rahman , Md. Abu Ahnaf Mollick , Nosin Anjum Dristi , Abdullah-Al-Noman