English
Related papers

Related papers: Knowledge-driven Subspace Fusion and Gradient Coor…

200 papers

Melanoma detection is vital for early diagnosis and effective treatment. While deep learning models on dermoscopic images have shown promise, they require specialized equipment, limiting their use in broader clinical settings. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Volodymyr Sydorskyi , Igor Krashenyi , Oleksii Yakubenko

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Grassmannian manifold offers a powerful carrier for geometric representation learning by modelling high-dimensional data as low-dimensional subspaces. However, existing approaches predominantly rely on static single-subspace…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xuan Yu , Tianyang Xu

The isocitrate dehydrogenase (IDH) gene mutation is an essential biomarker for the diagnosis and prognosis of glioma. It is promising to better predict glioma genotype by integrating focal tumor image and geometric features with brain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yiran Wei , Xi Chen , Lei Zhu , Lipei Zhang , Carola-Bibiane Schönlieb , Stephen J. Price , Chao Li

Recently, multi-modality scene perception tasks, e.g., image fusion and scene understanding, have attracted widespread attention for intelligent vision systems. However, early efforts always consider boosting a single task unilaterally and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Zhu Liu , Jinyuan Liu , Guanyao Wu , Long Ma , Xin Fan , Risheng Liu

Deep learning has revolutionized the early detection of breast cancer, resulting in a significant decrease in mortality rates. However, difficulties in obtaining annotations and huge variations in distribution between training sets and real…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Yuxiang Yang , Xinyi Zeng , Pinxian Zeng , Binyu Yan , Xi Wu , Jiliu Zhou , Yan Wang

Histo-genomic multi-modal methods have recently emerged as a powerful paradigm, demonstrating significant potential for improving cancer prognosis. However, genome sequencing, unlike histopathology imaging, is still not widely accessible in…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Zhikang Wang , Yumeng Zhang , Yingxue Xu , Seiya Imoto , Hao Chen , Jiangning Song

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Integrating cross-department multi-modal data (e.g., radiological, pathological, genomic, and clinical data) is ubiquitous in brain cancer diagnosis and survival prediction. To date, such an integration is typically conducted by human…

Machine Learning · Computer Science 2022-07-20 Can Cui , Han Liu , Quan Liu , Ruining Deng , Zuhayr Asad , Yaohong WangShilin Zhao , Haichun Yang , Bennett A. Landman , Yuankai Huo

Accurate brain tumor classification is crucial in medical imaging to ensure reliable diagnosis and effective treatment planning. This study introduces a novel double ensembling framework that synergistically combines pre-trained deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Zahid Ullah , Jihie Kim

Cancer is one of the leading causes of death worldwide, making the development of rapid, minimally invasive, label-free and scalable diagnostic strategies a major challenge in modern oncology. In this context, spectroscopic liquid biopsy…

Multimodal learning that integrates genomics and histopathology has shown strong potential in cancer diagnosis, yet its clinical translation is hindered by the limited availability of paired histology-genomics data. Knowledge distillation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yongxin Guo , Hao Lu , Onur C. Koyun , Zhengjie Zhu , Muhammet Fatih Demir , Metin Nafi Gurcan

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Skin cancer is a serious and potentially fatal disease caused by DNA damage. Early detection significantly increases survival rates, making accurate diagnosis crucial. In this groundbreaking study, we present a hybrid framework based on…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Maksuda Akter , Rabea Khatun , Md. Alamin Talukder , Md. Manowarul Islam , Md. Ashraf Uddin

Histopathological images contain rich phenotypic information that can be used to monitor underlying mechanisms contributing to diseases progression and patient survival outcomes. Recently, deep learning has become the mainstream…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Chetan L. Srinidhi , Ozan Ciga , Anne L. Martel

Survival prediction plays a crucial role in assisting clinicians with the development of cancer treatment protocols. Recent evidence shows that multimodal data can help in the diagnosis of cancer disease and improve survival prediction.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Ruiquan Ge , Xiangyang Hu , Rungen Huang , Gangyong Jia , Yaqi Wang , Renshu Gu , Changmiao Wang , Elazab Ahmed , Linyan Wang , Juan Ye , Ye Li

Multimodal molecular representation learning, which jointly models molecular graphs and their textual descriptions, enhances predictive accuracy and interpretability by enabling more robust and reliable predictions of drug toxicity,…

Machine Learning · Computer Science 2025-10-21 Yingxu Wang , Kunyu Zhang , Jiaxin Huang , Nan Yin , Siwei Liu , Eran Segal

Survival risk stratification is an important step in clinical decision making for breast cancer management. We propose a novel deep learning approach for this purpose by integrating histopathological imaging, genetic and clinical data. It…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Raktim Kumar Mondol , Ewan K. A. Millar , Arcot Sowmya , Erik Meijering

Prostate cancer is one of the leading causes of cancer-related death in men worldwide. Like many cancers, diagnosis involves expert integration of heterogeneous patient information such as imaging, clinical risk factors, and more. For this…

Image and Video Processing · Electrical Eng. & Systems 2023-10-02 Gregory Holste , Douwe van der Wal , Hans Pinckaers , Rikiya Yamashita , Akinori Mitani , Andre Esteva