English
Related papers

Related papers: Continually Evolved Multimodal Foundation Models f…

200 papers

Machine learning (ML) applications in medical artificial intelligence (AI) systems have shifted from traditional and statistical methods to increasing application of deep learning models. This survey navigates the current landscape of…

Machine Learning · Computer Science 2024-01-23 Elisa Warner , Joonsang Lee , William Hsu , Tanveer Syeda-Mahmood , Charles Kahn , Olivier Gevaert , Arvind Rao

It is imperative that breast cancer is detected precisely and timely to improve patient outcomes. Diagnostic methodologies have traditionally relied on unimodal approaches; however, medical data analytics is integrating diverse data sources…

Machine Learning · Computer Science 2024-06-21 Faseela Abdullakutty , Younes Akbari , Somaya Al-Maadeed , Ahmed Bouridane , Rifat Hamoudi

Accurately predicting early recurrence in brain tumor patients following surgical resection remains a clinical challenge. This study proposes a multi-modal machine learning framework that integrates structural MRI features with clinical…

Machine Learning · Computer Science 2025-09-03 Cheng Cheng , Zeping Chen , Rui Xie , Peiyao Zheng , Xavier Wang

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Computational pathology is part of precision oncology medicine. The integration of high-throughput data including genomics, transcriptomics, proteomics, metabolomics, pathomics, and radiomics into clinical practice improves cancer treatment…

Image and Video Processing · Electrical Eng. & Systems 2022-06-07 Liangrui Pan , Zhichao Feng , Shaoliang Peng

Predicting survival outcomes for non-small cell lung cancer (NSCLC) patients is challenging due to the different individual prognostic features. This task can benefit from the integration of whole-slide images, bulk transcriptomics, and DNA…

Recent deep learning research based on Transformer model architectures has demonstrated state-of-the-art performance across a variety of domains and tasks, mostly within the computer vision and natural language processing domains. While…

Machine Learning · Computer Science 2021-11-11 Benjamin Shickel , Patrick J. Tighe , Azra Bihorac , Parisa Rashidi

The recent development of high-throughput sequencing creates a large collection of multi-omics data, which enables researchers to better investigate cancer molecular profiles and cancer taxonomy based on molecular subtypes. Integrating…

Genomics · Quantitative Biology 2024-01-25 Bingjun Li , Sheida Nabavi

Many healthcare applications are inherently multimodal, involving several physiological signals. As sensors for these signals become more common, improving machine learning methods for multimodal healthcare data is crucial. Pretraining…

Machine Learning · Computer Science 2024-10-23 Ching Fang , Christopher Sandino , Behrooz Mahasseni , Juri Minxha , Hadi Pouransari , Erdrin Azemi , Ali Moin , Ellen Zippi

In real-world scenarios, achieving domain adaptation and generalization poses significant challenges, as models must adapt to or generalize across unknown target distributions. Extending these capabilities to unseen multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hao Dong , Moru Liu , Kaiyang Zhou , Eleni Chatzi , Juho Kannala , Cyrill Stachniss , Olga Fink

The histological assessment of human tissue has emerged as the key challenge for detection and treatment of cancer. A plethora of different data sources ranging from tissue microarray data to gene expression, proteomics or metabolomics data…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Thomas J. Fuchs , Joachim M. Buhmann

This study proposes a novel approach combining Multimodal Deep Learning with intrinsic eXplainable Artificial Intelligence techniques to predict pathological response in non-small cell lung cancer patients undergoing neoadjuvant therapy.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alice Natalina Caragliano , Claudia Tacconi , Carlo Greco , Lorenzo Nibid , Edy Ippolito , Michele Fiore , Giuseppe Perrone , Sara Ramella , Paolo Soda , Valerio Guarrasi

The objective of this paper is to provide a baseline for performing multi-modal data classification on a novel open multimodal dataset of hepatocellular carcinoma (HCC), which includes both image data (contrast-enhanced CT and MRI images)…

Metadata are general characteristics of the data in a well-curated and condensed format, and have been proven to be useful for decision making, knowledge discovery, and also heterogeneous data organization of biobank. Among all data types…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Wei-Hung Weng , Yuannan Cai , Angela Lin , Fraser Tan , Po-Hsuan Cameron Chen

Thyroid cancer is a common endocrine carcinoma that occurs in the thyroid gland. Much effort has been invested in improving its diagnosis, and thyroidectomy remains the primary treatment method. A successful operation without unnecessary…

Machine Learning · Computer Science 2022-03-31 Nan Miles Xi , Lin Wang , Chuanjia Yang

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Recent studies show that deep learning models achieve good performance on medical imaging tasks such as diagnosis prediction. Among the models, multimodality has been an emerging trend, integrating different forms of data such as chest…

Machine Learning · Computer Science 2022-02-10 Haodi Zhang , Chenyu Xu , Peirou Liang , Ke Duan , Hao Ren , Weibin Cheng , Kaishun Wu

Early detection is crucial for successful cancer treatment and increasing survivability rates, particularly in the most common forms. Ten different cancers have been identified in most of these advances that effectively use CNNs…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Hossein Molaeian , Kaveh Karamjani , Sina Teimouri , Saeed Roshani , Sobhan Roshani

Cancer is a complex disease that provides various types of information depending on the scale of observation. While most tumor diagnostics are performed by observing histopathological slides, radiology images should yield additional…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Marvin Lerousseau , Eric Deutsh , Nikos Paragios

The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth…