English
Related papers

Related papers: Continually Evolved Multimodal Foundation Models f…

200 papers

Accurate prediction of cancer progression remains a challenge due to the high heterogeneity of molecular omics data across patients. While biologically informed models have improved the interpretability of these predictions, a persistent…

Machine Learning · Computer Science 2026-04-21 Koushik Howlader , Md Tauhidul Islam , Wei Le

We study multimodal survival analysis integrating clinical text, tabular covariates, and genomic profiles using locally deployable large language models (LLMs). As many institutions face tight computational and privacy constraints, this…

Machine Learning · Computer Science 2026-03-24 Moritz Gögl , Christopher Yau

Foundation models have emerged as a powerful approach for processing electronic health records (EHRs), offering flexibility to handle diverse medical data modalities. In this study, we present a comprehensive benchmark that evaluates the…

Machine Learning · Computer Science 2025-07-22 Kunyu Yu , Rui Yang , Jingchi Liao , Siqi Li , Huitao Li , Irene Li , Yifan Peng , Rishikesan Kamaleswaran , Nan Liu

Accurate and interpretable survival analysis remains a core challenge in oncology. With growing multimodal data and the clinical need for transparent models to support validation and trust, this challenge increases in complexity. We propose…

Artificial Intelligence · Computer Science 2025-09-29 Mafalda Malafaia , Peter A. N. Bosman , Coen Rasch , Tanja Alderliesten

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

In this review we make the statement that hybrid models in oncology are required as a mean for enhanced data integration. In the context of systems oncology, experimental and clinical data need to be at the heart of the models developments…

Quantitative Methods · Quantitative Biology 2019-01-18 Angélique Stéphanou , Pascal Ballet , Gibin Powathil

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

With recent advancements in the development of artificial intelligence applications using theories and algorithms in machine learning, many accurate models can be created to train and predict on given datasets. With the realization of the…

Machine Learning · Computer Science 2024-03-29 Pei Xi , Lin

Cancer and its subtypes constitute approximately 30% of all causes of death globally and display a wide range of heterogeneity in terms of clinical and molecular responses to therapy. Molecular subtyping has enabled the use of precision…

Quantitative Methods · Quantitative Biology 2024-07-11 Anwar Khan , Boreom Lee

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Recent advances in cancer research largely rely on new developments in microscopic or molecular profiling techniques offering high level of detail with respect to either spatial or molecular features, but usually not both. Here, we present…

Cancer remains a leading cause of death worldwide, necessitating personalized treatment approaches to improve outcomes. Theranostics, combining molecular-level imaging with targeted therapy, offers potential for precision oncology but…

Computational Engineering, Finance, and Science · Computer Science 2025-05-16 Binesh Sadanandan , Vahid Behzadan

Cervical cancer presents a significant global health challenge, necessitating advanced diagnostic and prognostic approaches for effective treatment. This paper investigates the potential of employing multi-modal medical imaging at various…

Medical Physics · Physics 2024-08-27 Haotian Feng , Emi Yoshida , Ke Sheng

Cancer survival prediction using multi-modal medical imaging presents a critical challenge in oncology, mainly due to the vulnerability of deep learning models to noise and protocol variations across imaging centers. Current approaches…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Aiman Farooq , Azad Singh , Deepak Mishra , Santanu Chaudhury

In cancer research, high-throughput profiling has been extensively conducted. In recent studies, the integrative analysis of data on multiple cancer patient groups/subgroups has been conducted. Such analysis has the potential to reveal the…

Methodology · Statistics 2022-12-01 Yifan Sun , Zhengyang Sun , Yu Jiang , Yang Li , Shuangge Ma

Renal cell carcinoma represents a significant global health challenge with a low survival rate. This research aimed to devise a comprehensive deep-learning model capable of predicting survival probabilities in patients with renal cell…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Maryamalsadat Mahootiha , Hemin Ali Qadir , Jacob Bergsland , Ilangko Balasingham

Accurate survival prediction is essential for personalised cancer treatment. We propose ModalSurv, a multimodal deep survival framework integrating clinical, MRI, histopathology, and RNA-sequencing data via modality-specific projections and…

Machine Learning · Computer Science 2025-12-19 Noorul Wahab , Ethar Alzaid , Jiaqi Lv , Fayyaz Minhas , Adam Shephard , Shan E Ahmed Raza

Accurate prognosis of non-small cell lung cancer (NSCLC) patients undergoing immunotherapy is essential for personalized treatment planning, enabling informed patient decisions, and improving both treatment outcomes and quality of life.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Qilong Xing , Zikai Song , Bingxin Gong , Lian Yang , Junqing Yu , Wei Yang

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

Identifying the mutations that drive cancer growth is key in clinical decision making and precision oncology. As driver mutations confer selective advantage and thus have an increased likelihood of occurrence, frequency-based statistical…

Genomics · Quantitative Biology 2021-05-04 Adnan Akbar , Andrey Solovyev , John W Cassidy , Nirmesh Patel , Harry W Clifford