English
Related papers

Related papers: Adaptive Prototype Learning for Multimodal Cancer …

200 papers

While multimodal survival prediction models are increasingly more accurate, their complexity often reduces interpretability, limiting insight into how different data sources influence predictions. To address this, we introduce DIMAFx, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Aniek Eijpe , Soufyan Lakbir , Melis Erdal Cesur , Sara P. Oliveira , Angelos Chatzimparmpas , Sanne Abeln , Wilson Silva

Offline Reinforcement Learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods…

Machine Learning · Computer Science 2025-03-18 Kun Wu , Yinuo Zhao , Zhiyuan Xu , Zhengping Che , Chengxiang Yin , Chi Harold Liu , Feiferi Feng , Jian Tang

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

Selecting the most appropriate data examples to present a deep neural network (DNN) at different stages of training is an unsolved challenge. Though practitioners typically ignore this problem, a non-trivial data scheduling method may…

Machine Learning · Computer Science 2018-07-25 Vithursan Thangarasa , Graham W. Taylor

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Accurate survival prediction in Non-Small Cell Lung Cancer (NSCLC) requires integrating clinical, radiological, and histopathological data. Multimodal Deep Learning (MDL) can improve precision prognosis, but small cohorts and missing…

Prognostic information at diagnosis has important implications for cancer treatment and monitoring. Although cancer staging, histopathological assessment, molecular features, and clinical variables can provide useful prognostic insights,…

Multimodal Fusion Learning (MFL), leveraging disparate data from various imaging modalities (e.g., MRI, CT, SPECT), has shown great potential for addressing medical problems such as skin cancer and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Joy Dhar , Nayyar Zaidi , Maryam Haghighat

Behavioral models enable the analysis of the functionality of software product lines (SPL), e.g., model checking and model-based testing. Model learning aims at constructing behavioral models for software systems in some form of a finite…

Software Engineering · Computer Science 2022-08-02 Shaghayegh Tavassoli , Carlos Diego Nascimento Damasceno , Ramtin Khosravi , Mohammad Reza Mousavi

This study proposes a novel approach combining Multimodal Deep Learning with intrinsic eXplainable Artificial Intelligence techniques to predict pathological response in non-small cell lung cancer patients undergoing neoadjuvant therapy.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alice Natalina Caragliano , Claudia Tacconi , Carlo Greco , Lorenzo Nibid , Edy Ippolito , Michele Fiore , Giuseppe Perrone , Sara Ramella , Paolo Soda , Valerio Guarrasi

Accurate survival prediction is critical in oncology for prognosis and treatment planning. Traditional approaches often rely on a single data modality, limiting their ability to capture the complexity of tumor biology. To address this…

Machine Learning · Computer Science 2025-07-11 Alba Garrido , Alejandro Almodóvar , Patricia A. Apellániz , Juan Parras , Santiago Zazo

Multimodal learning enhances the performance of various machine learning tasks by leveraging complementary information across different modalities. However, existing methods often learn multimodal representations that retain substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tong Zhang , Shu Shen , C. L. Philip Chen

Current multimodal survival prediction methods typically rely on pathology images (WSIs) and genomic data, both of which are high-dimensional and redundant, making it difficult to extract discriminative features from them and align…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Chenyu Zhao , Yingxue Xu , Fengtao Zhou , Yihui Wang , Hao Chen

Cancer diagnosis, prognosis, and therapeutic response predictions are based on morphological information from histology slides and molecular profiles from genomic data. However, most deep learning-based objective outcome prediction and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Richard J. Chen , Ming Y. Lu , Jingwen Wang , Drew F. K. Williamson , Scott J. Rodig , Neal I. Lindeman , Faisal Mahmood

Cancer survival prediction requires integrating pathological Whole Slide Images (WSIs) and genomic profiles, a challenging task due to the inherent heterogeneity and the complexity of modeling both inter- and intra-modality interactions.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Mingxin Liu , Chengfei Cai , Jun Li , Pengbo Xu , Jinze Li , Jiquan Ma , Jun Xu

Molecular subtyping of breast cancer is crucial for personalized treatment and prognosis. Traditional classification approaches rely on either histopathological images or gene expression profiling, limiting their predictive power. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Amin Honarmandi Shandiz

Survival analysis stands as a pivotal process in cancer treatment research, crucial for predicting patient survival rates accurately. Recent advancements in data collection techniques have paved the way for enhancing survival predictions by…

Machine Learning · Computer Science 2024-07-26 Linhao Qu , Dan Huang , Shaoting Zhang , Xiaosong Wang

While current autonomous navigation systems allow robots to successfully drive themselves from one point to another in specific environments, they typically require extensive manual parameter re-tuning by human robotics experts in order to…

Robotics · Computer Science 2022-05-19 Xuesu Xiao , Zizhao Wang , Zifan Xu , Bo Liu , Garrett Warnell , Gauraang Dhamankar , Anirudh Nair , Peter Stone

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu