English
Related papers

Related papers: Multi-modal Learning with Missing Modality in Pred…

200 papers

Assessing the presence of potentially malignant lymph nodes aids in estimating cancer progression, and identifying surrounding benign lymph nodes can assist in determining potential metastatic pathways for cancer. For quantitative analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Litingyu Wang , Yijie Qu , Xiangde Luo , Wenjun Liao , Shichuan Zhang , Guotai Wang

Multimodal models often over-rely on dominant modalities, failing to achieve optimal performance. While prior work focuses on modifying training objectives or optimization procedures, data-centric solutions remain underexplored. We propose…

Machine Learning · Computer Science 2025-10-01 Seong-Hyeon Hwang , Soyoung Choi , Steven Euijong Whang

Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xianrui Li , Yufei Cui , Jun Li , Antoni B. Chan

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Qisheng He , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Clinical notes contain rich patient information, such as diagnoses or medications, making them valuable for patient representation learning. Recent advances in large language models have further improved the ability to extract meaningful…

Machine Learning · Computer Science 2025-09-23 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

Immunohistochemical (IHC) biomarker prediction benefits from multi-modal data fusion analysis. However, the simultaneous acquisition of multi-modal data, such as genomic and pathological information, is often challenging due to cost or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qibin Zhang , Xinyu Hao , Qiao Chen , Rui Xu , Fengyu Cong , Cheng Lu , Hongming Xu

The diagnosis of the presence of metastatic lymph nodes from abdominal computed tomography (CT) scans is an essential task performed by radiologists to guide radiation and chemotherapy treatment. State-of-the-art deep learning classifiers…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Saskia Glaser , Gabriel Maicas , Sergei Bedrikovetski , Tarik Sammour , Gustavo Carneiro

Recently, various deep learning methods have shown significant successes in medical image analysis, especially in the detection of cancer metastases in hematoxylin and eosin (H&E) stained whole-slide images (WSIs). However, in order to…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Yinsheng He , Xingyu Li

Multimodal machine learning integrating histopathology and molecular data shows promise for cancer prognostication. We systematically reviewed studies combining whole slide images (WSIs) and high-throughput omics to predict overall…

Quantitative Methods · Quantitative Biology 2025-07-30 Charlotte Jennings , Andrew Broad , Lucy Godson , Emily Clarke , David Westhead , Darren Treanor

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

Multimodal networks have demonstrated remarkable performance improvements over their unimodal counterparts. Existing multimodal networks are designed in a multi-branch fashion that, due to the reliance on fusion strategies, exhibit…

Pathological lymph node delineation is crucial in cancer diagnosis, progression assessment, and treatment planning. The MICCAI 2023 Lymph Node Quantification Challenge published the first public dataset for pathological lymph node…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Stefan M. Fischer , Johannes Kiechle , Daniel M. Lang , Jan C. Peeken , Julia A. Schnabel

Multimodal deep learning has shown strong potential in medical applications by integrating heterogeneous data sources such as medical images and structured clinical variables. However, most existing approaches implicitly assume complete…

Machine Learning · Computer Science 2026-05-13 Camillo Maria Caruso , Valerio Guarrasi , Paolo Soda

The scarcity of labeled data is a major bottleneck for developing accurate and robust deep learning-based models for histopathology applications. The problem is notably prominent for the task of metastasis detection in lymph nodes, due to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Apostolia Tsirikoglou , Karin Stacke , Gabriel Eilertsen , Jonas Unger

Recent advances in histopathology vision-language foundation models (VLFMs) have shown promise in addressing data scarcity for whole slide image (WSI) classification via zero-shot adaptation. However, these methods remain outperformed by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Tianqi Xiang , Yi Li , Qixiang Zhang , Xiaomeng Li

Annotating cancerous regions in whole-slide images (WSIs) of pathology samples plays a critical role in clinical diagnosis, biomedical research, and machine learning algorithms development. However, generating exhaustive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Zhenzhen Wang , Carla Saoud , Sintawat Wangsiricharoen , Aaron W. James , Aleksander S. Popel , Jeremias Sulam

A method has been developed for the analysis of images of sentinel lymph nodes generated by a spectral scanning device. The aim is to classify the nodes, excised during surgery for breast cancer, as normal or metastatic. The data from one…

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Self-supervised learning has greatly facilitated medical image analysis by suppressing the training data requirement for real-world applications. Current paradigms predominantly rely on self-supervision within uni-modal image data, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Shaohao Rui , Lingzhi Chen , Zhenyu Tang , Lilong Wang , Mianxin Liu , Shaoting Zhang , Xiaosong Wang