English
Related papers

Related papers: Multi-Modal Foundation Models for Computational Pa…

200 papers

Graph-structured data pervades domains such as social networks, biological systems, knowledge graphs, and recommender systems. While foundation models have transformed natural language processing, vision, and multimodal learning through…

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

Machine Learning · Computer Science 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang

To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Benedikt Roth , Valentin Koch , Sophia J. Wagner , Julia A. Schnabel , Carsten Marr , Tingying Peng

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

Deep Learning-based computational pathology algorithms have demonstrated profound ability to excel in a wide array of tasks that range from characterization of well known morphological phenotypes to predicting non-human-identifiable…

Image and Video Processing · Electrical Eng. & Systems 2020-09-24 Ming Y. Lu , Dehan Kong , Jana Lipkova , Richard J. Chen , Rajendra Singh , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

In the field of computational histopathology, both whole slide images (WSIs) and diagnostic captions provide valuable insights for making diagnostic decisions. However, aligning WSIs with diagnostic captions presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Qifeng Zhou , Wenliang Zhong , Yuzhi Guo , Michael Xiao , Hehuan Ma , Junzhou Huang

Vision-language models in pathology enable multimodal case retrieval and automated report generation. Many of the models developed so far, however, have been trained on pathology reports that include information which cannot be inferred…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruben T. Lucassen , Tijn van de Luijtgaarden , Sander P. J. Moonemans , Gerben E. Breimer , Willeke A. M. Blokx , Mitko Veta

Pathology foundation models (PFMs) have become central to computational pathology, aiming to offer general encoders for feature extraction from whole-slide images (WSIs). Despite strong benchmark performance, PFM robustness to real-world…

Image and Video Processing · Electrical Eng. & Systems 2026-01-08 Erik Thiringer , Fredrik K. Gustafsson , Kajsa Ledesma Eriksson , Mattias Rantalainen

Foundation models are rapidly being developed for computational pathology applications. However, it remains an open question which factors are most important for downstream performance with data scale and diversity, model size, and training…

This paper attacks an emerging challenge of multi-modal retinal disease recognition. Given a multi-modal case consisting of a color fundus photo (CFP) and an array of OCT B-scan images acquired during an eye examination, we aim to build a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Xirong Li , Yang Zhou , Jie Wang , Hailan Lin , Jianchun Zhao , Dayong Ding , Weihong Yu , Youxin Chen

Spatial transcriptomics (ST) provides high-resolution pathological images and whole-transcriptomic expression profiles at individual spots across whole-slide scales. This setting makes it an ideal data source to develop multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yuxiang Lin , Ling Luo , Ying Chen , Xushi Zhang , Zihui Wang , Wenxian Yang , Mengsha Tong , Rongshan Yu

Recent advances in whole slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence (AI) based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath)…

Pathology, the microscopic examination of diseased tissue, is critical for diagnosing various medical conditions, particularly cancers. Traditional methods are labor-intensive and prone to human error. Digital pathology, which converts…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Dmitry Nechaev , Alexey Pchelnikov , Ekaterina Ivanova

Digital hematopathology requires cell-level analysis across diverse disease categories, including malignant disorders (e.g., leukemia), infectious conditions (e.g., malaria), and non-malignant red blood cell disorders (e.g., sickle cell…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Abdul Rehman , Iqra Rasool , Ayisha Imran , Mohsen Ali , Waqas Sultani

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Richard J. Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Jana Lipkova , Muhammad Shaban , Maha Shady , Mane Williams , Bumjin Joo , Zahra Noor , Faisal Mahmood

Self-supervised learning (SSL) has driven major advances in computational pathology by enabling the learning of rich representations from histopathology data. Yet, tissue analysis alone may fall short in capturing broader molecular…

Machine Learning · Computer Science 2025-12-17 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

As natural image understanding moves towards the pretrain-finetune era, research in pathology imaging is concurrently evolving. Despite the predominant focus on pretraining pathological foundation models, how to adapt foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaxuan Lu , Fang Yan , Xiaofan Zhang , Yue Gao , Shaoting Zhang

Vision systems to see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The complex relations between objects and their locations, ambiguities, and variations in the real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Muhammad Awais , Muzammal Naseer , Salman Khan , Rao Muhammad Anwer , Hisham Cholakkal , Mubarak Shah , Ming-Hsuan Yang , Fahad Shahbaz Khan

Vision-Language Models (VLMs) are advancing computational pathology with superior visual understanding capabilities. However, current systems often reduce diagnosis to directly output conclusions without verifiable evidence-linked…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Songhan Jiang , Fengchun Liu , Ziyue Wang , Linghan Cai , Yongbing Zhang
‹ Prev 1 8 9 10 Next ›