English
Related papers

Related papers: Multi-Modal Foundation Models for Computational Pa…

200 papers

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

Whole slide imaging (WSI) has transformed digital pathology by enabling computational analysis of gigapixel histopathology images. Recent foundation model advances have accelerated progress in computational pathology, facilitating joint…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Peihang Wu , Zehong Chen , Lijian Xu

Automated generation of diagnostic pathology reports directly from whole slide images (WSIs) is an emerging direction in computational pathology. Translating high-resolution tissue patterns into clinically coherent text remains difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Noorul Wahab , Nasir Rajpoot

Vision foundation models trained on discretely sampled images achieve strong performance on classification benchmarks, yet whether their representations encode the continuous processes underlying their training data remains unclear. This…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Pritika Vig , Ren-Chin Wu , William Lotter

Whole slide image (WSI) analysis has emerged as an increasingly essential technique in computational pathology. Recent advances in the pathology foundation models (FMs) have demonstrated significant advantages in deriving meaningful…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zhidong Yang , Xiuhui Shi , Wei Ba , Zhigang Song , Haijing Luan , Taiyuan Hu , Senlin Lin , Jiguang Wang , Shaohua Kevin Zhou , Rui Yan

Foundation models and vision-language pre-training have significantly advanced Vision-Language Models (VLMs), enabling multimodal processing of visual and linguistic data. However, their application in domain-specific agricultural tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Khang Nguyen Quoc , Phuong D. Dao , Luyl-Da Quach

Healthcare data now span EHRs, medical imaging, genomics, and wearable sensors, but most diagnostic models still process these modalities in isolation. This limits their ability to capture early, cross-modal disease signatures. This paper…

Machine Learning · Computer Science 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

The Vision-Language Foundation model is increasingly investigated in the fields of computer vision and natural language processing, yet its exploration in ophthalmology and broader medical applications remains limited. The challenge is the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiawei Du , Jia Guo , Weihang Zhang , Shengzhu Yang , Hanruo Liu , Huiqi Li , Ningli Wang

Foundation models have recently achieved impressive success in computational pathology, demonstrating strong generalization across diverse histopathology tasks. However, existing models overlook the heterogeneous and non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Di Zhang , Zhangpeng Gong , Xiaobo Pang , Jiashuai Liu , Junbo Lu , Hao Cui , Jiusong Ge , Zhi Zeng , Kai Yi , Yinghua Li , Si Liu , Tingsong Yu , Haoran Wang , Mireia Crispin-Ortuzar , Weimiao Yu , Chen Li , Zeyu Gao

Microscopic interpretation of histopathology images underlies many important diagnostic and treatment decisions. While advances in vision-language modeling raise new opportunities for analysis of such images, the gigapixel-scale size of…

The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their…

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan

The recent surge of foundation models in computer vision and natural language processing opens up perspectives in utilizing multi-modal clinical data to train large models with strong generalizability. Yet pathological image datasets often…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Yunkun Zhang , Jin Gao , Mu Zhou , Xiaosong Wang , Yu Qiao , Shaoting Zhang , Dequan Wang

Since the emergence of the ImageNet dataset, the pretraining and fine-tuning approach has become widely adopted in computer vision due to the ability of ImageNet-pretrained models to learn a wide variety of visual features. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pablo Meseguer , Rocío del Amor , Adrian Colomer , Valery Naranjo

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Advancements in artificial intelligence have driven the development of numerous pathology foundation models capable of extracting clinically relevant information. However, there is currently limited literature independently evaluating these…

Despite their successes in vision and language, foundation models have stumbled in pathology, revealing low accuracy, instability, and heavy computational demands. These shortcomings stem not from tuning problems but from deeper conceptual…

Artificial Intelligence · Computer Science 2026-04-21 Hamid R. Tizhoosh

Multimodal foundation models that can holistically process text alongside images, video, audio, and other sensory modalities are increasingly used in a variety of real-world applications. However, it is challenging to characterize and study…

There exist numerous diagnostic tasks in pathology. Conventional computational pathology formulates and tackles them as independent and individual image classification problems, thereby resulting in computational inefficiency and high…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Anh Tien Nguyen , Keunho Byeon , Kyungeun Kim , Boram Song , Seoung Wan Chae , Jin Tae Kwak

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn