English
Related papers

Related papers: Multi-Modal Foundation Models for Computational Pa…

200 papers

The advent of foundation models has revolutionized the fields of natural language processing and computer vision, paving the way for their application in autonomous driving (AD). This survey presents a comprehensive review of more than 40…

Machine Learning · Computer Science 2024-09-06 Haoxiang Gao , Zhongruo Wang , Yaqian Li , Kaiwen Long , Ming Yang , Yiqing Shen

Healthcare foundation models have largely followed paradigms from natural language processing and computer vision, emphasizing large scale pretraining and deterministic representations over heterogeneous clinical data. However, clinical…

Machine Learning · Computer Science 2026-04-07 Qian Zhou , Yuanyun Zhang , Shi Li

Vision-Language Foundation Models (VLMs), trained on large-scale multimodal datasets, have driven significant advances in Artificial Intelligence (AI) by enabling rich cross-modal reasoning. Despite their success in general domains,…

Computational pathology needs whole-slide image (WSI) foundation models that transfer across diverse clinical tasks, yet current approaches remain largely slide-centric, often depend on private data and expensive paired-report supervision,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yousef Kotp , Vincent Quoc-Huy Trinh , Christopher Pal , Mahdi S. Hosseini

Histopathological images contain rich phenotypic information that can be used to monitor underlying mechanisms contributing to diseases progression and patient survival outcomes. Recently, deep learning has become the mainstream…

Image and Video Processing · Electrical Eng. & Systems 2020-10-28 Chetan L. Srinidhi , Ozan Ciga , Anne L. Martel

Medical imaging provides critical evidence for clinical diagnosis, treatment planning, and surgical decisions, yet most existing imaging models are narrowly focused and require multiple specialized networks, limiting their generalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Guoxin Wang , Jun Zhao , Xinyi Liu , Yanbo Liu , Xuyang Cao , Chao Li , Zhuoyun Liu , Qintian Sun , Fangru Zhou , Haoqiang Xing , Zhenhong Yang

Musculoskeletal disorders represent a leading cause of global disability, creating an urgent demand for precise interpretation of medical imaging. Current artificial intelligence (AI) approaches in orthopedics predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Kang Yu , Dingyu Wang , Zimu Yuan , Nan Zhou , Jiajun Liu , Jiaxin Liu , Shanggui Liu , Yaoyan Zheng , Huishu Yuan , Di Huang , Dong Jiang

Computational pathology (CPath) digitizes pathology slides into whole slide images (WSIs), enabling analysis for critical healthcare tasks such as cancer diagnosis and prognosis. However, WSIs possess extremely long sequence lengths (up to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Wenhao Tang , Heng Fang , Ge Wu , Xiang Li , Ming-Ming Cheng

The development of medical vision-language foundation models has attracted significant attention in the field of medicine and healthcare due to their promising prospect in various clinical applications. While previous studies have commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Weijian Huang , Cheng Li , Hong-Yu Zhou , Jiarun Liu , Hao Yang , Yong Liang , Guangming Shi , Hairong Zheng , Shanshan Wang

The advent of foundation models has heralded a new era in medical artificial intelligence (AI), enabling the extraction of generalizable representations from large-scale unlabeled datasets. However, current ophthalmic AI paradigms are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tienyu Chang , Zhen Chen , Renjie Liang , Jinyu Ding , Jie Xu , Sunu Mathew , Amir Reza Hajrasouliha , Andrew J. Saykin , Ruogu Fang , Yu Huang , Jiang Bian , Qingyu Chen

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Pathology reports are structured, multi-granular documents encoding diagnostic conclusions, histological grades, and ancillary test results across one or more anatomical sites; yet existing pathology vision-language models (VLMs) reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ruicheng Yuan , Zhenxuan Zhang , Anbang Wang , Liwei Hu , Xiangqian Hua , Yaya Peng , Jiawei Luo , Guang Yang

Histopathology is essential for disease diagnosis and treatment decision-making. Recent advances in artificial intelligence (AI) have enabled the development of pathology foundation models that learn rich visual representations from…

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Cancer research is increasingly driven by the integration of diverse data modalities, spanning from genomics and proteomics to imaging and clinical factors. However, extracting actionable insights from these vast and heterogeneous datasets…

Cell-level dense prediction is central to computational pathology, but remains challenging due to fine-grained histological structures, strong domain shifts, and costly dense annotations. Existing ViT-based pathology foundation models rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weiming Chen , Xitong Ling , Zhenyang Cai , Xidong Wang , Jiawen Li , Tian Guan , Benyou Wang , Yonghong He

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…

Foundation models learn highly transferable representations through large-scale pretraining on diverse data. An increasing body of research indicates that these representations exhibit a remarkable degree of similarity across architectures…

Artificial Intelligence · Computer Science 2025-10-08 Jianglin Lu , Hailing Wang , Yi Xu , Yizhou Wang , Kuo Yang , Yun Fu

Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are…

Machine Learning · Computer Science 2025-06-27 Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

Multimodal large language models (MLLMs) have emerged as powerful tools for computational pathology, offering unprecedented opportunities to integrate pathological images with language context for comprehensive diagnostic analysis. These…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Zhe Xu , Ziyi Liu , Junlin Hou , Jiabo Ma , Cheng Jin , Yihui Wang , Zhixuan Chen , Zhengyu Zhang , Fuxiang Huang , Zhengrui Guo , Fengtao Zhou , Yingxue Xu , Xi Wang , Ronald Cheong Kin Chan , Li Liang , Hao Chen