English
Related papers

Related papers: PLUTO-4: Frontier Pathology Foundation Models

200 papers

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

Pre-trained transformers are often fine-tuned to aid clinical decision-making using limited clinical notes. Model interpretability is crucial, especially in high-stakes domains like medicine, to establish trust and ensure safety, which…

Computation and Language · Computer Science 2024-02-28 Aliyah R. Hsu , Yeshwanth Cherapanamjeri , Briton Park , Tristan Naumann , Anobel Y. Odisho , Bin Yu

Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Yu , Joakim Nguyen , Jinrui Fang , Awais Naeem , Zeyuan Cao , Sanjay Krishnan , Nicholas Konz , Tianlong Chen , Chandra Krishnan , Hairong Wang , Edward Castillo , Ying Ding , Ankita Shukla

Foundation models pretrained on large-scale pathology datasets have shown promising results across various diagnostic tasks. Here, we present a systematic evaluation of transfer learning strategies for brain tumor classification using these…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Ken Enda , Yoshitaka Oda , Zen-ichi Tanei , Kenichi Satoh , Hiroaki Motegi , Terasaka Shunsuke , Shigeru Yamaguchi , Takahiro Ogawa , Wang Lei , Masumi Tsuda , Shinya Tanaka

Generalist pathology foundation models (PFMs), pretrained on large-scale multi-organ datasets, have demonstrated remarkable predictive capabilities across diverse clinical applications. However, their proficiency on the full spectrum of…

Accurate diagnosis and treatment of complex diseases require integrating histological, molecular, and clinical data, yet in practice these modalities are often incomplete owing to tissue scarcity, assay cost, and workflow constraints.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jinxi Xiang , Mingjie Li , Siyu Hou , Yijiang Chen , Xiangde Luo , Yuanfeng Ji , Xiang Zhou , Ehsan Adeli , Akshay Chaudhari , Curtis P. Langlotz , Kilian M. Pohl , Ruijiang Li

Foundation models pre-trained on large-scale natural image datasets offer a powerful paradigm for medical image segmentation. However, effectively transferring their learned representations for precise clinical applications remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haoyue Li , Yifan Gao , Feng Yuan , Xiaosong Wang , Xin Gao

The rapid expansion of multi-source satellite imagery drives innovation in Earth observation, opening unprecedented opportunities for Remote Sensing Foundation Models to harness diverse data. However, many existing models remain constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xuyang Li , Chenyu Li , Pedram Ghamisi , Danfeng Hong

The scaling laws and extraordinary performance of large foundation models motivate the development and utilization of such models in biomedicine. However, despite early promising results on some biomedical benchmarks, there are still major…

Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in…

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan

State-of-the-art vessel segmentation methods typically require large-scale annotated datasets and suffer from severe performance degradation under domain shifts. In clinical practice, however, acquiring extensive annotations for every new…

Image and Video Processing · Electrical Eng. & Systems 2026-03-02 Kirato Yoshihara , Yohei Sugawara , Yuta Tokuoka , Lihang Hong

Pathology foundation models (PFMs) have demonstrated strong representational capabilities through self-supervised pre-training on large-scale, unannotated histopathology image datasets. However, their diverse yet opaque pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuxiang Xiao , Yang Hu , Bin Li , Tianyang Zhang , Zexi Li , Huazhu Fu , Jens Rittscher , Kaixiang Yang

This paper addresses complex challenges in histopathological image analysis through three key contributions. Firstly, it introduces a fast patch selection method, FPS, for whole-slide image (WSI) analysis, significantly reducing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Saghir Alfasly , Abubakr Shafique , Peyman Nejat , Jibran Khan , Areej Alsaafin , Ghazal Alabtah , H. R. Tizhoosh

Foundation models (FoMos), referring to large-scale AI models, possess human-like capabilities and are able to perform competitively in the domain of human intelligence. The breakthrough in FoMos has inspired researchers to deploy such…

Networking and Internet Architecture · Computer Science 2023-10-31 Hai Wu , Xu Chen , Kaibin Huang

Foundation models are predominantly trained in an unsupervised or self-supervised manner on highly diverse and large-scale datasets, making them broadly applicable to various downstream tasks. In this work, we investigate for the first time…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Tahar Chettaoui , Naser Damer , Fadi Boutros

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Cancer progression arises from interactions across multiple biological layers, especially beyond morphological and across molecular layers that remain invisible to image-only models. To capture this broader biological landscape, we present…

Machine Learning · Computer Science 2025-12-17 Juseung Yun , Sunwoo Yu , Sumin Ha , Jonghyun Kim , Janghyeon Lee , Jongseong Jang , Soonyoung Lee

Skin diseases impose a substantial burden on global healthcare systems, driven by their high prevalence (affecting up to 70% of the population), complex diagnostic processes, and a critical shortage of dermatologists in resource-limited…

Pretraining on large-scale, in-domain datasets grants histopathology foundation models (FM) the ability to learn task-agnostic data representations, enhancing transfer learning on downstream tasks. In computational pathology, automated…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Pablo Meseguer , Rocío del Amor , Valery Naranjo