English
Related papers

Related papers: To What Extent Do Token-Level Representations from…

200 papers

Driven by the recent advances in deep learning methods and, in particular, by the development of modern self-supervised learning algorithms, increased interest and efforts have been devoted to build foundation models (FMs) for medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 kaiko. ai , Nanne Aben , Edwin D. de Jong , Ioannis Gatopoulos , Nicolas Känzig , Mikhail Karasikov , Axel Lagré , Roman Moser , Joost van Doorn , Fei Tang

In computational pathology, several foundation models have recently emerged and demonstrated enhanced learning capability for analyzing pathology images. However, adapting these models to various downstream tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jeaung Lee , Jeewoo Lim , Keunho Byeon , Jin Tae Kwak

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

Computational pathology (CPath) has shown great potential in mining actionable insights from Whole Slide Images (WSIs). Deep Learning (DL) has been at the center of modern CPath, and while it delivers unprecedented performance, it is also…

Quantitative Methods · Quantitative Biology 2025-07-31 Gianluca Carloni , Biagio Brattoli , Seongho Keum , Jongchan Park , Taebum Lee , Chang Ho Ahn , Sergio Pereira

Pathology foundation models (PFMs) have become central to computational pathology, aiming to offer general encoders for feature extraction from whole-slide images (WSIs). Despite strong benchmark performance, PFM robustness to real-world…

Image and Video Processing · Electrical Eng. & Systems 2026-01-08 Erik Thiringer , Fredrik K. Gustafsson , Kajsa Ledesma Eriksson , Mattias Rantalainen

Revealing novel insights from the relationship between molecular measurements and pathology remains a very impactful application of machine learning in biomedicine. Data in this domain typically contain only a few observations but thousands…

Machine Learning · Computer Science 2026-03-31 Christopher Kolberg , Jules Kreuer , Jonas Huurdeman , Sofiane Ouaari , Katharina Eggensperger , Nico Pfeifer

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

The Genomic Foundation Model (GFM) paradigm is expected to facilitate the extraction of generalizable representations from massive genomic data, thereby enabling their application across a spectrum of downstream applications. Despite…

Genomics · Quantitative Biology 2024-06-06 Zicheng Liu , Jiahui Li , Siyuan Li , Zelin Zang , Cheng Tan , Yufei Huang , Yajing Bai , Stan Z. Li

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Pathology foundation models (PFMs) have advanced rapidly in recent years and support training classifiers for a range of histopathology tasks. However, their robustness across hospitals remains limited: performance often degrades when…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ben Vardi , Dana Schonberger , Yuval Friedmann , Zohar Yakhini , Iris Barshack , Alexander Loebel , Ariel Shamir

We present PDE-FM, a modular foundation model for physics-informed machine learning that unifies spatial, spectral, and temporal reasoning across heterogeneous partial differential equation (PDE) systems. PDE-FM combines spatial-spectral…

Machine Learning · Computer Science 2025-12-01 Eduardo Soares , Emilio Vital Brazil , Victor Shirasuna , Breno W. S. R. de Carvalho , Cristiano Malossi

Despite the promise of computational pathology foundation models, adapting them to specific clinical tasks remains challenging due to the complexity of whole-slide image (WSI) processing, the opacity of learned features, and the wide range…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Abdul Rahman Diab , Emily E. Karn , Renchin Wu , Emily S. Ruiz , William Lotter

Gene expression profiling provides critical insights into cellular heterogeneity, biological processes and disease mechanisms. There has been an increasing interest in computational approaches that can predict gene expression directly from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shi Pan , Jianan Chen , Maria Secrier

Foundation models pretrained on large-scale datasets are revolutionizing the field of computational pathology (CPath). The generalization ability of foundation models is crucial for the success in various downstream clinical tasks. However,…

Foundation models have revolutionized the paradigm of digital pathology, as they leverage general-purpose features to emulate real-world pathological practices, enabling the quantitative analysis of critical histological patterns and the…

Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in…

Recent years have witnessed a surge in the development of protein foundation models, significantly improving performance in protein prediction and generative tasks ranging from 3D structure prediction and protein design to conformational…

Quantitative Methods · Quantitative Biology 2024-10-08 Fei Ye , Zaixiang Zheng , Dongyu Xue , Yuning Shen , Lihao Wang , Yiming Ma , Yan Wang , Xinyou Wang , Xiangxin Zhou , Quanquan Gu