English
Related papers

Related papers: Do Pathology Foundation Models Encode Disease Prog…

200 papers

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Due to the increasing workload of pathologists, the need for automation to support diagnostic tasks and quantitative biomarker evaluation is becoming more and more apparent. Foundation models have the potential to improve generalizability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Till Nicke , Jan Raphael Schaefer , Henning Hoefener , Friedrich Feuerhake , Dorit Merhof , Fabian Kiessling , Johannes Lotz

Neural networks achieve state-of-the-art performance in many supervised learning tasks when the training data distribution matches the test data distribution. However, their performance drops significantly under domain (covariate) shift, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kerem Cekmeceli , Meva Himmetoglu , Guney I. Tombak , Anna Susmelj , Ertunc Erdil , Ender Konukoglu

Recent advances in large-scale pretraining have yielded visual foundation models with strong capabilities. Not only can recent models generalize to arbitrary images for their training task, their intermediate representations are useful for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Mohamed El Banani , Amit Raj , Kevis-Kokitsi Maninis , Abhishek Kar , Yuanzhen Li , Michael Rubinstein , Deqing Sun , Leonidas Guibas , Justin Johnson , Varun Jampani

Advancements in artificial intelligence have driven the development of numerous pathology foundation models capable of extracting clinically relevant information. However, there is currently limited literature independently evaluating these…

Understanding the biological mechanisms of disease is crucial for medicine, and in particular, for drug discovery. AI-powered analysis of genome-scale biological data holds great potential in this regard. The increasing availability of…

Cell-level dense prediction is central to computational pathology, but remains challenging due to fine-grained histological structures, strong domain shifts, and costly dense annotations. Existing ViT-based pathology foundation models rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weiming Chen , Xitong Ling , Zhenyang Cai , Xidong Wang , Jiawen Li , Tian Guan , Benyou Wang , Yonghong He

Gene expression profiling provides critical insights into cellular heterogeneity, biological processes and disease mechanisms. There has been an increasing interest in computational approaches that can predict gene expression directly from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shi Pan , Jianan Chen , Maria Secrier

Recently, several studies have reported on the fine-tuning of foundation models for image-text modeling in the field of medicine, utilizing images from online data sources such as Twitter and PubMed. Foundation models are large, deep…

Pathology Foundation Models (FMs) hold great promise for healthcare. Before they can be used in clinical practice, it is essential to ensure they are robust to variations between medical centers. We measure whether pathology FMs focus on…

Machine Learning · Computer Science 2025-02-04 Edwin D. de Jong , Eric Marcus , Jonas Teuwen

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

Single-cell RNA sequencing (scRNA-seq) data exhibit strong and reproducible statistical structure. This has motivated the development of large-scale foundation models, such as TranscriptFormer, that use transformer-based architectures to…

Genomics · Quantitative Biology 2026-02-19 Huan Souza , Pankaj Mehta

Driven by the recent advances in deep learning methods and, in particular, by the development of modern self-supervised learning algorithms, increased interest and efforts have been devoted to build foundation models (FMs) for medical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 kaiko. ai , Nanne Aben , Edwin D. de Jong , Ioannis Gatopoulos , Nicolas Känzig , Mikhail Karasikov , Axel Lagré , Roman Moser , Joost van Doorn , Fei Tang

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Foundation models have revolutionized computational pathology by achieving remarkable success in high-level diagnostic tasks, yet the critical challenge of low-level image enhancement remains largely unaddressed. Real-world pathology images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ziyi Liu , Zhe Xu , Jiabo Ma , Wenqaing Li , Junlin Hou , Fuxiang Huang , Xi Wang , Ronald Cheong Kin Chan , Terence Tsz Wai Wong , Hao Chen

Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Maxime W. Lafarge , Josien P. W. Pluim , Mitko Veta

Recently, data-driven deep saliency models have achieved high performance and have outperformed classical saliency models, as demonstrated by results on datasets such as the MIT300 and SALICON. Yet, there remains a large gap between the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Sen He , Hamed R. Tavakoli , Ali Borji , Yang Mi , Nicolas Pugeault

Computational pathology has made significant progress in recent years, fueling advances in both fundamental disease understanding and clinically ready tools. This evolution is driven by the availability of large amounts of digitized slides…

Foundation models pretrained on large-scale datasets are revolutionizing the field of computational pathology (CPath). The generalization ability of foundation models is crucial for the success in various downstream clinical tasks. However,…

Generative AI framework-based modeling and prediction of longitudinal human brain images offer an efficient mechanism to track neurodegenerative progression, essential for the assessment of diseases like Alzheimer's. Among the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ayantika Das , Keerthi Ram , Mohanasankar Sivaprakasam