English
Related papers

Related papers: Benchmarking foundation models as feature extracto…

200 papers

Pathology has played a crucial role in the diagnosis and evaluation of patient tissue samples obtained from surgeries and biopsies for many years. The advent of Whole Slide Scanners and the development of deep learning technologies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Mieko Ochi , Daisuke Komura , Shumpei Ishikawa

Accurate cell nuclei segmentation is critical for downstream tasks in kidney pathology and remains a major challenge due to the morphological diversity and imaging variability of renal tissues. While our prior work has evaluated…

Despite the significant potential of Foundation Models (FMs) in medical imaging, their application to prognosis prediction remains challenging due to data scarcity, class imbalance, and task complexity, which limit their clinical adoption.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Filippo Ruffini , Elena Mulero Ayllon , Linlin Shen , Paolo Soda , Valerio Guarrasi

Accurately extracting clinical information from speech is critical to the diagnosis and treatment of many neurological conditions. As such, there is interest in leveraging AI for automatic, objective assessments of clinical speech to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Daniela A. Wiepert , Rene L. Utianski , Joseph R. Duffy , John L. Stricker , Leland R. Barnard , David T. Jones , Hugo Botha

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Eric Zimmermann , Julian Viret , Michal Zelechowski , James Brian Hall , Neil Tenenholtz , Adam Casson , George Shaikovski , Eugene Vorontsov , Siqi Liu , Kristen A Severson

Large pretrained visual foundation models exhibit impressive general capabilities. However, the extensive prior knowledge inherent in these models can sometimes be a double-edged sword when adapting them to downstream tasks in specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Qinghe Ma , Jian Zhang , Zekun Li , Lei Qi , Qian Yu , Yinghuan Shi

Due to the increasing workload of pathologists, the need for automation to support diagnostic tasks and quantitative biomarker evaluation is becoming more and more apparent. Foundation models have the potential to improve generalizability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Till Nicke , Jan Raphael Schaefer , Henning Hoefener , Friedrich Feuerhake , Dorit Merhof , Fabian Kiessling , Johannes Lotz

Deep learning has led to remarkable advancements in computational histopathology, e.g., in diagnostics, biomarker prediction, and outcome prognosis. Yet, the lack of annotated data and the impact of batch effects, e.g., systematic technical…

Machine Learning · Computer Science 2024-11-11 Jonah Kömen , Hannah Marienwald , Jonas Dippel , Julius Hense

Recent advances in digital pathology have demonstrated the effectiveness of foundation models across diverse applications. In this report, we present Atlas, a novel vision foundation model based on the RudolfV approach. Our model was…

The development of medical vision-language foundation models has attracted significant attention in the field of medicine and healthcare due to their promising prospect in various clinical applications. While previous studies have commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Weijian Huang , Cheng Li , Hong-Yu Zhou , Jiarun Liu , Hao Yang , Yong Liang , Guangming Shi , Hairong Zheng , Shanshan Wang

Foundation models have substantially advanced computational pathology by learning transferable visual representations from large histological datasets, yet their performance varies widely across tasks due to differences in training data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Wenhui Lei , Yusheng Tan , Anqi Li , Hanyu Chen , Hengrui Tian , Ruiying Li , Zhengqun Jiang , Fang Yan , Xiaofan Zhang , Shaoting Zhang

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Transcriptomic assays such as the PAM50-based ROR-P score guide recurrence risk stratification in non-metastatic, ER-positive, HER2-negative breast cancer but are not universally accessible. Histopathology is routinely available and may…

Computational pathology (CPath) has shown great potential in mining actionable insights from Whole Slide Images (WSIs). Deep Learning (DL) has been at the center of modern CPath, and while it delivers unprecedented performance, it is also…

Quantitative Methods · Quantitative Biology 2025-07-31 Gianluca Carloni , Biagio Brattoli , Seongho Keum , Jongchan Park , Taebum Lee , Chang Ho Ahn , Sergio Pereira

Computational pathology holds substantial promise for improving diagnosis and guiding treatment decisions. Recent pathology foundation models enable the extraction of rich patch-level representations from large-scale whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Xiangde Luo , Jinxi Xiang , Yuanfeng Ji , Ruijiang Li

Foundation models are reshaping computational pathology by enabling transfer learning, where models pre-trained on vast datasets can be adapted for downstream diagnostic, prognostic, and therapeutic response tasks. Despite these advances,…

In histopathology, pathologists examine both tissue architecture at low magnification and fine-grained morphology at high magnification. Yet, the performance of pathology foundation models across magnifications and the effect of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Alexander Möllers , Julius Hense , Florian Schulz , Timo Milbich , Maximilian Alber , Lukas Ruff

Current foundation models exhibit impressive capabilities when prompted either with text only or with both image and text inputs. But do their capabilities change depending on the input modality? In this work, we propose…

Artificial Intelligence · Computer Science 2024-08-20 Deqing Fu , Ruohao Guo , Ghazal Khalighinejad , Ollie Liu , Bhuwan Dhingra , Dani Yogatama , Robin Jia , Willie Neiswanger

Since the emergence of the ImageNet dataset, the pretraining and fine-tuning approach has become widely adopted in computer vision due to the ability of ImageNet-pretrained models to learn a wide variety of visual features. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pablo Meseguer , Rocío del Amor , Adrian Colomer , Valery Naranjo