English
Related papers

Related papers: PRISM: A Multi-Modal Generative Foundation Model f…

200 papers

The use of artificial intelligence to enable precision medicine and decision support systems through the analysis of pathology images has the potential to revolutionize the diagnosis and treatment of cancer. Such applications will depend on…

In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are still several…

Large amounts of digitized histopathological data display a promising future for developing pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shengyi Hua , Fang Yan , Tianle Shen , Lei Ma , Xiaofan Zhang

Since the emergence of the ImageNet dataset, the pretraining and fine-tuning approach has become widely adopted in computer vision due to the ability of ImageNet-pretrained models to learn a wide variety of visual features. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Pablo Meseguer , Rocío del Amor , Adrian Colomer , Valery Naranjo

Foundation models are reshaping computational histopathology, yet their value for whole-slide image retrieval relative to strong patch-based and supervised aggregation baselines remains unclear. We benchmarked ten pipelines on 9,387…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tianhao Lei , Parsa Esmaeilkhani , Saghir Alfasly , Wataru Uegami , Judy C. Boughey , Matthew P. Goetz , Krishna R. Kalari , H. R. Tizhoosh

We introduce Projection-based Reduction of Implicit Spurious bias in vision-language Models (PRISM), a new data-free and task-agnostic solution for bias mitigation in VLMs like CLIP. VLMs often inherit and amplify biases in their training…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mahdiyar Molahasani , Azadeh Motamedi , Michael Greenspan , Il-Min Kim , Ali Etemad

Melanoma is an aggressive form of skin cancer with rapid progression and high metastatic potential. Accurate characterisation of tissue morphology in melanoma is crucial for prognosis and treatment planning. However, manual segmentation of…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Jiaqi Lv , Yijie Zhu , Carmen Guadalupe Colin Tenorio , Brinder Singh Chohan , Mark Eastwood , Shan E Ahmed Raza

Histopathology is essential for disease diagnosis and treatment decision-making. Recent advances in artificial intelligence (AI) have enabled the development of pathology foundation models that learn rich visual representations from…

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

In this paper, we propose Precision-Informed Semantic Modeling (PRISM), a structured topic modeling framework combining the benefits of rich representations captured by LLMs with the low cost and interpretability of latent semantic…

Machine Learning · Computer Science 2026-04-06 Connor Douglas , Utkucan Balci , Joseph Aylett-Bullock

Representation learning of pathology whole-slide images (WSIs) has primarily relied on weak supervision with Multiple Instance Learning (MIL). This approach leads to slide representations highly tailored to a specific clinical task.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tim Lenz , Peter Neidlinger , Marta Ligero , Georg Wölflein , Marko van Treeck , Jakob Nikolas Kather

In pathological research, education, and clinical practice, the decision-making process based on pathological images is critically important. This significance extends to digital pathology image analysis: its adequacy is demonstrated by the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Zhi-Bo Liu , Xiaobo Pang , Jizhao Wang , Shuai Liu , Chen Li

The rapid generation of whole-slide images (WSIs) in dermatopathology necessitates automated methods for efficient processing and accurate classification. This study evaluates the performance of two foundation models, UNI and Virchow2, as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Riya Gupta , Yiwei Zong , Dennis H. Murphree

Computational pathology holds substantial promise for improving diagnosis and guiding treatment decisions. Recent pathology foundation models enable the extraction of rich patch-level representations from large-scale whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Xiangde Luo , Jinxi Xiang , Yuanfeng Ji , Ruijiang Li

Self-supervised learning (SSL) has been successful in building patch embeddings of small histology images (e.g., 224x224 pixels), but scaling these models to learn slide embeddings from the entirety of giga-pixel whole-slide images (WSIs)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Guillaume Jaume , Lukas Oldenburg , Anurag Vaidya , Richard J. Chen , Drew F. K. Williamson , Thomas Peeters , Andrew H. Song , Faisal Mahmood

Whole-slide image analysis via the means of computational pathology often relies on processing tessellated gigapixel images with only slide-level labels available. Applying multiple instance learning-based methods or transformer models is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Joshua Butke , Noriaki Hashimoto , Ichiro Takeuchi , Hiroaki Miyoshi , Koichi Ohshima , Jun Sakuma

Artificial intelligence foundation models are increasingly deployed for prostate cancer Gleason grading, where GP3/GP4 distinction directly impacts treatment decisions. However, these models may achieve high validation accuracy by learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Joshua L. Ebbert , Dennis Della Corte

Simulation plays a central role in scientific discovery. In many applications, the bottleneck is no longer running a simulator; it is choosing among large families of plausible simulators, each corresponding to different forward…

Timely and accurate lymphoma diagnosis is essential for guiding cancer treatment. Standard diagnostic practice combines hematoxylin and eosin (HE)-stained whole slide images with immunohistochemistry, flow cytometry, and molecular genetic…