中文
相关论文

相关论文: PRISM2: Unlocking Multi-Modal General Pathology AI…

200 篇论文

Developing reliable and generalizable deep learning systems for medical imaging faces significant obstacles due to spurious correlations, data imbalances, and limited text annotations in datasets. Addressing these challenges requires…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Amar Kumar , Anita Kriz , Mohammad Havaei , Tal Arbel

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Moona Mazher , Geoff J. M. Parker , Daniel C. Alexander

Foundation models have recently achieved impressive success in computational pathology, demonstrating strong generalization across diverse histopathology tasks. However, existing models overlook the heterogeneous and non-uniform…

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

CLIP is a seminal multimodal model that maps images and text into a shared representation space through contrastive learning on billions of image-caption pairs. Inspired by the rapid progress of large language models (LLMs), we investigate…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Weiquan Huang , Aoqi Wu , Yifan Yang , Xufang Luo , Yuqing Yang , Usman Naseem , Chunyu Wang , Chunyu Wang , Qi Dai , Xiyang Dai , Dongdong Chen , Chong Luo , Lili Qiu , Liang Hu

Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in…

Prediction tasks in digital pathology are challenging due to the massive size of whole-slide images (WSIs) and the weak nature of training signals. Advances in computing, data availability, and self-supervised learning (SSL) have paved the…

图像与视频处理 · 电气工程与系统科学 2026-02-02 Vishwesh Ramanathan , Tony Xu , Pushpak Pati , Faruk Ahmed , Maged Goubran , Anne L. Martel

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Medical foundation models have shown promise in controlled benchmarks, yet widespread deployment remains hindered by reliance on task-specific fine-tuning. Here, we introduce DermFM-Zero, a dermatology vision-language foundation model…

Foundation models are rapidly being developed for computational pathology applications. However, it remains an open question which factors are most important for downstream performance with data scale and diversity, model size, and training…

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour

In the field of computational histopathology, both whole slide images (WSIs) and diagnostic captions provide valuable insights for making diagnostic decisions. However, aligning WSIs with diagnostic captions presents a significant…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Qifeng Zhou , Wenliang Zhong , Yuzhi Guo , Michael Xiao , Hehuan Ma , Junzhou Huang

Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Kai Zhang , Zhongyi Shui , Bowen Ding , Tao Lin , Lin Yang

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

Vision-language models (VLMs) have the potential to become co-pilots for pathologists. However, most VLMs either focus on small regions of interest within whole-slide images, provide only static slide-level outputs, or rely on data that is…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Sander Moonemans , Sebastiaan Ram , Frédérique Meeuwsen , Carlijn Lems , Jeroen van der Laak , Geert Litjens , Francesco Ciompi

Whole slide imaging (WSI) has transformed digital pathology by enabling computational analysis of gigapixel histopathology images. Recent foundation model advances have accelerated progress in computational pathology, facilitating joint…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Peihang Wu , Zehong Chen , Lijian Xu

Foundation models are reshaping computational histopathology, yet their value for whole-slide image retrieval relative to strong patch-based and supervised aggregation baselines remains unclear. We benchmarked ten pipelines on 9,387…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Tianhao Lei , Parsa Esmaeilkhani , Saghir Alfasly , Wataru Uegami , Judy C. Boughey , Matthew P. Goetz , Krishna R. Kalari , H. R. Tizhoosh

Vision-language foundation models like CLIP have revolutionized the field of artificial intelligence. Nevertheless, VLM models supporting multi-language, e.g., in both Chinese and English, have lagged due to the relative scarcity of…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Qingpei Guo , Furong Xu , Hanxiao Zhang , Wang Ren , Ziping Ma , Lin Ju , Jian Wang , Jingdong Chen , Ming Yang

Despite the progress made by multimodal large language models (MLLMs) in computational pathology, they remain limited by a predominant focus on patch-level analysis, missing essential contextual information at the whole-slide level. The…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Ying Chen , Guoan Wang , Yuanfeng Ji , Yanjun Li , Jin Ye , Tianbin Li , Ming Hu , Rongshan Yu , Yu Qiao , Junjun He