中文
相关论文

相关论文: PolyPath: Adapting a Large Multimodal Model for Mu…

200 篇论文

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challenge due to the high…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Saurav Sengupta , Donald E. Brown

Vision Language Models (VLMs) like CLIP have attracted substantial attention in pathology, serving as backbones for applications such as zero-shot image classification and Whole Slide Image (WSI) analysis. Additionally, they can function as…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Yuxuan Sun , Yunlong Zhang , Yixuan Si , Chenglu Zhu , Zhongyi Shui , Kai Zhang , Jingxiong Li , Xingheng Lyu , Tao Lin , Lin Yang

Whole Slide Imaging (WSI) is a cornerstone of digital pathology, offering detailed insights critical for diagnosis and research. Yet, the gigapixel size of WSIs imposes significant computational challenges, limiting their practical utility.…

图像与视频处理 · 电气工程与系统科学 2024-11-15 Ravi Kant Gupta , Shounak Das , Amit Sethi

Despite remarkable efforts been made, the classification of gigapixels whole-slide image (WSI) is severely restrained from either the constrained computing resources for the whole slides, or limited utilizing of the knowledge from different…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Ming Feng , Kele Xu , Nanhui Wu , Weiquan Huang , Yan Bai , Changjian Wang , Huaimin Wang

Despite the progress made by multimodal large language models (MLLMs) in computational pathology, they remain limited by a predominant focus on patch-level analysis, missing essential contextual information at the whole-slide level. The…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Ying Chen , Guoan Wang , Yuanfeng Ji , Yanjun Li , Jin Ye , Tianbin Li , Ming Hu , Rongshan Yu , Yu Qiao , Junjun He

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

计算与语言 · 计算机科学 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

In this paper, we address the challenge of few-shot classification in histopathology whole slide images (WSIs) by utilizing foundational vision-language models (VLMs) and slide-level prompt learning. Given the gigapixel scale of WSIs,…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Devavrat Tomar , Guillaume Vray , Dwarikanath Mahapatra , Sudipta Roy , Jean-Philippe Thiran , Behzad Bozorgtabar

Recent advances in agentic artificial intelligence, i.e. systems capable of autonomous perception, reasoning, and tool use, offer new opportunities for digital pathology. In this pilot study, we evaluate whether two agentic multimodal AI…

人机交互 · 计算机科学 2026-01-21 Marc Aubreville , Taryn A. Donovan , Christof A. Bertram

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…

The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to identify…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hongyi Wang , Zhengjie Zhu , Jiabo Ma , Fang Wang , Yue Shi , Bo Luo , Jili Wang , Qiuyu Cai , Xiuming Zhang , Yen-Wei Chen , Lanfen Lin , Hao Chen

Multiple Instance Learning (MIL) methods allow for gigapixel Whole-Slide Image (WSI) analysis with only slide-level annotations. Interpretability is crucial for safely deploying such algorithms in high-stakes medical domains. Traditional…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Susu Sun , Leslie Tessier , Frédérique Meeuwsen , Clément Grisi , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

图像与视频处理 · 电气工程与系统科学 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

Histopathology whole slide images (WSIs) play a very important role in clinical studies and serve as the gold standard for many cancer diagnoses. However, generating automatic tools for processing WSIs is challenging due to their enormous…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Jingwei Zhang , Xin Zhang , Ke Ma , Rajarsi Gupta , Joel Saltz , Maria Vakalopoulou , Dimitris Samaras

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

图像与视频处理 · 电气工程与系统科学 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

Medical images and radiology reports are crucial for diagnosing medical conditions, highlighting the importance of quantitative analysis for clinical decision-making. However, the diversity and cross-source heterogeneity of these data…

图像与视频处理 · 电气工程与系统科学 2024-07-09 Yutong Zhang , Yi Pan , Tianyang Zhong , Peixin Dong , Kangni Xie , Yuxiao Liu , Hanqi Jiang , Zhengliang Liu , Shijie Zhao , Tuo Zhang , Xi Jiang , Dinggang Shen , Tianming Liu , Xin Zhang

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Whole slide images (WSIs) in computational pathology (CPath) pose a major computational challenge due to their gigapixel scale, often requiring the processing of tens to hundreds of thousands of high-resolution patches per slide. This…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Yonghan Shin , SeungKyu Kim , Won-Ki Jeong

Pathology reports are rich in clinical and pathological details but are often presented in free-text format. The unstructured nature of these reports presents a significant challenge limiting the accessibility of their content. In this…

计算与语言 · 计算机科学 2024-11-28 Ethar Alzaid , Gabriele Pergola , Harriet Evans , David Snead , Fayyaz Minhas

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…