English
Related papers

Related papers: PolyPath: Adapting a Large Multimodal Model for Mu…

200 papers

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challenge due to the high…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Saurav Sengupta , Donald E. Brown

Vision Language Models (VLMs) like CLIP have attracted substantial attention in pathology, serving as backbones for applications such as zero-shot image classification and Whole Slide Image (WSI) analysis. Additionally, they can function as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yuxuan Sun , Yunlong Zhang , Yixuan Si , Chenglu Zhu , Zhongyi Shui , Kai Zhang , Jingxiong Li , Xingheng Lyu , Tao Lin , Lin Yang

Whole Slide Imaging (WSI) is a cornerstone of digital pathology, offering detailed insights critical for diagnosis and research. Yet, the gigapixel size of WSIs imposes significant computational challenges, limiting their practical utility.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-15 Ravi Kant Gupta , Shounak Das , Amit Sethi

Despite remarkable efforts been made, the classification of gigapixels whole-slide image (WSI) is severely restrained from either the constrained computing resources for the whole slides, or limited utilizing of the knowledge from different…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ming Feng , Kele Xu , Nanhui Wu , Weiquan Huang , Yan Bai , Changjian Wang , Huaimin Wang

Despite the progress made by multimodal large language models (MLLMs) in computational pathology, they remain limited by a predominant focus on patch-level analysis, missing essential contextual information at the whole-slide level. The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ying Chen , Guoan Wang , Yuanfeng Ji , Yanjun Li , Jin Ye , Tianbin Li , Ming Hu , Rongshan Yu , Yu Qiao , Junjun He

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

In this paper, we address the challenge of few-shot classification in histopathology whole slide images (WSIs) by utilizing foundational vision-language models (VLMs) and slide-level prompt learning. Given the gigapixel scale of WSIs,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Devavrat Tomar , Guillaume Vray , Dwarikanath Mahapatra , Sudipta Roy , Jean-Philippe Thiran , Behzad Bozorgtabar

Recent advances in agentic artificial intelligence, i.e. systems capable of autonomous perception, reasoning, and tool use, offer new opportunities for digital pathology. In this pilot study, we evaluate whether two agentic multimodal AI…

Human-Computer Interaction · Computer Science 2026-01-21 Marc Aubreville , Taryn A. Donovan , Christof A. Bertram

Whole slide pathology image classification presents challenges due to gigapixel image sizes and limited annotation labels, hindering model generalization. This paper introduces a prompt learning method to adapt large vision-language models…

The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to identify…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hongyi Wang , Zhengjie Zhu , Jiabo Ma , Fang Wang , Yue Shi , Bo Luo , Jili Wang , Qiuyu Cai , Xiuming Zhang , Yen-Wei Chen , Lanfen Lin , Hao Chen

Multiple Instance Learning (MIL) methods allow for gigapixel Whole-Slide Image (WSI) analysis with only slide-level annotations. Interpretability is crucial for safely deploying such algorithms in high-stakes medical domains. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Susu Sun , Leslie Tessier , Frédérique Meeuwsen , Clément Grisi , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

Image and Video Processing · Electrical Eng. & Systems 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

Histopathology whole slide images (WSIs) play a very important role in clinical studies and serve as the gold standard for many cancer diagnoses. However, generating automatic tools for processing WSIs is challenging due to their enormous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jingwei Zhang , Xin Zhang , Ke Ma , Rajarsi Gupta , Joel Saltz , Maria Vakalopoulou , Dimitris Samaras

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

Image and Video Processing · Electrical Eng. & Systems 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

Medical images and radiology reports are crucial for diagnosing medical conditions, highlighting the importance of quantitative analysis for clinical decision-making. However, the diversity and cross-source heterogeneity of these data…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Yutong Zhang , Yi Pan , Tianyang Zhong , Peixin Dong , Kangni Xie , Yuxiao Liu , Hanqi Jiang , Zhengliang Liu , Shijie Zhao , Tuo Zhang , Xi Jiang , Dinggang Shen , Tianming Liu , Xin Zhang

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

Whole slide images (WSIs) in computational pathology (CPath) pose a major computational challenge due to their gigapixel scale, often requiring the processing of tens to hundreds of thousands of high-resolution patches per slide. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yonghan Shin , SeungKyu Kim , Won-Ki Jeong

Pathology reports are rich in clinical and pathological details but are often presented in free-text format. The unstructured nature of these reports presents a significant challenge limiting the accessibility of their content. In this…

Computation and Language · Computer Science 2024-11-28 Ethar Alzaid , Gabriele Pergola , Harriet Evans , David Snead , Fayyaz Minhas

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Eric Zimmermann , Julian Viret , Michal Zelechowski , James Brian Hall , Neil Tenenholtz , Adam Casson , George Shaikovski , Eugene Vorontsov , Siqi Liu , Kristen A Severson