English
Related papers

Related papers: MPath: Multimodal Pathology Report Generation from…

200 papers

The rapid digitization of histopathology slides has opened up new possibilities for computational tools in clinical and research workflows. Among these, content-based slide retrieval stands out, enabling pathologists to identify…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hongyi Wang , Zhengjie Zhu , Jiabo Ma , Fang Wang , Yue Shi , Bo Luo , Jili Wang , Qiuyu Cai , Xiuming Zhang , Yen-Wei Chen , Lanfen Lin , Hao Chen

Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Kai Zhang , Zhongyi Shui , Bowen Ding , Tao Lin , Lin Yang

Whole Slide Image (WSI) MLLMs are difficult to build and deploy because gigapixel slides induce thousands of visual tokens, while only a small fraction of regions is diagnostically relevant. Existing slide-level pathology MLLMs typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qingqiao Hu , Weimin Lyu , Meilong Xu , Kehan Qi , Xiaoling Hu , Saumya Gupta , Jiawei Zhou , Chao Chen

Diagnosing diseases through histopathology whole slide images (WSIs) is fundamental in modern pathology but is challenged by the gigapixel scale and complexity of WSIs. Trained histopathologists overcome this challenge by navigating the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Fatemeh Ghezloo , Mehmet Saygin Seyfioglu , Rustin Soraki , Wisdom O. Ikezogwo , Beibin Li , Tejoram Vivekanandan , Joann G. Elmore , Ranjay Krishna , Linda Shapiro

Automating medical report generation from histopathology images is a critical challenge requiring effective visual representations and domain-specific knowledge. Inspired by the common practices of human experts, we propose an in-context…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Shih-Wen Liu , Hsuan-Yu Fan , Wei-Ta Chu , Fu-En Yang , Yu-Chiang Frank Wang

In digital pathology, whole-slide images (WSIs) are often difficult to handle due to their gigapixel scale, so most approaches train patch encoders via self-supervised learning (SSL) and then aggregate the patch-level embeddings via…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Myeongjang Pyeon , Janghyeon Lee , Minsoo Lee , Juseung Yun , Hwanil Choi , Jonghyun Kim , Jiwon Kim , Yi Hu , Jongseong Jang , Soonyoung Lee

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour

Pathological image segmentation faces numerous challenges, particularly due to ambiguous semantic boundaries and the high cost of pixel-level annotations. Although recent semi-supervised methods based on consistency regularization (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Mingxi Fu , Fanglei Fu , Xitong Ling , Huaitian Yuan , Tian Guan , Yonghong He , Lianghui Zhu

Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack…

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art methods has been a challenge due to the high…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Saurav Sengupta , Donald E. Brown

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

Pathology reports are structured, multi-granular documents encoding diagnostic conclusions, histological grades, and ancillary test results across one or more anatomical sites; yet existing pathology vision-language models (VLMs) reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ruicheng Yuan , Zhenxuan Zhang , Anbang Wang , Liwei Hu , Xiangqian Hua , Yaya Peng , Jiawei Luo , Guang Yang

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

Representation learning from Gigapixel Whole Slide Images (WSI) poses a significant challenge in computational pathology due to the complicated nature of tissue structures and the scarcity of labeled data. Multi-instance learning methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Ali Nasiri-Sarvi , Vincent Quoc-Huy Trinh , Hassan Rivaz , Mahdi S. Hosseini

Multimodal large language models (MLLMs) have emerged as powerful tools for computational pathology, offering unprecedented opportunities to integrate pathological images with language context for comprehensive diagnostic analysis. These…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Zhe Xu , Ziyi Liu , Junlin Hou , Jiabo Ma , Cheng Jin , Yihui Wang , Zhixuan Chen , Zhengyu Zhang , Fuxiang Huang , Zhengrui Guo , Fengtao Zhou , Yingxue Xu , Xi Wang , Ronald Cheong Kin Chan , Li Liang , Hao Chen

Recent methods for pathology report generation from whole-slide image (WSI) are capable of producing slide-level diagnostic descriptions but fail to ground fine-grained statements in localized visual evidence. Furthermore, they lack control…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Rundong Wang , Wei Ba , Ying Zhou , Yingtai Li , Bowen Liu , Baizhi Wang , Yuhao Wang , Zhidong Yang , Kun Zhang , Rui Yan , S. Kevin Zhou

Learning good representation of giga-pixel level whole slide pathology images (WSI) for downstream tasks is critical. Previous studies employ multiple instance learning (MIL) to represent WSIs as bags of sampled patches because, for most…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chunyuan Li , Xinliang Zhu , Jiawen Yao , Junzhou Huang

Recent advancements in computational pathology have produced patch-level Multi-modal Large Language Models (MLLMs), but these models are limited by their inability to analyze whole slide images (WSIs) comprehensively and their tendency to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuci Liang , Xinheng Lyu , Wenting Chen , Meidan Ding , Jipeng Zhang , Xiangjian He , Song Wu , Xiaohan Xing , Sen Yang , Xiyue Wang , Linlin Shen

With the development of digital imaging in medical microscopy, artificial intelligent-based analysis of pathological whole slide images (WSIs) provides a powerful tool for cancer diagnosis. Limited by the expensive cost of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jiawen Li , Qiehe Sun , Renao Yan , Yizhi Wang , Yuqiu Fu , Yani Wei , Tian Guan , Huijuan Shi , Yonghonghe He , Anjia Han