English
Related papers

Related papers: PolyPath: Adapting a Large Multimodal Model for Mu…

200 papers

Pathology images are considered the ``gold standard" for cancer diagnosis and treatment, with gigapixel images providing extensive tissue and cellular information. Existing methods fail to simultaneously extract global structural and local…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Haoming Luo , Xiaotian Yu , Shengxuming Zhang , Jiabin Xia , Yang Jian , Yuning Sun , Liang Xue , Mingli Song , Jing Zhang , Xiuming Zhang , Zunlei Feng

Pathology foundation models (PFMs) have enabled robust generalization in computational pathology through large-scale datasets and expansive architectures, but their substantial computational cost, particularly for gigapixel whole slide…

Despite significant advancements in general AI, its effectiveness in the medical domain is limited by the lack of specialized medical knowledge. To address this, we formulate GMAI-VL-5.5M, a multimodal medical dataset created by converting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Tianbin Li , Yanzhou Su , Wei Li , Bin Fu , Zhe Chen , Ziyan Huang , Guoan Wang , Chenglong Ma , Ying Chen , Ming Hu , Yanjun Li , Pengcheng Chen , Xiaowei Hu , Zhongying Deng , Yuanfeng Ji , Jin Ye , Yu Qiao , Junjun He

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). Existing approaches typically rely on frozen pre-trained models to extract instance features, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yi Lin , Zhengjie Zhu , Kwang-Ting Cheng , Hao Chen

Whole slide image (WSI) classification is a crucial problem for cancer diagnostics in clinics and hospitals. A WSI, acquired at gigapixel size, is commonly tiled into patches and processed by multiple-instance learning (MIL) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Doanh C. Bui , Jin Tae Kwak

Pathology is experiencing rapid digital transformation driven by whole-slide imaging and artificial intelligence (AI). While deep learning-based computational pathology has achieved notable success, traditional models primarily focus on…

Deep neural networks are increasingly applied in automated histopathology. Yet, whole-slide images (WSIs) are often acquired at gigapixel sizes, rendering them computationally infeasible to analyze entirely at high resolution. Diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Tarun G , Naman Malpani , Gugan Thoppe , Sridharan Devarajan

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Gabriele Campanella , Eugene Fluder , Jennifer Zeng , Chad Vanderbilt , Thomas J. Fuchs

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Recent accelerations in multi-modal applications have been made possible with the plethora of image and text data available online. However, the scarcity of analogous data in the medical field, specifically in histopathology, has slowed…

Background. Digital pathology has aroused widespread interest in modern pathology. The key of digitalization is to scan the whole slide image (WSI) at high magnification. The lager the magnification is, the richer details WSI will provide,…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Kai Sun , Yanhua Gao , Ting Xie , Xun Wang , Qingqing Yang , Le Chen , Kuansong Wang , Gang Yu

Digital gigapixel whole slide image (WSI) is widely used in clinical diagnosis, and automated WSI analysis is key for computer-aided diagnosis. Currently, analyzing the integrated descriptor of probabilities or feature maps from massive…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Ziquan Wei , Shenghua Cheng , Junbo Hu , Li Chen , Shaoqun Zeng , Xiuli Liu

With the rise of multimodal applications, instruction data has become critical for training multimodal language models capable of understanding complex image-based queries. Existing practices rely on powerful but costly large language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Jieyu Zhang , Le Xue , Linxin Song , Jun Wang , Weikai Huang , Manli Shu , An Yan , Zixian Ma , Juan Carlos Niebles , Silvio Savarese , Caiming Xiong , Zeyuan Chen , Ranjay Krishna , Ran Xu

In histopathology, tissue samples are often larger than a standard microscope slide, making stitching of multiple fragments necessary to process entire structures such as tumors. Automated stitching is a prerequisite for scaling analysis,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Stefan Brandstätter , Maximilian Köller , Philipp Seeböck , Alissa Blessing , Felicitas Oberndorfer , Svitlana Pochepnia , Helmut Prosch , Georg Langs

The application of deep learning to pathology assumes the existence of digital whole slide images of pathology slides. However, slide digitization is bottlenecked by the high cost of precise motor stages in slide scanners that are needed…

Image and Video Processing · Electrical Eng. & Systems 2020-11-13 Viswesh Krishna , Anirudh Joshi , Philip L. Bulterys , Eric Yang , Andrew Y. Ng , Pranav Rajpurkar

In digital pathology, Whole Slide Image (WSI) analysis is usually formulated as a Multiple Instance Learning (MIL) problem. Although transformer-based architectures have been used for WSI classification, these methods require modifications…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Juan I. Pisula , Katarzyna Bozek

Multimodal large language models (MLLMs) have achieved impressive performance across various tasks such as image captioning and visual question answer(VQA); however, they often struggle to accurately interpret depth information inherent in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hao Yang , Hongbo Zhang , Yanyan Zhao , Bing Qin

Interpretation of giga-pixel whole-slide images (WSIs) is an important but difficult task for pathologists. Their diagnostic accuracy is estimated to average around 70%. Adding a second pathologist does not substantially improve decision…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Veronica Thai , Rui Li , Meng Ling , Shuning Jiang , Jeremy Wolfe , Raghu Machiraju , Yan Hu , Zaibo Li , Anil Parwani , Jian Chen

Whole-slide image (WSI) analysis is challenging due to the gigapixel scale of slides and their inherent hierarchical multi-resolution structure. Existing multiple instance learning (MIL) approaches often model WSIs as unordered collections…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Dongqing Xie , Yonghuang Wu