中文
相关论文

相关论文: PolyPath: Adapting a Large Multimodal Model for Mu…

200 篇论文

Pathology images are considered the ``gold standard" for cancer diagnosis and treatment, with gigapixel images providing extensive tissue and cellular information. Existing methods fail to simultaneously extract global structural and local…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Haoming Luo , Xiaotian Yu , Shengxuming Zhang , Jiabin Xia , Yang Jian , Yuning Sun , Liang Xue , Mingli Song , Jing Zhang , Xiuming Zhang , Zunlei Feng

Pathology foundation models (PFMs) have enabled robust generalization in computational pathology through large-scale datasets and expansive architectures, but their substantial computational cost, particularly for gigapixel whole slide…

Despite significant advancements in general AI, its effectiveness in the medical domain is limited by the lack of specialized medical knowledge. To address this, we formulate GMAI-VL-5.5M, a multimodal medical dataset created by converting…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Tianbin Li , Yanzhou Su , Wei Li , Bin Fu , Zhe Chen , Ziyan Huang , Guoan Wang , Chenglong Ma , Ying Chen , Ming Hu , Yanjun Li , Pengcheng Chen , Xiaowei Hu , Zhongying Deng , Yuanfeng Ji , Jin Ye , Yu Qiao , Junjun He

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). Existing approaches typically rely on frozen pre-trained models to extract instance features, neglecting the…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Yi Lin , Zhengjie Zhu , Kwang-Ting Cheng , Hao Chen

Whole slide image (WSI) classification is a crucial problem for cancer diagnostics in clinics and hospitals. A WSI, acquired at gigapixel size, is commonly tiled into patches and processed by multiple-instance learning (MIL) models.…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Doanh C. Bui , Jin Tae Kwak

Pathology is experiencing rapid digital transformation driven by whole-slide imaging and artificial intelligence (AI). While deep learning-based computational pathology has achieved notable success, traditional models primarily focus on…

Deep neural networks are increasingly applied in automated histopathology. Yet, whole-slide images (WSIs) are often acquired at gigapixel sizes, rendering them computationally infeasible to analyze entirely at high resolution. Diagnostic…

图像与视频处理 · 电气工程与系统科学 2026-02-10 Tarun G , Naman Malpani , Gugan Thoppe , Sridharan Devarajan

The Vision Foundation Model has recently gained attention in medical image analysis. Its zero-shot learning capabilities accelerate AI deployment and enhance the generalizability of clinical applications. However, segmenting pathological…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Can Cui , Ruining Deng , Junlin Guo , Quan Liu , Tianyuan Yao , Haichun Yang , Yuankai Huo

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and…

图像与视频处理 · 电气工程与系统科学 2024-05-24 Gabriele Campanella , Eugene Fluder , Jennifer Zeng , Chad Vanderbilt , Thomas J. Fuchs

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Recent accelerations in multi-modal applications have been made possible with the plethora of image and text data available online. However, the scarcity of analogous data in the medical field, specifically in histopathology, has slowed…

Background. Digital pathology has aroused widespread interest in modern pathology. The key of digitalization is to scan the whole slide image (WSI) at high magnification. The lager the magnification is, the richer details WSI will provide,…

图像与视频处理 · 电气工程与系统科学 2021-08-03 Kai Sun , Yanhua Gao , Ting Xie , Xun Wang , Qingqing Yang , Le Chen , Kuansong Wang , Gang Yu

Digital gigapixel whole slide image (WSI) is widely used in clinical diagnosis, and automated WSI analysis is key for computer-aided diagnosis. Currently, analyzing the integrated descriptor of probabilities or feature maps from massive…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Ziquan Wei , Shenghua Cheng , Junbo Hu , Li Chen , Shaoqun Zeng , Xiuli Liu

With the rise of multimodal applications, instruction data has become critical for training multimodal language models capable of understanding complex image-based queries. Existing practices rely on powerful but costly large language…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Jieyu Zhang , Le Xue , Linxin Song , Jun Wang , Weikai Huang , Manli Shu , An Yan , Zixian Ma , Juan Carlos Niebles , Silvio Savarese , Caiming Xiong , Zeyuan Chen , Ranjay Krishna , Ran Xu

In histopathology, tissue samples are often larger than a standard microscope slide, making stitching of multiple fragments necessary to process entire structures such as tumors. Automated stitching is a prerequisite for scaling analysis,…

The application of deep learning to pathology assumes the existence of digital whole slide images of pathology slides. However, slide digitization is bottlenecked by the high cost of precise motor stages in slide scanners that are needed…

图像与视频处理 · 电气工程与系统科学 2020-11-13 Viswesh Krishna , Anirudh Joshi , Philip L. Bulterys , Eric Yang , Andrew Y. Ng , Pranav Rajpurkar

In digital pathology, Whole Slide Image (WSI) analysis is usually formulated as a Multiple Instance Learning (MIL) problem. Although transformer-based architectures have been used for WSI classification, these methods require modifications…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Juan I. Pisula , Katarzyna Bozek

Multimodal large language models (MLLMs) have achieved impressive performance across various tasks such as image captioning and visual question answer(VQA); however, they often struggle to accurately interpret depth information inherent in…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Hao Yang , Hongbo Zhang , Yanyan Zhao , Bing Qin

Interpretation of giga-pixel whole-slide images (WSIs) is an important but difficult task for pathologists. Their diagnostic accuracy is estimated to average around 70%. Adding a second pathologist does not substantially improve decision…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Veronica Thai , Rui Li , Meng Ling , Shuning Jiang , Jeremy Wolfe , Raghu Machiraju , Yan Hu , Zaibo Li , Anil Parwani , Jian Chen

Whole-slide image (WSI) analysis is challenging due to the gigapixel scale of slides and their inherent hierarchical multi-resolution structure. Existing multiple instance learning (MIL) approaches often model WSIs as unordered collections…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Dongqing Xie , Yonghuang Wu