中文
相关论文

相关论文: PolyPath: Adapting a Large Multimodal Model for Mu…

200 篇论文

Generative models have revolutionized Artificial Intelligence (AI), particularly in multimodal applications. However, adapting these models to the medical domain poses unique challenges due to the complexity of medical data and the…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Daniele Molino , Francesco di Feola , Linlin Shen , Paolo Soda , Valerio Guarrasi

Peripheral Blood Smear (PBS) is a critical microscopic examination in hematopathology that yields whole-slide imaging (WSI). Unlike solid tissue pathology, PBS interpretation focuses on individual cell morphologies rather than tissue…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yuanlong Wang , Weichi Chen , Adrian Rajab , Wenfang Liu , Yulan Jin , Andrew Srisuwananukorn , Ping Zhang

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Deep-learning techniques have been used widely to alleviate the labour-intensive and time-consuming manual annotation required for pixel-level tissue characterization. Our previous study introduced an efficient single dynamic network -…

图像与视频处理 · 电气工程与系统科学 2023-05-25 Haoju Leng , Ruining Deng , Zuhayr Asad , R. Michael Womick , Haichun Yang , Lipeng Wan , Yuankai Huo

We present ViDRiP-LLaVA, the first large multimodal model (LMM) in computational pathology that integrates three distinct image scenarios, including single patch images, automatically segmented pathology video clips, and manually segmented…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Trinh T. L. Vuong , Jin Tae Kwak

Multiple Instance Learning (MIL) and transformers are increasingly popular in histopathology Whole Slide Image (WSI) classification. However, unlike human pathologists who selectively observe specific regions of histopathology tissues under…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Conghao Xiong , Hao Chen , Joseph J. Y. Sung , Irwin King

Histology analysis of the tumor micro-environment integrated with genomic assays is the gold standard for most cancers in modern medicine. This paper proposes a Gene-induced Multimodal Pre-training (GiMP) framework, which jointly…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Ting Jin , Xingran Xie , Renjie Wan , Qingli Li , Yan Wang

Searching for similar images in archives of histology and histopathology images is a crucial task that may aid in patient matching for various purposes, ranging from triaging and diagnosis to prognosis and prediction. Whole slide images…

Multimodal foundation models have shown compelling but conflicting performance in medical image interpretation. However, the mechanisms by which these models integrate and prioritize different data modalities, including images and text,…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Thomas Buckley , James A. Diao , Pranav Rajpurkar , Adam Rodman , Arjun K. Manrai

Objective: We develop a computer-aided diagnosis (CAD) system using deep learning approaches for lesion detection and classification on whole-slide images (WSIs) with breast cancer. The deep features being distinguishing in classification…

图像与视频处理 · 电气工程与系统科学 2021-08-29 Wei-Wen Hsu , Yongfang Wu , Chang Hao , Yu-Ling Hou , Xiang Gao , Yun Shao , Xueli Zhang , Tao He , Yanhong Tai

Recent advances in artificial intelligence (AI), in particular self-supervised learning of foundation models (FMs), are revolutionizing medical imaging and computational pathology (CPath). A constant challenge in the analysis of digital…

Multiple Instance Learning (MIL) methods have succeeded remarkably in histopathology whole slide image (WSI) analysis. However, most MIL models only offer attention-based explanations that do not faithfully capture the model's decision…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Susu Sun , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Multiple Instance Learning (MIL) is the predominant framework for classifying gigapixel whole-slide images in computational pathology. MIL follows a sequence of 1) extracting patch features, 2) applying a linear layer to obtain…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Daniel Shao , Joel Runevic , Richard J. Chen , Drew F. K. Williamson , Ahrong Kim , Andrew H. Song , Faisal Mahmood

Deep Learning-based computational pathology algorithms have demonstrated profound ability to excel in a wide array of tasks that range from characterization of well known morphological phenotypes to predicting non-human-identifiable…

图像与视频处理 · 电气工程与系统科学 2020-09-24 Ming Y. Lu , Dehan Kong , Jana Lipkova , Richard J. Chen , Rajendra Singh , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

Automated whole slide image (WSI) tagging has become a growing demand due to the increasing volume and diversity of WSIs collected nowadays in histopathology. Various methods have been studied to classify WSIs with single tags but none of…

计算机视觉与模式识别 · 计算机科学 2019-07-05 Weijian Li , Viet-Duy Nguyen , Haofu Liao , Matt Wilder , Ke Cheng , Jiebo Luo

Histology slide digitization is becoming essential for telepathology (remote consultation), knowledge sharing (education), and using the state-of-the-art artificial intelligence algorithms (augmented/automated end-to-end clinical…

图像与视频处理 · 电气工程与系统科学 2024-05-15 Talat Zehra , Joseph Marino , Wendy Wang , Grigoriy Frantsuzov , Saad Nadeem

The rapidly emerging field of deep learning-based computational pathology has demonstrated promise in developing objective prognostic models from histology whole slide images. However, most prognostic models are either based on histology or…

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

The expanding adoption of digital pathology has enabled the curation of large repositories of histology whole slide images (WSIs), which contain a wealth of information. Similar pathology image search offers the opportunity to comb through…

计算机视觉与模式识别 · 计算机科学 2021-07-30 Chengkuan Chen , Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Andrew J. Schaumberg , Faisal Mahmood