中文
相关论文

相关论文: CPath-Omni: A Unified Multimodal Foundation Model …

200 篇论文

Pathological image analysis is a crucial field in computer-aided diagnosis, where deep learning is widely applied. Transfer learning using pre-trained models initialized on natural images has effectively improved the downstream pathological…

图像与视频处理 · 电气工程与系统科学 2023-10-30 Nan Ying , Yanli Lei , Tianyi Zhang , Shangqing Lyu , Chunhui Li , Sicheng Chen , Zeyu Liu , Yu Zhao , Guanglei Zhang

Whole slide images (WSIs) in computational pathology (CPath) pose a major computational challenge due to their gigapixel scale, often requiring the processing of tens to hundreds of thousands of high-resolution patches per slide. This…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Yonghan Shin , SeungKyu Kim , Won-Ki Jeong

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

Foundation models are increasingly developed in computational pathology (CPath) given their promise in facilitating many downstream tasks. While recent studies have evaluated task performance across models, less is known about the structure…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Vaibhav Mishra , William Lotter

Foundation models are reshaping computational histopathology, yet their value for whole-slide image retrieval relative to strong patch-based and supervised aggregation baselines remains unclear. We benchmarked ten pipelines on 9,387…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Tianhao Lei , Parsa Esmaeilkhani , Saghir Alfasly , Wataru Uegami , Judy C. Boughey , Matthew P. Goetz , Krishna R. Kalari , H. R. Tizhoosh

Whole Slide Imaging (WSI) is a cornerstone of digital pathology, offering detailed insights critical for diagnosis and research. Yet, the gigapixel size of WSIs imposes significant computational challenges, limiting their practical utility.…

图像与视频处理 · 电气工程与系统科学 2024-11-15 Ravi Kant Gupta , Shounak Das , Amit Sethi

Recent advances in clinical AI have enabled remarkable progress across many clinical domains. However, existing benchmarks and models are primarily limited to a small set of modalities and tasks, which hinders the development of large-scale…

机器学习 · 计算机科学 2025-03-21 Wei Dai , Peilin Chen , Malinda Lu , Daniel Li , Haowen Wei , Hejie Cui , Paul Pu Liang

Vision language models (VLM) have achieved success in both natural language comprehension and image recognition tasks. However, their use in pathology report generation for whole slide images (WSIs) is still limited due to the huge size of…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Jing Wei Tan , SeungKyu Kim , Eunsu Kim , Sung Hak Lee , Sangjeong Ahn , Won-Ki Jeong

The field of computational pathology has been transformed with recent advances in foundation models that encode histopathology region-of-interests (ROIs) into versatile and transferable feature representations via self-supervised learning…

Pathology foundation models (PFMs) have enabled robust generalization in computational pathology through large-scale datasets and expansive architectures, but their substantial computational cost, particularly for gigapixel whole slide…

Comprehensive semantic segmentation on renal pathological images is challenging due to the heterogeneous scales of the objects. For example, on a whole slide image (WSI), the cross-sectional areas of glomeruli can be 64 times larger than…

图像与视频处理 · 电气工程与系统科学 2023-01-20 Ruining Deng , Quan Liu , Can Cui , Tianyuan Yao , Jun Long , Zuhayr Asad , R. Michael Womick , Zheyu Zhu , Agnes B. Fogo , Shilin Zhao , Haichun Yang , Yuankai Huo

The emergence of pathology foundation models has revolutionized computational histopathology, enabling highly accurate, generalized whole-slide image analysis for improved cancer diagnosis, and prognosis assessment. While these models show…

Pathological captioning of Whole Slide Images (WSIs), though is essential in computer-aided pathological diagnosis, has rarely been studied due to the limitations in datasets and model training efficacy. In this paper, we propose a new…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Wenkang Qin , Rui Xu , Peixiang Huang , Xiaomin Wu , Heyu Zhang , Lin Luo

Multimodal learning has shown promise in medical imaging, combining complementary modalities like images and text. Vision-language models (VLMs) capture rich diagnostic cues but often require large paired datasets and prompt- or text-based…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Banafsheh Karimian , Giulia Avanzato , Soufian Belharbi , Alexis Guichemerre , Luke McCaffrey , Mohammadhadi Shateri , Eric Granger

In computational pathology, understanding and generation have evolved along disparate paths: advanced understanding models already exhibit diagnostic-level competence, whereas generative models largely simulate pixels. Progress remains…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Minghao Han , Yichen Liu , Yizhou Liu , Zizhi Chen , Jingqun Tang , Xuecheng Wu , Dingkang Yang , Lihua Zhang

In human-centric scenes, the ability to simultaneously understand visual and auditory information is crucial. While recent omni models can process multiple modalities, they generally lack effectiveness in human-centric scenes due to the…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Jiaxing Zhao , Qize Yang , Yixing Peng , Detao Bai , Shimin Yao , Boyuan Sun , Xiang Chen , Shenghao Fu , Weixuan chen , Xihan Wei , Liefeng Bo

Advances in optical microscopy scanning have significantly contributed to computational pathology (CPath) by converting traditional histopathological slides into whole slide images (WSIs). This development enables comprehensive digital…

图像与视频处理 · 电气工程与系统科学 2024-11-19 Xitong Ling , Yuanyuan Lei , Jiawen Li , Junru Cheng , Wenting Huang , Tian Guan , Jian Guan , Yonghong He

Vision-Language Pre-training (VLP) has shown the merits of analysing medical images, by leveraging the semantic congruence between medical images and their corresponding reports. It efficiently learns visual representations, which in turn…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Xiaoxuan He , Yifan Yang , Xinyang Jiang , Xufang Luo , Haoji Hu , Siyun Zhao , Dongsheng Li , Yuqing Yang , Lili Qiu

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo