English
Related papers

Related papers: Knowledge-enhanced Visual-Language Pretraining for…

200 papers

Pathological diagnosis is vital for determining disease characteristics, guiding treatment, and assessing prognosis, relying heavily on detailed, multi-scale analysis of high-resolution whole slide images (WSI). However, existing large…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Shengxuming Zhang , Weihan Li , Tianhong Gao , Jiacong Hu , Haoming Luo , Xiuming Zhang , Jing Zhang , Mingli Song , Zunlei Feng

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Gabriele Campanella , Eugene Fluder , Jennifer Zeng , Chad Vanderbilt , Thomas J. Fuchs

With the development of digital imaging in medical microscopy, artificial intelligent-based analysis of pathological whole slide images (WSIs) provides a powerful tool for cancer diagnosis. Limited by the expensive cost of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jiawen Li , Qiehe Sun , Renao Yan , Yizhi Wang , Yuqiu Fu , Yani Wei , Tian Guan , Huijuan Shi , Yonghonghe He , Anjia Han

Vision-language models have become increasingly powerful for tasks that require an understanding of both visual and linguistic elements, bridging the gap between these modalities. In the context of multimodal clinical AI, there is a growing…

Computation and Language · Computer Science 2024-04-30 Masoud Monajatipoor , Zi-Yi Dou , Aichi Chien , Nanyun Peng , Kai-Wei Chang

Vision-language models in pathology enable multimodal case retrieval and automated report generation. Many of the models developed so far, however, have been trained on pathology reports that include information which cannot be inferred…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruben T. Lucassen , Tijn van de Luijtgaarden , Sander P. J. Moonemans , Gerben E. Breimer , Willeke A. M. Blokx , Mitko Veta

In this paper, we consider enhancing medical visual-language pre-training (VLP) with domain-specific knowledge, by exploiting the paired image-text reports from the radiological daily practice. In particular, we make the following…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Objective: We develop a computer-aided diagnosis (CAD) system using deep learning approaches for lesion detection and classification on whole-slide images (WSIs) with breast cancer. The deep features being distinguishing in classification…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Wei-Wen Hsu , Yongfang Wu , Chang Hao , Yu-Ling Hou , Xiang Gao , Yun Shao , Xueli Zhang , Tao He , Yanhong Tai

Foundation models are increasingly developed in computational pathology (CPath) given their promise in facilitating many downstream tasks. While recent studies have evaluated task performance across models, less is known about the structure…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Vaibhav Mishra , William Lotter

Multimodal pathological image understanding has garnered widespread interest due to its potential to improve diagnostic accuracy and enable personalized treatment through integrated visual and textual data. However, existing methods exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zhe Xu , Cheng Jin , Yihui Wang , Ziyi Liu , Hao Chen

Computational pathology, integrating computational methods and digital imaging, has shown to be effective in advancing disease diagnosis and prognosis. In recent years, the development of machine learning and deep learning has greatly…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Jiamu Wang , Chang-Su Kim , Jin Tae Kwak

Vision-Language Models (VLMs) are advancing computational pathology with superior visual understanding capabilities. However, current systems often reduce diagnosis to directly output conclusions without verifiable evidence-linked…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Songhan Jiang , Fengchun Liu , Ziyue Wang , Linghan Cai , Yongbing Zhang

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

Computational pathology relies on effective representation learning to support cancer research and precision medicine. Although self-supervised learning has driven major progress at the patch and whole-slide image levels, representation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Loïc Chadoutaud , Alice Blondel , Hana Feki , Jacqueline Fontugne , Emmanuel Barillot , Thomas Walter

Histopathological images are widely used for the analysis of diseased (tumor) tissues and patient treatment selection. While the majority of microscopy image processing was previously done manually by pathologists, recent advances in…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Andrey Ignatov , Josephine Yates , Valentina Boeva

In this work, we investigate multi-task learning as a way of pre-training models for classification tasks in digital pathology. It is motivated by the fact that many small and medium-size datasets have been released by the community over…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Romain Mormont , Pierre Geurts , Raphaël Marée

Computational Pathology CPath is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows…

The field of computational pathology has witnessed remarkable progress in the development of both task-specific predictive models and task-agnostic self-supervised vision encoders. However, despite the explosive growth of generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Ming Y. Lu , Bowen Chen , Drew F. K. Williamson , Richard J. Chen , Kenji Ikamura , Georg Gerber , Ivy Liang , Long Phi Le , Tong Ding , Anil V Parwani , Faisal Mahmood

Pathology deals with the practice of discovering the reasons for disease by analyzing the body samples. The most used way in this field, is to use histology which is basically studying and viewing microscopic structures of cell and tissues.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-08 Virender Ranga , Shivam Gupta , Priyansh Agrawal , Jyoti Meena

Computational pathology demands both visual pattern recognition and dynamic integration of structured domain knowledge, including taxonomy, grading criteria, and clinical evidence. In practice, diagnostic reasoning requires linking…

Artificial Intelligence · Computer Science 2026-05-26 Jinyue Li , Yuci Liang , Qiankun Li , Xinheng Lyu , Jiayu Qian , Huabao Chen , Kun Wang , Zhigang Zeng , Anil Anthony Bharath , Yang Liu