English
Related papers

Related papers: Multi-Resolution Pathology-Language Pre-training M…

200 papers

Vision-Language Pretraining (VLP) has demonstrated remarkable capabilities in learning visual representations from textual descriptions of images without annotations. Yet, effective VLP demands large-scale image-text pairs, a resource that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yinda Chen , Che Liu , Wei Huang , Sibo Cheng , Rossella Arcucci , Zhiwei Xiong

Vision-language models (VLMs) can couple visual perception with open-ended clinical reasoning, making them attractive for computational histopathology. However, fine-tuning billions of parameters on scarce, expert-annotated pathology data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Franciskus Xaverius Erick , Johanna Paula Müller , Bernhard Kainz

Pathology reports are structured, multi-granular documents encoding diagnostic conclusions, histological grades, and ancillary test results across one or more anatomical sites; yet existing pathology vision-language models (VLMs) reduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ruicheng Yuan , Zhenxuan Zhang , Anbang Wang , Liwei Hu , Xiangqian Hua , Yaya Peng , Jiawei Luo , Guang Yang

This paper proposes Comprehensive Pathology Language Image Pre-training (CPLIP), a new unsupervised technique designed to enhance the alignment of images and text in histopathology for tasks such as classification and segmentation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Sajid Javed , Arif Mahmood , Iyyakutti Iyappan Ganapathi , Fayaz Ali Dharejo , Naoufel Werghi , Mohammed Bennamoun

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Peripheral Blood Smear (PBS) is a critical microscopic examination in hematopathology that yields whole-slide imaging (WSI). Unlike solid tissue pathology, PBS interpretation focuses on individual cell morphologies rather than tissue…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yuanlong Wang , Weichi Chen , Adrian Rajab , Wenfang Liu , Yulan Jin , Andrew Srisuwananukorn , Ping Zhang

As data requirements continue to grow, efficient learning increasingly depends on the curation and distillation of high-value data rather than brute-force scaling of model sizes. In the case of a hyperspectral image (HSI), the challenge is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Abhiroop Chatterjee , Susmita Ghosh

Accurate analysis of pathological images is essential for automated tumor diagnosis but remains challenging due to high structural similarity and subtle morphological variations in tissue images. Current vision-language (VL) models often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yating Huang , Ziyan Huang , Lintao Xiang , Qijun Yang , Hujun Yin

Medical large vision-language models (LVLMs) have demonstrated promising performance across various single-image question answering (QA) benchmarks, yet their capability in processing multi-image clinical scenarios remains underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xikai Yang , Juzheng Miao , Yuchen Yuan , Jiaze Wang , Qi Dou , Jinpeng Li , Pheng-Ann Heng

Vision-language models (VLMs) have the potential to become co-pilots for pathologists. However, most VLMs either focus on small regions of interest within whole-slide images, provide only static slide-level outputs, or rely on data that is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Sander Moonemans , Sebastiaan Ram , Frédérique Meeuwsen , Carlijn Lems , Jeroen van der Laak , Geert Litjens , Francesco Ciompi

Hepatocellular Carcinoma diagnosis relies heavily on the interpretation of gigapixel Whole Slide Images. However, current computational approaches are constrained by fixed-resolution processing mechanisms and inefficient feature…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuxuan Yang , Zhonghao Yan , Yi Zhang , Bo Yun , Muxi Diao , Guowei Zhao , Kongming Liang , Wenbin Li , Zhanyu Ma

In digital pathology, whole slide images (WSIs) are widely used for applications such as cancer diagnosis and prognosis prediction. Visual transformer models have recently emerged as a promising method for encoding large regions of WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shuai Jiang , Liesbeth Hondelink , Arief A. Suriawinata , Saeed Hassanpour

Computational pathology and whole-slide image (WSI) analysis are pivotal in cancer diagnosis and prognosis. However, the ultra-high resolution of WSIs presents significant modeling challenges. Recent advancements in pathology foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Honglin Li , Zhongyi Shui , Yunlong Zhang , Chenglu Zhu , Lin Yang

Automated generation of diagnostic pathology reports directly from whole slide images (WSIs) is an emerging direction in computational pathology. Translating high-resolution tissue patterns into clinically coherent text remains difficult…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Noorul Wahab , Nasir Rajpoot

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are still several…

Recently, Multimodal Large Language Models (MLLMs) that enable Large Language Models (LLMs) to interpret images through visual instruction tuning have achieved significant success. However, existing visual instruction tuning methods only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Chi Chen , Ruoyu Qin , Fuwen Luo , Xiaoyue Mi , Peng Li , Maosong Sun , Yang Liu

Vision-language pre-training (VLP) on large-scale image-text pairs has recently witnessed rapid progress for learning cross-modal representations. Existing pre-training methods either directly concatenate image representation and text…

Computation and Language · Computer Science 2021-03-16 Chenliang Li , Ming Yan , Haiyang Xu , Fuli Luo , Wei Wang , Bin Bi , Songfang Huang

Brain tumor diagnosis is largely dependent on Magnetic Resonance Imaging (MRI) evaluation, which requires radiologists to synthesize thousands of images across multiple 3D sequences and longitudinal studies. This process requires advanced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shiv Ghosh , Junayd Lateef , Chih-Hua Liu , Yannan Yu , Andreas M. Rauschecker , Madhumita Sushil