English
Related papers

Related papers: HiPath: Hierarchical Vision-Language Alignment for…

200 papers

Vision-language pretraining has driven significant progress in medical image analysis. However, current methods typically supervise visual encoders using one-hot labels or free-form text, neither of which effectively captures the complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Xiyao Wang , Xiaoyu Tan , Yang Dai , Yuxuan Fu , Shuo Li , Xihe Qiu

The previous advancements in pathology image understanding primarily involved developing models tailored to specific tasks. Recent studies has demonstrated that the large vision-language model can enhance the performance of various…

Artificial Intelligence · Computer Science 2024-08-20 Dawei Dai , Yuanhui Zhang , Long Xu , Qianlan Yang , Xiaojing Shen , Shuyin Xia , Guoyin Wang

Vision-language foundation models have shown great promise in computational pathology but remain primarily data-driven, lacking explicit integration of medical knowledge. We introduce KEEP (KnowledgE-Enhanced Pathology), a foundation model…

Image and Video Processing · Electrical Eng. & Systems 2026-01-28 Xiao Zhou , Luoyi Sun , Dexuan He , Wenbin Guan , Ge Wang , Ruifen Wang , Lifeng Wang , Xiaojun Yuan , Xin Sun , Ya Zhang , Kun Sun , Yanfeng Wang , Weidi Xie

Prompt learning has become a prevalent strategy for adapting vision-language foundation models (VLMs) such as CLIP to downstream tasks. With the emergence of large language models (LLMs), recent studies have explored the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Yubin Wang , Xinyang Jiang , De Cheng , Wenli Sun , Dongsheng Li , Cairong Zhao

The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks. However, existing approaches often treat vision encoders and large language models (LLMs) as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Eugene Lee , Ting-Yu Chang , Jui-Huang Tsai , Jiajie Diao , Chen-Yi Lee

Computational pathology (CPath) digitizes pathology slides into whole slide images (WSIs), enabling analysis for critical healthcare tasks such as cancer diagnosis and prognosis. However, WSIs possess extremely long sequence lengths (up to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Wenhao Tang , Heng Fang , Ge Wu , Xiang Li , Ming-Ming Cheng

The interpretation of histopathology cases underlies many important diagnostic and treatment decisions in medicine. Notably, this process typically requires pathologists to integrate and summarize findings across multiple slides per case.…

Advances in AI have introduced several strong models in computational pathology to usher it into the era of multi-modal diagnosis, analysis, and interpretation. However, the current pathology-specific visual language models still lack…

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

In diagnostic reports, experts encode complex imaging data into clinically actionable information. They describe subtle pathological findings that are meaningful in their anatomical context. Reports follow relatively consistent structures,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Felicia Bader , Philipp Seeböck , Anastasia Bartashova , Ulrike Attenberger , Georg Langs

Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ziqiao Weng , Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee AD Cooper , Weidong Cai , Bo Zhou

Pruning vision-language models (VLMs) for efficient deployment is challenging because compression can affect not only task utility but also visual grounding, often amplifying object hallucinations even at the same sparsity level. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Lincen Bai , Hedi Tabia , Raul Santos-Rodriguez

There is a growing interest in developing strong biomedical vision-language models. A popular approach to achieve robust representations is to use web-scale scientific data. However, current biomedical vision-language pretraining typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Kun Yuan , Min Woo Sun , Zhen Chen , Alejandro Lozano , Xiangteng He , Shi Li , Nassir Navab , Xiaoxiao Sun , Nicolas Padoy , Serena Yeung-Levy

Timely cancer reporting data are required in order to understand the impact of cancer, inform public health resource planning and implement cancer policy especially in Sub Saharan Africa where the reporting lag is behind world averages.…

Machine Learning · Computer Science 2020-09-02 Waheeda Saib , Tapiwa Chiwewe , Elvira Singh

Histopathology plays a pivotal role in medical diagnostics. In contrast to preparing permanent sections for histopathology, a time-consuming process, preparing frozen sections is significantly faster and can be performed during surgery,…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Elad Yoshai , Gil Goldinger , Miki Haifler , Natan T. Shaked

In semi-supervised segmentation, capturing meaningful semantic structures from unlabeled data is essential. This is particularly challenging in histopathology image analysis, where objects are densely distributed. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Meilong Xu , Xiaoling Hu , Shahira Abousamra , Chen Li , Chao Chen

We present Clin-JEPA, a multi-phase co-training framework for joint-embedding predictive (JEPA) pretraining on EHR patient trajectories. JEPA architectures have enabled latent-space planning in robotics and high-quality representation…

Precision pathology relies on detecting fine-grained morphological abnormalities within specific Regions of Interest (ROIs), as these local, texture-rich cues - rather than global slide contexts - drive expert diagnostic reasoning. While…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chunze Yang , Wenjie Zhao , Yue Tang , Junbo Lu , Jiusong Ge , Qidong Liu , Zeyu Gao , Chen Li

Pathology image classification plays a crucial role in accurate medical diagnosis and treatment planning. Training high-performance models for this task typically requires large-scale annotated datasets, which are both expensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Lanfeng Zhong , Xin Liao , Shichuan Zhang , Shaoting Zhang , Guotai Wang

Progress in biomedical Named Entity Recognition (NER) and Entity Linking (EL) is currently hindered by a fragmented data landscape, a lack of resources for building explainable models, and the limitations of semantically-blind evaluation…

Computation and Language · Computer Science 2025-11-17 Nishant Mishra , Wilker Aziz , Iacer Calixto