English
Related papers

Related papers: Improving Medical Visual Representation Learning w…

200 papers

In weakly supervised medical image segmentation, the absence of structural priors and the discreteness of class feature distribution present a challenge, i.e., how to accurately propagate supervision signals from local to global regions…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yu Lei , Haolun Luo , Lituan Wang , Zhenwei Zhang , Lei Zhang

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

The success of CLIP-like vision-language models (VLMs) on natural images has inspired medical counterparts, yet existing approaches largely fall into two extremes: specialist models trained on single-domain data, which capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 M. Arda Aydın , Melih B. Yilmaz , Aykut Koç , Tolga Çukur

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

In pathology image analysis, obtaining and maintaining high-quality annotated samples is an extremely labor-intensive task. To overcome this challenge, mixing-based methods have emerged as effective alternatives to traditional preprocessing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Tianyi Zhang , Zhiling Yan , Chunhui Li , Nan Ying , Yanli Lei , Yunlu Feng , Yu Zhao , Guanglei Zhang

Recent years have seen a surge of interest in anomaly detection for tackling industrial defect detection, event detection, etc. However, existing unsupervised anomaly detectors, particularly those for the vision modality, face significant…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Dong Chen , Kaihang Pan , Guoming Wang , Yueting Zhuang , Siliang Tang

State-of-the-art medical multi-modal LLMs (med-MLLMs), such as LLaVA-Med and BioMedGPT, primarily depend on scaling model size and data volume, with training driven largely by autoregressive objectives. However, we reveal that this approach…

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

Multimodal pathology-genomic analysis has become increasingly prominent in cancer survival prediction. However, existing studies mainly utilize multi-instance learning to aggregate patch-level features, neglecting the information loss of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Mingcheng Qu , Guang Yang , Donglin Di , Tonghua Su , Yue Gao , Yang Song , Lei Fan

Visual place recognition (VPR) remains challenging due to significant viewpoint changes and appearance variations. Mainstream works tackle these challenges by developing various feature aggregation methods to transform deep features into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Teng Wang , Lingquan Meng , Lei Cheng , Changyin Sun

In the past ten years, with the help of deep learning, especially the rapid development of deep neural networks, medical image analysis has made remarkable progress. However, how to effectively use the relational information between various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhihua Liu

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Digital pathology tasks have benefited greatly from modern deep learning algorithms. However, their need for large quantities of annotated data has been identified as a key challenge. This need for data can be countered by using…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Jacob Carse , Frank Carey , Stephen McKenna

Medical image segmentation remains challenging due to the high cost of pixel-level annotations for training. In the context of weak supervision, clinician gaze data captures regions of diagnostic interest; however, its sparsity limits its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingkun Chen , Haoran Duan , Xiao Zhang , Boyan Gao , Vicente Grau , Jungong Han

Automated medical image classification is the key component in intelligent diagnosis systems. However, most medical image datasets contain plenty of samples of common diseases and just a handful of rare ones, leading to major class…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jia-Xin Zhuang , Jiabin Cai , Jianguo Zhang , Wei-shi Zheng , Ruixuan Wang

Different medical imaging modalities capture diagnostic information at varying spatial resolutions, from coarse global patterns to fine-grained localized structures. However, most existing vision-language frameworks in the medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shivang Chopra , Gabriela Sanchez-Rodriguez , Lingchao Mao , Andrew J Feola , Jing Li , Zsolt Kira

Medical image segmentation is more clinically valuable when it supports diagnosis rather than merely producing lesion masks. However, diagnostically relevant lesion cues are often subtle and localized, while existing models may be…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Fengyi Zhang , Xujie Zeng , Mohan Liu , Zengyi Wang , Yalong Jiang

Deep learning based automated pathological diagnosis has markedly improved diagnostic efficiency and reduced variability between observers, yet its clinical adoption remains limited by opaque model decisions and a lack of traceable…

Recent advances in prototypical learning have shown remarkable potential to provide useful decision interpretations associating activation maps and predictions with class-specific training prototypes. Such prototypical learning has been…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Chong Wang , Fengbei Liu , Yuanhong Chen , Helen Frazer , Gustavo Carneiro