English
Related papers

Related papers: MedSynapse-V: Bridging Visual Perception and Clini…

200 papers

Medical vision-language pretraining (VLP) models have recently been investigated for their generalization to diverse downstream tasks. However, current medical VLP methods typically force the model to learn simple and complex concepts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chenran Zhang , Ruiqi Wu , Tao Zhou , Yi Zhou

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

Clinical notes contain rich patient information, such as diagnoses or medications, making them valuable for patient representation learning. Recent advances in large language models have further improved the ability to extract meaningful…

Machine Learning · Computer Science 2025-09-23 Zihan Liang , Ziwen Pan , Ruoxuan Xiong

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Vision-language foundation models (VLMs) have shown great potential in feature transfer and generalization across a wide spectrum of medical-related downstream tasks. However, fine-tuning these models is resource-intensive due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ye Du , Nanxi Yu , Shujun Wang

General-purpose large Vision-Language Models (VLMs) demonstrate strong capabilities in generating detailed descriptions for natural images. However, their performance in the medical domain remains suboptimal, even for relatively…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yifan Li , Fenghe Tang , Yingtai Li , Shaohua Kevin Zhou

In medical visual question answering (Med-VQA), achieving accurate responses relies on three critical steps: precise perception of medical imaging data, logical reasoning grounded in visual input and textual questions, and coherent answer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Songtao Jiang , Yuan Wang , Ruizhe Chen , Yan Zhang , Ruilin Luo , Bohan Lei , Sibo Song , Yang Feng , Jimeng Sun , Jian Wu , Zuozhu Liu

Medical automatic diagnosis aims to imitate human doctors in real-world diagnostic processes and to achieve accurate diagnoses by interacting with the patients. The task is formulated as a sequential decision-making problem with a series of…

Machine Learning · Computer Science 2022-06-07 Hongyi Yuan , Sheng Yu

The rise of In-Context Learning (ICL) for universal medical image segmentation has introduced an unprecedented demand for large-scale, diverse datasets for training, exacerbating the long-standing problem of data scarcity. While data…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Jiesi Hu , Yanwu Yang , Zhiyu Ye , Chenfei Ye , Hanyang Peng , Jianfeng Cao , Ting Ma

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Temporal causal representation learning is a powerful tool for uncovering complex patterns in observational studies, which are often represented as low-dimensional time series. However, in many real-world applications, data are…

Machine Learning · Computer Science 2025-07-21 Jianhong Chen , Meng Zhao , Mostafa Reisi Gahrooei , Xubo Yue

The integration of deep learning based systems in clinical practice is often impeded by challenges rooted in limited and heterogeneous medical datasets. In addition, the field has increasingly prioritized marginal performance gains on a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sebastian Doerrich , Francesco Di Salvo , Julius Brockmann , Christian Ledig

Despite the remarkable success of the end-to-end paradigm in deep learning, it often suffers from slow convergence and heavy reliance on large-scale datasets, which fundamentally limits its efficiency and applicability in data-scarce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Feifei Zhang , Zhenhong Jia , Sensen Song , Fei Shi , Dayong Ren

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Tingyi Lin , Pengju Lyu , Jie Zhang , Yuqing Wang , Cheng Wang , Jianjun Zhu

While Large Language Models (LLMs) have demonstrated potential in healthcare, they often struggle with the complex, non-linear reasoning required for accurate clinical diagnosis. Existing methods typically rely on static, linear mappings…

Computation and Language · Computer Science 2026-05-28 Zhuohan Ge , Haoyang Li , Yubo Wang , Nicole Hu , Chen Jason Zhang , Qing Li

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Referring medical image segmentation targets delineating lesions indicated by textual descriptions. Aligning visual and textual cues is challenging due to their distinct data properties. Inspired by large-scale pre-trained vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Minghong Wei , Zixuan Zheng , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate…

Computation and Language · Computer Science 2026-04-08 Han Jang , Junhyeok Lee , Heeseong Eum , Kyu Sung Choi