English
Related papers

Related papers: LVM-Med: Learning Large-Scale Self-Supervised Visi…

200 papers

Semi-supervised learning has attracted much attention in medical image segmentation due to challenges in acquiring pixel-wise image annotations, which is a crucial step for building high-performance deep learning methods. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Shuailin Li , Chuyu Zhang , Xuming He

In medical image analysis, the expertise scarcity and the high cost of data annotation limits the development of large artificial intelligence models. This paper investigates the potential of transfer learning with pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiajin Zhang , Ge Wang , Mannudeep K. Kalra , Pingkun Yan

3D medical image analysis is pivotal in numerous clinical applications. However, the scarcity of labeled data and limited generalization capabilities hinder the advancement of AI-empowered models. Radiology reports are easily accessible and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuefeng Ni , Linshan Wu , Jiaxin Zhuang , Qiong Wang , Mingxiang Wu , Varut Vardhanabhuti , Lihai Zhang , Hanyu Gao , Hao Chen

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Walid Ehab , Yongmin Li

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Foundation models have achieved transformative success across biomedical domains by enabling holistic understanding of multimodal data. However, their application in surgery remains underexplored. Surgical intelligence presents unique…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zhitao Zeng , Zhu Zhuo , Xiaojun Jia , Erli Zhang , Junde Wu , Jiaan Zhang , Yuxuan Wang , Chang Han Low , Jian Jiang , Zilong Zheng , Xiaochun Cao , Yutong Ban , Qi Dou , Yang Liu , Yueming Jin

Learning inter-image similarity is crucial for 3D medical images self-supervised pre-training, due to their sharing of numerous same semantic regions. However, the lack of the semantic prior in metrics and the semantic-independent variation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yuting He , Guanyu Yang , Rongjun Ge , Yang Chen , Jean-Louis Coatrieux , Boyu Wang , Shuo Li

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Medical diagnostic applications require models that can process multimodal medical inputs (images, patient histories, lab results) and generate diverse outputs including both textual reports and visual content (annotations, segmentation…

Medical vision-and-language models (MVLMs) have attracted substantial interest due to their capability to offer a natural language interface for interpreting complex medical data. Their applications are versatile and have the potential to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Qi Chen , Ruoshan Zhao , Sinuo Wang , Vu Minh Hieu Phan , Anton van den Hengel , Johan Verjans , Zhibin Liao , Minh-Son To , Yong Xia , Jian Chen , Yutong Xie , Qi Wu

Vision-language models (VLMs) have shown considerable potential in digital pathology, yet their effectiveness remains limited for fine-grained, disease-specific classification tasks such as distinguishing between glomerular subtypes. The…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenhao Guo , Rachit Saluja , Tianyuan Yao , Quan Liu , Yuankai Huo , Benjamin Liechty , David J. Pisapia , Kenji Ikemura , Mert R. Sabuncu , Yihe Yang , Ruining Deng

Large datasets often contain multiple distinct feature sets, or views, that offer complementary information that can be exploited by multi-view learning methods to improve results. We investigate anatomical multi-view data, where each brain…

Quantitative Methods · Quantitative Biology 2024-01-17 Yuxiang Wei , Yuqian Chen , Tengfei Xue , Leo Zekelman , Nikos Makris , Yogesh Rathi , Weidong Cai , Fan Zhang , Lauren J. O' Donnell

Deep learning models have demonstrated remarkable results for various computer vision tasks, including the realm of medical imaging. However, their application in the medical domain is limited due to the requirement for large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Aryan Singh , Pepijn Van de Ven , Ciarán Eising , Patrick Denny

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Fan Zhang , Qingsong Wen , Chaoyou Fu , Xue Wang , Zhang Zhang , Liang Wang , Rong Jin

In the past ten years, with the help of deep learning, especially the rapid development of deep neural networks, medical image analysis has made remarkable progress. However, how to effectively use the relational information between various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Zhihua Liu

Learning visual representations of medical images (e.g., X-rays) is core to medical image understanding but its progress has been held back by the scarcity of human annotations. Existing work commonly relies on fine-tuning weights…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yuhao Zhang , Hang Jiang , Yasuhide Miura , Christopher D. Manning , Curtis P. Langlotz

Medical images are naturally associated with rich semantics about the human anatomy, reflected in an abundance of recurring anatomical patterns, offering unique potential to foster deep semantic representation learning and yield…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Fatemeh Haghighi , Mohammad Reza Hosseinzadeh Taher , Zongwei Zhou , Michael B. Gotway , Jianming Liang

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

Joint image-text embedding extracted from medical images and associated contextual reports is the bedrock for most biomedical vision-and-language (V+L) tasks, including medical visual question answering, clinical image-text retrieval,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Yikuan Li , Hanyin Wang , Yuan Luo

Head computed tomography (CT) imaging is a widely-used imaging modality with multitudes of medical indications, particularly in assessing pathology of the brain, skull, and cerebrovascular system. It is commonly the first-line imaging in…