English
Related papers

Related papers: Navigating Data Scarcity using Foundation Models: …

200 papers

Few-shot learning has recently attracted wide interest in image classification, but almost all the current public benchmarks are focused on natural images. The few-shot paradigm is highly relevant in medical-imaging applications due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Fereshteh Shakeri , Malik Boudiaf , Sina Mohammadi , Ivaxi Sheth , Mohammad Havaei , Ismail Ben Ayed , Samira Ebrahimi Kahou

Foundation models hold promise for specialized medical imaging tasks, though their effectiveness in breast imaging remains underexplored. This study leverages BiomedCLIP as a foundation model to address challenges in model generalization.…

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

Machine Learning · Computer Science 2025-01-24 Rishabh Agrawal

Data scarcity significantly complicates the continual learning problem, i.e., how a deep neural network learns in dynamic environments with very few samples. However, the latest progress of few-shot class incremental learning (FSCIL)…

Machine Learning · Computer Science 2025-02-13 M. Anwar Ma'sum , Mahardhika Pratama , Igor Skrjanc

The Vision-Language Foundation model is increasingly investigated in the fields of computer vision and natural language processing, yet its exploration in ophthalmology and broader medical applications remains limited. The challenge is the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiawei Du , Jia Guo , Weihang Zhang , Shengzhu Yang , Hanruo Liu , Huiqi Li , Ningli Wang

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-Shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly…

Machine Learning · Computer Science 2020-03-31 Yaqing Wang , Quanming Yao , James Kwok , Lionel M. Ni

Automated retinal disease diagnosis is vital given the rising prevalence of conditions such as diabetic retinopathy and macular degeneration. Conventional deep learning approaches require large annotated datasets, which are costly and often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Jasmaine Khale , Ravi Prakash Srivastava

Class-Incremental Learning (CIL) aims to learn new classes over time without forgetting previously acquired knowledge. The emergence of foundation models (FM) pretrained on large datasets presents new opportunities for CIL by offering rich,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Mohamed Elkhayat , Mohamed Mahmoud , Jamil Fayyad , Nourhan Bayasi

We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal…

Machine Learning · Computer Science 2020-12-07 Zhongqi Yue , Hanwang Zhang , Qianru Sun , Xian-Sheng Hua

The challenge of learning a new concept, object, or a new medical disease recognition without receiving any examples beforehand is called Zero-Shot Learning (ZSL). One of the major issues in deep learning based methodologies such as in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Mahdi Rezaei , Mahsa Shahidi

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Scaling up model and data size have demonstrated impressive performance improvement over a wide range of tasks. Despite extensive studies on scaling behaviors for general-purpose tasks, medical images exhibit substantial differences from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Jiarun Liu , Hong-Yu Zhou , Weijian Huang , Hao Yang , Dongning Song , Tao Tan , Yong Liang , Shanshan Wang

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Foundation vision-language models (VLMs) excel on natural images, but their utility for biomedical microscopy remains underexplored. In this paper, we investigate how in-context learning enables state-of-the-art VLMs to perform few-shot…

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

Multi-modal foundation models such as CLIP have showcased impressive zero-shot capabilities. However, their applicability in resource-constrained environments is limited due to their large number of parameters and high inference time. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Niclas Popp , Jan Hendrik Metzen , Matthias Hein

Few-shot learning (FSL) has recently been extensively utilized to overcome the scarcity of training data in domain-specific visual recognition. In real-world scenarios, environmental factors such as complex backgrounds, varying lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Qianyu Guo , Jingrong Wu , Tianxing Wu , Haofen Wang , Weifeng Ge , Wenqiang Zhang

Few-shot learning (FSL) is an important and topical problem in computer vision that has motivated extensive research into numerous methods spanning from sophisticated meta-learning methods to simple transfer learning baselines. We seek to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Shell Xu Hu , Da Li , Jan Stühmer , Minyoung Kim , Timothy M. Hospedales