English
Related papers

Related papers: Navigating Data Scarcity using Foundation Models: …

200 papers

Widely used traditional supervised deep learning methods require a large number of training samples but often fail to generalize on unseen datasets. Therefore, a more general application of any trained model is quite limited for medical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Rabindra Khadga , Debesh Jha , Steven Hicks , Vajira Thambawita , Michael A. Riegler , Sharib Ali , Pål Halvorsen

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

Although deep learning models in medical imaging often achieve excellent classification performance, they can rely on shortcut learning, exploiting spurious correlations or confounding factors that are not causally related to the target…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sarah Müller , Philipp Berens

Ultrasound foundation models have achieved strong performance on structured prediction tasks but remain exclusively vision-based, limiting zero-shot and few-shot transfer to novel tasks where task-specific annotation is scarce. We address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhuoyang Lyu , Yiyang Zhang , Tongxin Wang , Ruirui Lan

Supervised classification for tabular data remains a core machine learning task, yet its reliance on large labeled datasets limits applicability in data-scarce domains. For such few-shot scenarios, specialized methods like TabPFN - a…

Machine Learning · Computer Science 2026-05-26 Daria Grushina , Kseniia Kuvshinova , Alina Kostromina , Aziz Temirkhanov , Mile Mitrovic , Dmitry Simakov

In medical contexts, the imbalanced data distribution in long-tailed datasets, due to scarce labels for rare diseases, greatly impairs the diagnostic accuracy of deep learning models. Recent multimodal text-image supervised foundation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Sirui Li , Li Lin , Yijin Huang , Pujin Cheng , Xiaoying Tang

Recent advancements in foundation models, typically trained with self-supervised learning on large-scale and diverse datasets, have shown great potential in medical image analysis. However, due to the significant spatial heterogeneity of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Lingxiao Luo , Xuanzhong Chen , Bingda Tang , Xinsheng Chen , Rong Han , Chengpeng Hu , Yujiang Li , Ting Chen

Classifying and analyzing human cells is a lengthy procedure, often involving a trained professional. In an attempt to expedite this process, an active area of research involves automating cell classification through use of deep…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Reece Walsh , Mohamed H. Abdelpakey , Mohamed S. Shehata , Mostafa M. Mohamed

Most computer aided pathology detection systems rely on large volumes of quality annotated data to aid diagnostics and follow up procedures. However, quality assuring large volumes of annotated medical image data can be subjective and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Sohini Roychowdhury

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Annotated images and ground truth for the diagnosis of rare and novel diseases are scarce. This is expected to prevail, considering the small number of affected patient population and limited clinical expertise to annotate images. Further,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Karthik Desingu , Mirunalini P. , Aravindan Chandrabose

While the general machine learning (ML) community has benefited from public datasets, tasks, and models, the progress of ML in healthcare has been hampered by a lack of such shared assets. The success of foundation models creates new…

Machine Learning · Computer Science 2023-12-12 Michael Wornow , Rahul Thapa , Ethan Steinberg , Jason A. Fries , Nigam H. Shah

This study aims to guide language model selection by investigating: 1) the necessity of finetuning versus zero-shot usage, 2) the benefits of domain-adjacent versus generic pretrained models, 3) the value of further domain-specific…

Computation and Language · Computer Science 2025-09-25 Lovedeep Gondara , Jonathan Simkin , Graham Sayle , Shebnum Devji , Gregory Arbour , Raymond Ng

The high cost of obtaining accurate annotations for image segmentation and localization makes the use of one and few shot algorithms attractive. Several state-of-the-art methods for few-shot segmentation have emerged, including text-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Gurunath Reddy , Dattesh Shanbhag , Deepa Anand

Automated surgical skill assessment (SSA) is a central task in surgical computer vision. Developing robust SSA models is challenging due to the scarcity of skill annotations, which are time-consuming to produce and require expert consensus.…

The application of deep learning to medical image segmentation has been hampered due to the lack of abundant pixel-level annotated data. Few-shot Semantic Segmentation (FSS) is a promising strategy for breaking the deadlock. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xiaoang Shen , Guokai Zhang , Huilin Lai , Jihao Luo , Jianwei Lu , Ye Luo

Medical imaging often operates under limited labeled data, especially in rare disease and low resource clinical environments. Existing multimodal and meta learning approaches improve performance in these settings but lack a theoretical…

Machine Learning · Statistics 2025-12-18 Md Talha Mohsin , Ismail Abdulrashid

Medical image analysis faces two critical challenges: scarcity of labeled data and lack of model interpretability, both hindering clinical AI deployment. Few-shot learning (FSL) addresses data limitations but lacks transparency in…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh

Foundation models have transformed medical image analysis by providing robust feature representations that reduce the need for large-scale task-specific training. However, current benchmarks in dermatology often reduce the complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Furkan Yuceyalcin , Abdurrahim Yilmaz , Burak Temelkuran

Few-shot Semantic Segmentation (FSS) aims to adapt a pretrained model to new classes with as few as a single labelled training sample per class. Despite the prototype based approaches have achieved substantial success, existing models are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Song Tang , Shaxu Yan , Xiaozhi Qi , Jianxin Gao , Mao Ye , Jianwei Zhang , Xiatian Zhu