English
Related papers

Related papers: From Embeddings to Accuracy: Comparing Foundation …

200 papers

Foundation vision encoders such as CLIP and DINOv2, trained on web-scale data, exhibit strong transfer performance across tasks and datasets. However, medical imaging foundation models remain constrained by smaller datasets, limiting our…

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

Foundation models, trained on vast amounts of data using self-supervised techniques, have emerged as a promising frontier for advancing artificial intelligence (AI) applications in medicine. This study evaluates three different…

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

Although deep learning models for abnormality classification can perform well in screening mammography, the demographic, imaging, and clinical characteristics associated with increased risk of model failure remain unclear. This…

Foundation models possess strong capabilities in reasoning and memorizing across modalities. To further unleash the power of foundation models, we present FIND, a generalized interface for aligning foundation models' embeddings with unified…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xueyan Zou , Linjie Li , Jianfeng Wang , Jianwei Yang , Mingyu Ding , Junyi Wei , Zhengyuan Yang , Feng Li , Hao Zhang , Shilong Liu , Arul Aravinthan , Yong Jae Lee , Lijuan Wang

Foundation models have become prominent in computer vision, achieving notable success in various tasks. However, their effectiveness largely depends on pre-training with extensive datasets. Applying foundation models directly to small…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Bowen Zhang , Ying Chen , Long Bai , Yan Zhao , Yuxiang Sun , Yixuan Yuan , Jianhua Zhang , Hongliang Ren

Feature-Imitating-Networks (FINs) are neural networks that are first trained to approximate closed-form statistical features (e.g. Entropy), and then embedded into other networks to enhance their performance. In this work, we perform the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-24 Shangyang Min , Hassan B. Ebadian , Tuka Alhanai , Mohammad Mahdi Ghassemi

Foundational models have emerged as a powerful paradigm in deep learning field, leveraging their capacity to learn robust representations from large-scale datasets and effectively to diverse downstream applications such as classification.…

Instrumentation and Methods for Astrophysics · Physics 2026-03-11 Cristobal Donoso-Oliva , Ignacio Becker , Pavlos Protopapas , Guillermo Cabrera-Vives , Martina Cádiz-Leyton , Daniel Moreno-Cartagena

This paper presents a comprehensive evaluation of lightweight deep learning models for image classification, emphasizing their suitability for deployment in resource-constrained environments such as low-memory devices. Five state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Tasnim Shahriar

Multi-parametric magnetic resonance imaging (mpMRI) exams have various series types acquired with different imaging protocols. The DICOM headers of these series often have incorrect information due to the sheer diversity of protocols and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Boah Kim , Tejas Sudharshan Mathai , Kimberly Helm , Peter A. Pinto , Ronald M. Summers

Scaling EEG foundation models requires pooling data across heterogeneous electrode montages, a prerequisite both for larger pretraining corpora and for downstream deployment. We present the first systematic comparison of four channel…

Machine Learning · Computer Science 2026-04-28 Kuntal Kokate , Bruno Aristimunha , Dung Truong , Arnaud Delorme

Vision-language foundation models have emerged as powerful general-purpose representation learners with strong potential for multimodal understanding, but their deterministic embeddings often fail to provide the reliability required for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ahmad Elallaf , Yu Zhang , Yuktha Priya Masupalli , Jeong Yang , Young Lee , Zechun Cao , Gongbo Liang

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Two questions regarding practitioners' use of patent embeddings arise: (i) Does one fine-tuning recipe suffice for all downstream applications? (ii) Is fine-tuning on one patent landscape sufficient for downstream application on other…

Information Retrieval · Computer Science 2026-05-27 Amirhossein Yousefiramandi , Ciaran Cooney

Despite the significant potential of Foundation Models (FMs) in medical imaging, their application to prognosis prediction remains challenging due to data scarcity, class imbalance, and task complexity, which limit their clinical adoption.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Filippo Ruffini , Elena Mulero Ayllon , Linlin Shen , Paolo Soda , Valerio Guarrasi

Adapting Vision Language Segmentation Models (VLSMs) to medical imaging domains requires significant computational overhead when using conventional fine-tuning approaches. Existing Parameter-Efficient Fine-Tuning (PEFT) methods apply…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Ujjwal Mishra , Vinita Shukla , Praful Hambarde , Amit Shukla

Foundation models like CLIP and SAM have advanced computer vision and medical imaging via low-shot transfer learning, aiding CADD with limited data. However, their deployment faces two key challenges. \textit{distribution shift} where…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Behraj Khan , Tahir Qasim Syed , Nouman M. Durrani , Bilal Naseem , Shabir Ahmad , Rizwan Qureshi

Foundation models (FMs) have demonstrated strong performance across diverse pathology tasks. While there are similarities in the pre-training objectives of FMs, there is still limited understanding of their complementarity, redundancy in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Brennan Flannery , Thomas DeSilvio , Jane Nguyen , Satish E. Viswanath

Multi-label fundus diagnosis requires features that capture both fine-grained lesions and large-scale retinal structure. Many multi-scale medical vision models address this challenge through explicit frequency decomposition, but our…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yifeng Zheng