English
Related papers

Related papers: A Hierarchical Benchmark of Foundation Models for …

200 papers

Foundation models provide robust embeddings for diverse tasks, including medical imaging. We evaluate embeddings from seven general and medical-specific foundation models (e.g., DenseNet121, BiomedCLIP, MedImageInsight, Rad-DINO,…

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Diagnosing and treating skin diseases require advanced visual skills across domains and the ability to synthesize information from multiple imaging modalities. While current deep learning models excel at specific tasks like skin cancer…

In practice, many medical datasets have an underlying taxonomy defined over the disease label space. However, existing classification algorithms for medical diagnoses often assume semantically independent labels. In this study, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zhen Yu , Toan Nguyen , Yaniv Gal , Lie Ju , Shekhar S. Chandra , Lei Zhang , Paul Bonnington , Victoria Mar , Zhiyong Wang , Zongyuan Ge

Accurate classification of skin lesions from dermatoscopic images is essential for diagnosis and treatment of skin cancer. In this study, we investigate the utility of a dermatology-specific foundation model, PanDerm, in comparison with two…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Amirreza Mahbod , Rupert Ecker , Ramona Woitek

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

The rapid proliferation of open-source medical foundation models (FMs) raises a practical question: how well do their pre-trained representations transfer to clinically relevant but data-scarce classification tasks? Particularly in CT-based…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hartmut Häntze , Sarah de Boer , Myrthe Buser , Alessa Hering , Bram van Ginneken , Mathias Prokop , Jawed Nawabi , Sebastian Ziegelmayer , Lisa Adams , Keno Bressem

Deep Learning approaches in dermatological image classification have shown promising results, yet the field faces significant methodological challenges that impede proper evaluation. This paper presents a dual contribution: first, a…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Łukasz Miętkiewicz , Leon Ciechanowski , Dariusz Jemielniak

The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language processing, progress…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Joana Palés Huix , Adithya Raju Ganeshan , Johan Fredin Haslum , Magnus Söderberg , Christos Matsoukas , Kevin Smith

Pretraining on large-scale, in-domain datasets grants histopathology foundation models (FM) the ability to learn task-agnostic data representations, enhancing transfer learning on downstream tasks. In computational pathology, automated…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Pablo Meseguer , Rocío del Amor , Valery Naranjo

Foundation models (FMs) promise to generalize medical imaging, but their effectiveness varies. It remains unclear how pre-training domain (medical vs. general), paradigm (e.g., text-guided), and architecture influence embedding quality,…

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Skin diseases impose a substantial burden on global healthcare systems, driven by their high prevalence (affecting up to 70% of the population), complex diagnostic processes, and a critical shortage of dermatologists in resource-limited…

Developing artificial intelligence (AI) and machine learning (ML) models for medical imaging typically involves extensive training and testing on large datasets, consuming significant computational time, energy, and resources. There is a…

Image and Video Processing · Electrical Eng. & Systems 2024-12-13 Raj Hansini Khoiwal , Alan B. McMillan

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

The rapid generation of whole-slide images (WSIs) in dermatopathology necessitates automated methods for efficient processing and accurate classification. This study evaluates the performance of two foundation models, UNI and Virchow2, as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Riya Gupta , Yiwei Zong , Dennis H. Murphree

The identification of melanoma involves an integrated analysis of skin lesion images acquired using the clinical and dermoscopy modalities. Dermoscopic images provide a detailed view of the subsurface visual structures that supplement the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

Automated skin lesion classification using deep learning has shown remarkable accuracy, yet clinical adoption remains limited due to the "black box" nature of these models. We present MelanomaNet, an explainable deep learning system for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Sukhrobbek Ilyosbekov

In recent years, foundation models such as CLIP, DINO,and CONCH have demonstrated remarkable domain generalization and unsupervised feature extraction capabilities across diverse imaging tasks. However, systematic and independent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lavish Ramchandani , Aashay Tinaikar , Dev Kumar Das , Rohit Garg , Tijo Thomas
‹ Prev 1 2 3 10 Next ›