English
Related papers

Related papers: Benchmarking Foundation Models for Zero-Shot Biome…

200 papers

$ $The synergy of language and vision models has given rise to Large Language and Vision Assistant models (LLVAs), designed to engage users in rich conversational experiences intertwined with image-based queries. These comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ashhadul Islam , Md. Rafiul Biswas , Wajdi Zaghouani , Samir Brahim Belhaouari , Zubair Shah

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Large-scale Vision-Language Foundation Models (VLFMs), such as CLIP, now underpin a wide range of computer vision research and applications. VLFMs are often adapted to various domain-specific tasks. However, VLFM performance on novel,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chris Vorster , Mayug Maniparambil , Noel E. O'Connor , Noel Murphy , Derek Molloy

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Recent Vision Language Models (VLMs) have demonstrated strong performance across a wide range of multimodal reasoning tasks. This raises the question of whether such general-purpose models can also address specialized visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Vaclav Javorek , Jakub Honzik , Ivan Gruber , Tomas Zelezny , Marek Hruz

Vision foundation models can perform generalized object classification in zero-shot mode, and face/person recognition when they are fine-tuned. However, fine-tuned models suffer from catastrophic forgetting. We create models that perform…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Thomas M Metz , Matthew Q Hill , Alice J O'Toole

Foundation models have had a significant impact across various AI applications, enabling use cases that were previously impossible. Contrastive Visual Language Models (VLMs), in particular, have outperformed other techniques in many tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Aviad Barzilai , Yotam Gigi , Amr Helmy , Vered Silverman , Yehonathan Refael , Bolous Jaber , Tomer Shekel , George Leifman , Genady Beryozkin

This study utilizes the advanced capabilities of the GPT-4 multimodal Large Language Model (LLM) to explore its potential in iris recognition - a field less common and more specialized than face recognition. By focusing on this niche yet…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Parisa Farmanifard , Arun Ross

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

Vision-language models (VLMs) trained on internet-scale data achieve remarkable zero-shot detection performance on common objects like car, truck, and pedestrian. However, state-of-the-art models still struggle to generalize to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Peter Robicheaux , Matvei Popov , Anish Madan , Isaac Robinson , Joseph Nelson , Deva Ramanan , Neehar Peri

Current deep learning models are mostly task specific and lack a user-friendly interface to operate. We present Meta-EyeFM, a multi-function foundation model that integrates a large language model (LLM) with vision foundation models (VFMs)…

The rapid emergence of foundation models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs), has introduced a transformative paradigm in robotics. These models offer powerful capabilities in semantic understanding,…

Robotics · Computer Science 2025-07-15 Muhammad Tayyab Khan , Ammar Waheed

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in cross-modal understanding and generation by integrating visual and textual information. While instruction tuning and parameter-efficient fine-tuning methods have…

Machine Learning · Computer Science 2025-06-12 Weiying Zheng , Ziyue Lin , Pengxin Guo , Yuyin Zhou , Feifei Wang , Liangqiong Qu

The contemporary phenomenon of deepfakes, utilizing GAN or diffusion models for face swapping, presents a substantial and evolving threat in digital media, identity verification, and a multitude of other systems. The majority of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Viacheslav Pirogov

While specialized learning-based models have historically dominated image privacy prediction, the current literature increasingly favours adopting large Vision-Language Models (VLMs) designed for generic tasks. This trend risks overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Alina Elena Baia , Alessio Xompero , Andrea Cavallaro

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities across various downstream tasks, including biometric face recognition (FR) with description. However, demographic biases remain a critical concern in FR, as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Abu Sufian , Anirudha Ghosh , Debaditya Barman , Marco Leo , Cosimo Distante

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Facial age estimation plays a critical role in content moderation, age verification, and deepfake detection. However, no prior benchmark has systematically compared modern vision-language models (VLMs) with specialized age estimation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Simiao Ren , Xingyu Shen , Ankit Raj , Albert Dai , Caroline , Zhang , Yuan Xu , Zexi Chen , Siqi Wu , Chen Gong , Yuxin Zhang

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Vision-Language Models (VLMs) trained on web-scale corpora excel at natural image tasks and are increasingly repurposed for healthcare; however, their competence in medical tasks remains underexplored. We present a comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Che Liu , Jiazhen Pan , Weixiang Shen , Wenjia Bai , Daniel Rueckert , Rossella Arcucci