English
Related papers

Related papers: LLMs Are Not Yet Ready for Deepfake Image Detectio…

200 papers

Explainability in artificial intelligence is crucial for restoring trust, particularly in areas like face forgery detection, where viewers often struggle to distinguish between real and fabricated content. Vision and Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Niki Maria Foteinopoulou , Enjie Ghorbel , Djamila Aouada

Vision language models (VLMs) have recently emerged and gained the spotlight for their ability to comprehend the dual modality of image and textual data. VLMs such as LLaVA, ChatGPT-4, and Gemini have recently shown impressive performance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Prateek Verma , Minh-Hao Van , Xintao Wu

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

The rapid progress of Large Models (LMs) has recently revolutionized various fields of deep learning with remarkable grades, ranging from Natural Language Processing (NLP) to Computer Vision (CV). However, LMs are increasingly challenged…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Ziyan Guo , Li Xu , Jun Liu

Recent advances in open-source vision-language models (VLMs) offer new opportunities for understanding complex and subjective multimodal phenomena such as sarcasm. In this work, we evaluate seven state-of-the-art VLMs - BLIP2, InstructBLIP,…

Machine Learning · Computer Science 2025-10-15 Saroj Basnet , Shafkat Farabi , Tharindu Ranasinghe , Diptesh Kanoji , Marcos Zampieri

Large Vision-Language Models (VLMs) are increasingly used to evaluate outputs of other models, for image-to-text (I2T) tasks such as visual question answering, and text-to-image (T2I) generation tasks. Despite this growing reliance, the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Mohammed Safi Ur Rahman Khan , Sanjay Suryanarayanan , Tushar Anand , Mitesh M. Khapra

The rapid rise of deepfake technology, which produces realistic but fraudulent digital content, threatens the authenticity of media. Traditional deepfake detection approaches often struggle with sophisticated, customized deepfakes,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Ahmad ALBarqawi , Mahmoud Nazzal , Issa Khalil , Abdallah Khreishah , NhatHai Phan

Large visual-language models (LVLMs) exhibit exceptional performance in visual-language reasoning across diverse cross-modal benchmarks. Despite these advances, recent research indicates that Large Language Models (LLMs), like…

Computation and Language · Computer Science 2025-04-17 Ye Jiang , Yimin Wang

Traditional evaluations of multimodal large language models (LLMs) have been limited by their focus on single-image reasoning, failing to assess crucial aspects like contextual understanding, reasoning stability, and uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Nidhal Jegham , Marwan Abdelatti , Abdeltawab Hendawi

Human age estimation from facial images represents a challenging computer vision task with significant applications in biometrics, healthcare, and human-computer interaction. While traditional deep learning approaches require extensive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rakib Hossain Sajib , Md Kishor Morol , Rajan Das Gupta , Mohammad Sakib Mahmood , Shuvra Smaran Das

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Language and Vision-Language Models (LLMs/VLMs) have revolutionized the field of AI by their ability to generate human-like text and understand images, but ensuring their reliability is crucial. This paper aims to evaluate the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Tobias Groot , Matias Valdenegro-Toro

Vision Language Models (VLMs) extend remarkable capabilities of text-only large language models and vision-only models, and are able to learn from and process multi-modal vision-text input. While modern VLMs perform well on a number of…

Computation and Language · Computer Science 2025-07-22 Hannah Sterz , Jonas Pfeiffer , Ivan Vulić

Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Kaiqing Lin , Zhiyuan Yan , Ruoxin Chen , Junyan Ye , Ke-Yue Zhang , Yue Zhou , Peng Jin , Bin Li , Taiping Yao , Shouhong Ding

Fine-grained detection and localization of localized image edits is crucial for assessing content authenticity, especially as modern diffusion models and image editors can produce highly realistic manipulations. However, this problem faces…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhen Sun , Ziyi Zhang , Zeren Luo , Zhiyuan Zhong , Zeyang Sha , Tianshuo Cong , Zheng Li , Shiwen Cui , Weiqiang Wang , Jiaheng Wei , Xinlei He , Qi Li , Qian Wang

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong capabilities in general visual reasoning, yet their applicability to rigorous biometric tasks remains unexplored. This work presents an exploratory study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Marta Robledo-Moreno , Ruben Vera-Rodriguez , Ruben Tolosana , Javier Ortega-Garcia

To leverage the full potential of Large Language Models (LLMs) it is crucial to have some information on their answers' uncertainty. This means that the model has to be able to quantify how certain it is in the correctness of a given…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mirko Borszukovszki , Ivo Pascal de Jong , Matias Valdenegro-Toro

Large vision-language models (LVLMs) have been regarded as a breakthrough advance in an astoundingly variety of tasks, from content generation to virtual assistants and multimodal search or retrieval. However, for many of these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Kailash Hambarde , Pranita Samale , Hugo Proença

In recent years, the rapid evolution of large vision-language models (LVLMs) has driven a paradigm shift in multimodal fake news detection (MFND), transforming it from traditional feature-engineering approaches to unified, end-to-end…

Artificial Intelligence · Computer Science 2026-01-23 Wei Ai , Yilong Tan , Yuntao Shou , Tao Meng , Haowen Chen , Zhixiong He , Keqin Li