English
Related papers

Related papers: Zero-Shot Fine-Grained Image Classification Using …

200 papers

Recent zero-shot learning (ZSL) approaches have integrated fine-grained analysis, i.e., fine-grained ZSL, to mitigate the commonly known seen/unseen domain bias and misaligned visual-semantics mapping problems, and have made profound…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Jingcai Guo , Zhijie Rao , Zhi Chen , Jingren Zhou , Dacheng Tao

While specialized learning-based models have historically dominated image privacy prediction, the current literature increasingly favours adopting large Vision-Language Models (VLMs) designed for generic tasks. This trend risks overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Alina Elena Baia , Alessio Xompero , Andrea Cavallaro

Vision-language models (VLMs) have made substantial progress across a wide range of visual question answering benchmarks, spanning visual reasoning, document understanding, and multimodal dialogue. These improvements are evident in a wide…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Dhruba Ghosh , Yuhui Zhang , Ludwig Schmidt

Fine-grained ship classification in remote sensing (RS-FGSC) poses a significant challenge due to the high similarity between classes and the limited availability of labeled data, limiting the effectiveness of traditional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Long Lan , Fengxiang Wang , Xiangtao Zheng , Zengmao Wang , Xinwang Liu

Human age estimation from facial images represents a challenging computer vision task with significant applications in biometrics, healthcare, and human-computer interaction. While traditional deep learning approaches require extensive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rakib Hossain Sajib , Md Kishor Morol , Rajan Das Gupta , Mohammad Sakib Mahmood , Shuvra Smaran Das

Large-scale vision-language models (VLMs), such as CLIP, have achieved remarkable success in zero-shot learning (ZSL) by leveraging large-scale visual-text pair datasets. However, these methods often lack interpretability, as they compute…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiming Chen , Bowen Duan , Salman Khan , Fahad Shahbaz Khan

While Multimodal Large Language Models (MLLMs) offer strong perception and reasoning capabilities for image-text input, Visual Question Answering (VQA) focusing on small image details still remains a challenge. Although visual cropping…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Liangyu Zhong , Fabio Rosenthal , Joachim Sicking , Fabian Hüger , Thorsten Bagdonat , Hanno Gottschalk , Leo Schwinn

The contemporary phenomenon of deepfakes, utilizing GAN or diffusion models for face swapping, presents a substantial and evolving threat in digital media, identity verification, and a multitude of other systems. The majority of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Viacheslav Pirogov

Vision language models (VLMs) excel at zero-shot visual classification, but their performance on fine-grained tasks and large hierarchical label spaces is understudied. This paper investigates whether structured, tree-based reasoning can…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sary Elmansoury , Islam Mesabah , Gerrit Großmann , Peter Neigel , Raj Bhalwankar , Daniel Kondermann , Sebastian J. Vollmer

Large-scale vision-language models (VLMs), trained on extensive datasets of image-text pairs, exhibit strong multimodal understanding capabilities by implicitly learning associations between textual descriptions and image regions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Large Vision Language Models (LVLMs) have made remarkable progress, enabling sophisticated vision-language interaction and dialogue applications. However, existing benchmarks primarily focus on reasoning tasks, often neglecting fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Cong Pang , Hongtao Yu , Zixuan Chen , Lewei Lu , Xin Lou

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attributes: manually encoded…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Scott Reed , Zeynep Akata , Bernt Schiele , Honglak Lee

Large-scale contrastive vision-language pre-trained models provide the zero-shot model achieving competitive performance across a range of image classification tasks without requiring training on downstream data. Recent works have confirmed…

Machine Learning · Computer Science 2024-04-02 Giung Nam , Byeongho Heo , Juho Lee

Large scale vision and language models can achieve impressive zero-shot recognition performance by mapping class specific text queries to image content. Two distinct challenges that remain however, are high sensitivity to the choice of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Sarah Parisot , Yongxin Yang , Steven McDonagh

Recently, Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in visual understanding and reasoning across various vision-language tasks. However, we found that MLLMs cannot process effectively from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Bangyan Li , Wenxuan Huang , Zhenkun Gao , Yeqiang Wang , Yunhang Shen , Jingzhong Lin , Ling You , Yuxiang Shen , Shaohui Lin , Wanli Ouyang , Yuling Sun

Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Adeel Yousaf , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jeonghwan Kim , Heng Ji

$ $The synergy of language and vision models has given rise to Large Language and Vision Assistant models (LLVAs), designed to engage users in rich conversational experiences intertwined with image-based queries. These comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ashhadul Islam , Md. Rafiul Biswas , Wajdi Zaghouani , Samir Brahim Belhaouari , Zubair Shah

Despite advancements in Multimodal Large Language Models (MLLMs), their proficiency in fine-grained video motion understanding remains critically limited. They often lack inter-frame differencing and tend to average or ignore subtle visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Yipeng Du , Tiehan Fan , Kepan Nan , Rui Xie , Penghao Zhou , Xiang Li , Jian Yang , Zhenheng Yang , Ying Tai

Stimulated by the sophisticated reasoning capabilities of recent Large Language Models (LLMs), a variety of strategies for bridging video modality have been devised. A prominent strategy involves Video Language Models (VideoLMs), which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Wonkyun Kim , Changin Choi , Wonseok Lee , Wonjong Rhee