English
Related papers

Related papers: Enhancing Fine-Grained Vision-Language Pretraining…

200 papers

Foundation Vision-Language Models (VLMs) trained using large-scale open-domain images and text pairs have recently been adapted to develop Vision-Language Segmentation Models (VLSMs) that allow providing text prompts during inference to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Manish Dhakal , Rabin Adhikari , Safal Thapaliya , Bishesh Khanal

Vision-language models offer strong few-shot capability through prompt tuning but remain vulnerable to noisy labels, which can corrupt prompts and degrade cross-modal alignment. Existing approaches struggle because they often lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lu Niu , Cheng Xue

The multimedia community has shown a significant interest in perceiving and representing the physical world with multimodal pretrained neural network models, and among them, the visual-language pertaining (VLP) is, currently, the most…

Multimedia · Computer Science 2023-08-28 Fei Wang , Liang Ding , Jun Rao , Ye Liu , Li Shen , Changxing Ding

Large-scale Vision-Language Pre-training (VLP) has demonstrated remarkable success in the general domain. However, in the fashion domain, items are distinguished by fine-grained attributes like texture and material, which are crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jiale Huang , Dehong Gao , Jinxia Zhang , Zechao Zhan , Yang Hu , Xin Wang

Recent advancements in Vision-Language-Action (VLA) models have leveraged pre-trained Vision-Language Models (VLMs) to improve the generalization capabilities. VLMs, typically pre-trained on vision-language understanding tasks, provide rich…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jianke Zhang , Yanjiang Guo , Yucheng Hu , Xiaoyu Chen , Xiang Zhu , Jianyu Chen

Subtle semantic differences in retinal image and text data present great challenges for pre-training visual-language models. Moreover, false negative samples, i.e., image-text pairs having the same semantics but incorrectly regarded as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Shengzhu Yang , Jiawei Du , Jia Guo , Weihang Zhang , Hanruo Liu , Huiqi Li , Ningli Wang

Vision-language models (VLMs) have demonstrated strong cross-modal capabilities, yet most work remains limited to 2D data and assumes binary supervision (i.e., positive vs. negative pairs), overlooking the continuous and structured…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Ailar Mahdizadeh , Puria Azadi Moghadam , Xiangteng He , Shahriar Mirabbasi , Panos Nasiopoulos , Leonid Sigal

Vision-Language Models (VLMs) have demonstrated impressive multimodal capabilities in learning joint representations of visual and textual data, making them powerful tools for tasks such as Compositional Zero-Shot Learning (CZSL). CZSL…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Kyle Stein , Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Most of the currently existing vision and language pre-training (VLP) methods have mainly focused on how to extract and align vision and text features. In contrast to the mainstream VLP methods, we highlight that two routinely applied steps…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jaeseok Byun , Taebaek Hwang , Jianlong Fu , Taesup Moon

Video anomaly detection is a subject of great interest across industrial and academic domains due to its crucial role in computer vision applications. However, the inherent unpredictability of anomalies and the scarcity of anomaly samples…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Yalong Jiang , Liquan Mao

This paper demonstrates that a progressively aligned language model can effectively bridge frozen vision encoders and large language models (LLMs). While the fundamental architecture and pre-training methods of vision encoders and LLMs have…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Junfei Xiao , Zheng Xu , Alan Yuille , Shen Yan , Boyu Wang

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Recent advances in instruction-tuned Large Vision-Language Models (LVLMs) have imbued the models with the ability to generate high-level, image-grounded explanations with ease. While such capability is largely attributed to the rich world…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Jeonghwan Kim , Heng Ji

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Silin Cheng , Kai Han

Although large vision-language models (LVLMs) have demonstrated impressive capabilities in multi-modal understanding and reasoning, their practical applications are still limited by massive model parameters and high computational costs.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang

Vision-and-language models (VLMs) have been increasingly explored in the medical domain, particularly following the success of CLIP in general domain. However, unlike the relatively straightforward pairing of 2D images and text, curating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ziyang Zhang , Yang Yu , Xulei Yang , Si Yong Yeo

Vision-language models (VLMs) like CLIP excel in zero-shot learning by aligning image and text representations through contrastive pretraining. Existing approaches to unsupervised adaptation (UA) for fine-grained classification with VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Eman Ali , Sathira Silva , Chetan Arora , Muhammad Haris Khan

Object-aware reasoning in vision-language tasks poses significant challenges for current models, particularly in handling unseen objects, reducing hallucinations, and capturing fine-grained relationships in complex visual scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Antonio Carlos Rivera , Anthony Moore , Steven Robinson

Recent advancements in Vision-Language (VL) models have sparked interest in their deployment on edge devices, yet challenges in handling diverse visual modalities, manual annotation, and computational constraints remain. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Kaiwen Cai , Zhekai Duan , Gaowen Liu , Charles Fleming , Chris Xiaoxuan Lu

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

Computation and Language · Computer Science 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer