English
Related papers

Related papers: CLIP-Guided Adaptable Self-Supervised Learning for…

200 papers

Street-view image attribute classification is a vital downstream task of image classification, enabling applications such as autonomous driving, urban analytics, and high-definition map construction. It remains computationally demanding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Qi You , Yitai Cheng , Zichao Zeng , James Haworth

Recent image tone adjustment (or enhancement) approaches have predominantly adopted supervised learning for learning human-centric perceptual assessment. However, these approaches are constrained by intrinsic challenges of supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hyeongmin Lee , Kyoungkook Kang , Jungseul Ok , Sunghyun Cho

Human action recognition plays a critical role in healthcare and medicine, supporting applications such as patient behavior monitoring, fall detection, surgical robot supervision, and procedural skill assessment. While traditional models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Utkarsh Shandilya , Marsha Mariya Kappan , Sanyam Jain , Vijeta Sharma

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Visual Self-Supervised Learning (SSL) currently underperforms Contrastive Language-Image Pretraining (CLIP) in multimodal settings such as Visual Question Answering (VQA). This multimodal gap is often attributed to the semantics introduced…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 David Fan , Shengbang Tong , Jiachen Zhu , Koustuv Sinha , Zhuang Liu , Xinlei Chen , Michael Rabbat , Nicolas Ballas , Yann LeCun , Amir Bar , Saining Xie

Contrastive Language-Image Pre-training (CLIP) has demonstrated remarkable generalization ability and strong performance across a wide range of vision-language tasks. However, due to the lack of region-level supervision, CLIP exhibits…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haoxi Zeng , Haoxuan Li , Yi Bin , Pengpeng Zeng , Xing Xu , Yang Yang , Heng Tao Shen

Recent approaches leveraging multi-modal pre-trained models like CLIP for Unsupervised Domain Adaptation (UDA) have shown significant promise in bridging domain gaps and improving generalization by utilizing rich semantic knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Tung-Long Vuong , Hoang Phan , Vy Vo , Anh Bui , Thanh-Toan Do , Trung Le , Dinh Phung

Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shaotian Cai , Liping Qiu , Xiaojun Chen , Qin Zhang , Longteng Chen

Malicious image manipulation threatens public safety and requires efficient localization methods. Existing approaches depend on costly pixel-level annotations which make training expensive. Existing weakly supervised methods rely only on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Xinghao Wang , Changtao Miao , Dianmo Sheng , Tao Gong , Qi Chu , Nenghai Yu , Quanchen Zou , Deyue Zhang , Xiangzheng Zhang

Visual Grounding (VG) is a crucial topic in the field of vision and language, which involves locating a specific region described by expressions within an image. To reduce the reliance on manually labeled data, unsupervised visual grounding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Linhui Xiao , Xiaoshan Yang , Fang Peng , Ming Yan , Yaowei Wang , Changsheng Xu

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

Vision-language contrastive learning frameworks such as CLIP enable learning representations from natural language supervision and provide strong zero-shot classification capabilities. However, due to the nature of the supervisory signal in…

Machine Learning · Computer Science 2025-06-24 Mohammed Baharoon , Jonathan Klein , Dominik L. Michels

Incidental supervision from language has become a popular approach for learning generic visual representations that can be prompted to perform many recognition tasks in computer vision. We conduct an in-depth exploration of the CLIP model…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Sachit Menon , Ishaan Preetam Chandratreya , Carl Vondrick

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

Large-scale vision-language models like CLIP have demonstrated impressive open-vocabulary capabilities for image-level tasks, excelling in recognizing what objects are present. However, they struggle with pixel-level recognition tasks like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Heeseong Shin , Chaehyun Kim , Sunghwan Hong , Seokju Cho , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unprecedented human-like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Bang An , Sicheng Zhu , Michael-Andrei Panaitescu-Liess , Chaithanya Kumar Mummadi , Furong Huang

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

This work aims to adapt large-scale pre-trained vision-language models, such as contrastive language-image pretraining (CLIP), to enhance the performance of object reidentification (Re-ID) across various supervision settings. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Jiachen Li , Xiaojin Gong