English
Related papers

Related papers: Boosting Open-Domain Continual Learning via Levera…

200 papers

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

Prompt learning is a powerful technique for transferring Vision-Language Models (VLMs) such as CLIP to downstream tasks. However, the prompt-based methods that are fine-tuned solely with base classes may struggle to generalize to novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Mushui Liu , Weijie He , Ziqian Lu , Yunlong Yu

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Open compound domain adaptation (OCDA) is a domain adaptation setting, where target domain is modeled as a compound of multiple unknown homogeneous domains, which brings the advantage of improved generalization to unseen domains. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Rui Gong , Yuhua Chen , Danda Pani Paudel , Yawei Li , Ajad Chhatkuli , Wen Li , Dengxin Dai , Luc Van Gool

In this paper, we focus on a new and challenging decentralized machine learning paradigm in which there are continuous inflows of data to be addressed and the data are stored in multiple repositories. We initiate the study of data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Xiaohan Zhang , Songlin Dong , Jinjie Chen , Qi Tian , Yihong Gong , Xiaopeng Hong

Large pre-trained vision-language models, such as CLIP, have shown remarkable generalization capabilities across various tasks when appropriate text prompts are provided. However, adapting these models to specific domains, like remote…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Large-scale vision-language models like CLIP have demonstrated impressive open-vocabulary capabilities for image-level tasks, excelling in recognizing what objects are present. However, they struggle with pixel-level recognition tasks like…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Heeseong Shin , Chaehyun Kim , Sunghwan Hong , Seokju Cho , Anurag Arnab , Paul Hongsuck Seo , Seungryong Kim

Identifying labels that did not appear during training, known as multi-label zero-shot learning, is a non-trivial task in computer vision. To this end, recent studies have attempted to explore the multi-modal knowledge of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Xuelin Zhu , Jian Liu , Dongqi Tang , Jiawei Ge , Weijia Liu , Bo Liu , Jiuxin Cao

A desirable open world recognition (OWR) system requires performing three tasks: (1) Open set recognition (OSR), i.e., classifying the known (classes seen during training) and rejecting the unknown (unseen$/$novel classes) online; (2)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Fulin Gao , Weimin Zhong , Zhixing Cao , Xin Peng , Zhi Li

Deep learning models dealing with image understanding in real-world settings must be able to adapt to a wide variety of tasks across different domains. Domain adaptation and class incremental learning deal with domain and task variability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Marco Toldo , Umberto Michieli , Pietro Zanuttigh

Vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot ability in image classification tasks by aligning text and images but suffer inferior performance compared with task-specific expert models. On the contrary,…

Artificial Intelligence · Computer Science 2025-02-04 Jia Zhang , Zhi Zhou , Lan-Zhe Guo , Yu-Feng Li

OOD-CV challenge is an out-of-distribution generalization task. In this challenge, our core solution can be summarized as that Noisy Label Learning Is A Strong Test-Time Domain Adaptation Optimizer. Briefly speaking, our main pipeline can…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Yilu Guo , Xingyue Shi , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

Vision-language pre-training methods, e.g., CLIP, demonstrate an impressive zero-shot performance on visual categorizations with the class proxy from the text embedding of the class name. However, the modality gap between the text and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Qi Qian , Yuanhong Xu , Juhua Hu

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

This paper develops variational continual learning (VCL), a simple but general framework for continual learning that fuses online variational inference (VI) and recent advances in Monte Carlo VI for neural networks. The framework can…

Machine Learning · Statistics 2018-05-22 Cuong V. Nguyen , Yingzhen Li , Thang D. Bui , Richard E. Turner

In open-world learning, an agent starts with a set of known classes, detects, and manages things that it does not know, and learns them over time from a non-stationary stream of data. Open-world learning is related to but also distinct from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Mohsen Jafarzadeh , Akshay Raj Dhamija , Steve Cruz , Chunchun Li , Touqeer Ahmad , Terrance E. Boult

With the increasing attention to pre-trained vision-language models (VLMs), \eg, CLIP, substantial efforts have been devoted to many downstream tasks, especially in test-time adaptation (TTA). However, previous works focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingyu Zhu , Shuo Wang , Beier Zhu , Miaoge Li , Yunfan Li , Junfeng Fang , Zhicai Wang , Dongsheng Wang , Hanwang Zhang

With its powerful visual-language alignment capability, CLIP performs well in zero-shot and few-shot learning tasks. However, we found in experiments that CLIP's logits suffer from serious inter-class confusion problems in downstream tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Shuo Li , Fang Liu , Zehua Hao , Xinyi Wang , Lingling Li , Xu Liu , Puhua Chen , Wenping Ma

Rapid development of large-scale pre-training has resulted in foundation models that can act as effective feature extractors on a variety of downstream tasks and domains. Motivated by this, we study the efficacy of pre-trained vision models…

Machine Learning · Computer Science 2022-07-05 Oleksiy Ostapenko , Timothee Lesort , Pau Rodríguez , Md Rifat Arefin , Arthur Douillard , Irina Rish , Laurent Charlin

Recent years have witnessed significant progress in person re-identification (ReID). However, current ReID approaches still suffer from considerable performance degradation when unseen testing domains exhibit different characteristics from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shijie Yu , Feng Zhu , Dapeng Chen , Rui Zhao , Haobin Chen , Shixiang Tang , Jinguo Zhu , Yu Qiao