English
Related papers

Related papers: Learning Visual Proxy for Compositional Zero-Shot …

200 papers

In compositional zero-shot learning, the goal is to recognize unseen compositions (e.g. old dog) of observed visual primitives states (e.g. old, cute) and objects (e.g. car, dog) in the training set. This is challenging because the same…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Muhammad Ferjad Naeem , Yongqin Xian , Federico Tombari , Zeynep Akata

Compositional Zero-Shot Learning (CZSL) aims to recognize novel state-object compositions by leveraging the shared knowledge of their primitive components. Despite considerable progress, effectively calibrating the bias between semantically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Miaoge Li , Jingcai Guo , Richard Yi Da Xu , Dongsheng Wang , Xiaofeng Cao , Zhijie Rao , Song Guo

Continual zero-shot learning(CZSL) is a new domain to classify objects sequentially the model has not seen during training. It is more suitable than zero-shot and continual learning approaches in real-case scenarios when data may come…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Subhankar Ghosh

In generalized zero shot learning (GZSL), the set of classes are split into seen and unseen classes, where training relies on the semantic features of the seen and unseen classes and the visual representations of only the seen classes,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Rafael Felix , B. G. Vijay Kumar , Ian Reid , Gustavo Carneiro

Visual imagery does not consist of solitary objects, but instead reflects the composition of a multitude of fluid concepts. While there have been great advances in visual representation learning, such advances have focused on building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Austin Stone , Hagen Soltau , Robert Geirhos , Xi Yi , Ye Xia , Bingyi Cao , Kaifeng Chen , Abhijit Ogale , Jonathon Shlens

We present a machine learning system that can quantify fine art paintings with a set of visual elements and principles of art. This formal analysis is fundamental for understanding art, but developing such a system is challenging. Paintings…

Machine Learning · Computer Science 2022-01-14 Diana Kim , Ahmed Elgammal , Marian Mazzone

Large Vision Language Models (LVLMs) have demonstrated impressive zero-shot capabilities in various vision-language dialogue scenarios. However, the absence of fine-grained visual object detection hinders the model from understanding the…

Computation and Language · Computer Science 2024-04-15 Junyu Lu , Dixiang Zhang , Songxin Zhang , Zejian Xie , Zhuoyang Song , Cong Lin , Jiaxing Zhang , Bingyi Jing , Pingjian Zhang

Zero-shot learning (ZSL) recognizes the unseen classes by conducting visual-semantic interactions to transfer semantic knowledge from seen classes to unseen ones, supported by semantic information (e.g., attributes). However, existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shiming Chen , Wenjin Hou , Salman Khan , Fahad Shahbaz Khan

Recent years have witnessed a significant increase in the performance of Vision and Language tasks. Foundational Vision-Language Models (VLMs), such as CLIP, have been leveraged in multiple settings and demonstrated remarkable performance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Santiago Castro , Amir Ziai , Avneesh Saluja , Zhuoning Yuan , Rada Mihalcea

Zero-shot Learning (ZSL) aims to enable classifiers to identify unseen classes. This is typically achieved by generating visual features for unseen classes based on learned visual-semantic correlations from seen classes. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Zihan Ye , Shreyank N. Gowda , Xiaowei Huang , Haotian Xu , Yaochu Jin , Kaizhu Huang , Xiaobo Jin

Zero-shot learning (ZSL) endeavors to transfer knowledge from seen categories to recognize unseen categories, which mostly relies on the semantic-visual interactions between image and attribute tokens. Recently, prompt learning has emerged…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Man Liu , Huihui Bai , Feng Li , Chunjie Zhang , Yunchao Wei , Tat-Seng Chua , Yao Zhao

Due to the lack of properly annotated medical data, exploring the generalization capability of the deep model is becoming a public concern. Zero-shot learning (ZSL) has emerged in recent years to equip the deep model with the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Bian , Chenglang Yuan , Kai Ma , Shuang Yu , Dong Wei , Yefeng Zheng

The task of Compositional Zero-Shot Learning (CZSL) is to recognize images of novel state-object compositions that are absent during the training stage. Previous methods of learning compositional embedding have shown effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Zhe Liu , Yun Li , Lina Yao , Xiaojun Chang , Wei Fang , Xiaojun Wu , Yi Yang

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

Although zero-shot learning (ZSL) has an inferential capability of recognizing new classes that have never been seen before, it always faces two fundamental challenges of the cross modality and crossdomain challenges. In order to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Cheng Xie , Hongxin Xiang , Ting Zeng , Yun Yang , Beibei Yu , Qing Liu

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Contextual cues related to a person's pose and interactions with objects and other people in the scene can provide valuable information for gaze following. While existing methods have focused on dedicated cue extraction methods, in this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Anshul Gupta , Pierre Vuillecard , Arya Farkhondeh , Jean-Marc Odobez

Zero-shot learning (ZSL) is concerned with the recognition of previously unseen classes. It relies on additional semantic knowledge for which a mapping can be learned with training examples of seen classes. While classical ZSL considers the…

Machine Learning · Computer Science 2019-01-16 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by learning seen classes and known attributes, but correlations in attributes were ignored by previous study which lead to classification results confused. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang