English
Related papers

Related papers: Benchmarking Knowledge-driven Zero-shot Learning

200 papers

Zero-shot learning (ZSL) aims to recognize unseen classes by aligning images with intermediate class semantics, like human-annotated concepts or class definitions. An emerging alternative leverages Large-scale Language Models (LLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zihan Ye , Shreyank N Gowda , Shiming Chen , Yaochu Jin , Kaizhu Huang , Xiaobo Jin

Natural Language Generation (NLG) accepts input data in the form of images, videos, or text and generates corresponding natural language text as output. Existing NLG methods mainly adopt a supervised approach and rely heavily on coupled…

Computation and Language · Computer Science 2024-06-04 Bang Yang , Fenglin Liu , Yuexian Zou , Xian Wu , Yaowei Wang , David A. Clifton

Knowledge graphs (KG) have served as the key component of various natural language processing applications. Commonsense knowledge graphs (CKG) are a special type of KG, where entities and relations are composed of free-form text. However,…

Computation and Language · Computer Science 2023-01-04 Haodi Ma , Daisy Zhe Wang

Generalized zero-shot learning (GZSL) is one of the most realistic but challenging problems due to the partiality of the classifier to supervised classes, especially under the class-inductive instance-inductive (CIII) training setting,…

Machine Learning · Computer Science 2021-08-24 Xiaowei Chen

Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes, using a set of attributes as auxiliary information, and the visual features extracted from a pre-trained convolutional neural network.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Paola Cascante-Bonilla , Leonid Karlinsky , James Seale Smith , Yanjun Qi , Vicente Ordonez

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

Zero-shot learning (ZSL) can be formulated as a cross-domain matching problem: after being projected into a joint embedding space, a visual sample will match against all candidate class-level semantic descriptions and be assigned to the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Lei Zhang , Peng Wang , Lingqiao Liu , Chunhua Shen , Wei Wei , Yannning Zhang , Anton Van Den Hengel

Zero-shot classification is a generalization task where no instance from the target classes is seen during training. To allow for test-time transfer, each class is annotated with semantic information, commonly in the form of attributes or…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Tristan Sylvain , Linda Petrini , R Devon Hjelm

Learning to classify unseen class samples at test time is popularly referred to as zero-shot learning (ZSL). If test samples can be from training (seen) as well as unseen classes, it is a more challenging problem due to the existence of…

Machine Learning · Statistics 2019-09-11 Vinay Kumar Verma , Dhanajit Brahma , Piyush Rai

Zero-shot learning (ZSL) aims to leverage additional semantic information to recognize unseen classes. To transfer knowledge from seen to unseen classes, most ZSL methods often learn a shared embedding space by simply aligning visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Bowen Duan , Shiming Chen , Yufei Guo , Guo-Sen Xie , Weiping Ding , Yisong Wang

Music classification and tagging is conducted through categorical supervised learning with a fixed set of labels. In principle, this cannot make predictions on unseen labels. Zero-shot learning is an approach to solve the problem by using…

Multimedia · Computer Science 2019-06-21 Jeong Choi , Jongpil Lee , Jiyoung Park , Juhan Nam

Feature generating networks face to the most important question, which is the fitting difference (inconsistence) of the distribution between the generated feature and the real data. This inconsistence further influence the performance of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Guangfeng Lin , Wanjun Chen , Kaiyang Liao , Xiaobing Kang , Caixia Fan

Zero-shot learning (ZSL) aims to recognize unseen classes by transferring semantic knowledge from seen classes to unseen ones, guided by semantic information. To this end, existing works have demonstrated remarkable performance by utilizing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Wenjin Hou , Dingjie Fu , Kun Li , Shiming Chen , Hehe Fan , Yi Yang

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to learn and understand the world. While considerable progress…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Siteng Huang , Qiyao Wei , Donglin Wang

We present a meta-learning based generative model for zero-shot learning (ZSL) towards a challenging setting when the number of training examples from each \emph{seen} class is very few. This setup contrasts with the conventional ZSL…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Vinay Kumar Verma , Ashish Mishra , Anubha Pandey , Hema A. Murthy , Piyush Rai

The number of categories for action recognition is growing rapidly and it has become increasingly hard to label sufficient training data for learning conventional models for all categories. Instead of collecting ever more data and labelling…

Computer Vision and Pattern Recognition · Computer Science 2016-12-05 Xun Xu , Timothy Hospedales , Shaogang Gong

Zero-shot learning, the task of learning to recognize new classes not seen during training, has received considerable attention in the case of 2D image classification. However, despite the increasing ubiquity of 3D sensors, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Ali Cheraghian , Shafinn Rahman , Townim F. Chowdhury , Dylan Campbell , Lars Petersson

Compositional Zero-Shot learning (CZSL) aims to recognize unseen compositions of state and object visual primitives seen during training. A problem with standard CZSL is the assumption of knowing which unseen compositions will be available…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Massimiliano Mancini , Muhammad Ferjad Naeem , Yongqin Xian , Zeynep Akata

We improve zero-shot learning (ZSL) by incorporating common-sense knowledge in DNNs. We propose Common-Sense based Neuro-Symbolic Loss (CSNL) that formulates prior knowledge as novel neuro-symbolic loss functions that regularize…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Karan Sikka , Jihua Huang , Andrew Silberfarb , Prateeth Nayak , Luke Rohrer , Pritish Sahu , John Byrnes , Ajay Divakaran , Richard Rohwer

The new generation of state-of-the-art computer vision systems are trained from natural language supervision, ranging from simple object category names to descriptive captions. This form of supervision ensures high generality and usability…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Sheng Shen , Chunyuan Li , Xiaowei Hu , Jianwei Yang , Yujia Xie , Pengchuan Zhang , Zhe Gan , Lijuan Wang , Lu Yuan , Ce Liu , Kurt Keutzer , Trevor Darrell , Anna Rohrbach , Jianfeng Gao