English
Related papers

Related papers: Vocabulary-informed Zero-shot and Open-set Learnin…

200 papers

Fine-grained object recognition that aims to identify the type of an object among a large number of subcategories is an emerging application with the increasing resolution that exposes new details in image data. Traditional fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Gencer Sumbul , Ramazan Gokberk Cinbis , Selim Aksoy

Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Jingcai Guo , Song Guo

The zero-shot paradigm exploits vector-based word representations extracted from text corpora with unsupervised methods to learn general mapping functions from other feature spaces onto word space, where the words associated to the nearest…

Computation and Language · Computer Science 2015-04-16 Georgiana Dinu , Angeliki Lazaridou , Marco Baroni

In Generalized Zero-Shot Learning (GZSL), unseen categories (for which no visual data are available at training time) can be predicted by leveraging their class embeddings (e.g., a list of attributes describing them) together with a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Federico Marmoreo , Julio Ivan Davila Carrazco , Vittorio Murino , Jacopo Cavazza

Zero-shot recognition (ZSR) deals with the problem of predicting class labels for target domain instances based on source domain side information (e.g. attributes) of unseen classes. We formulate ZSR as a binary prediction problem. Our…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Ziming Zhang , Venkatesh Saligrama

In this paper, we propose a novel deep learning architecture for multi-label zero-shot learning (ML-ZSL), which is able to predict multiple unseen class labels for each input instance. Inspired by the way humans utilize semantic knowledge…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Chung-Wei Lee , Wei Fang , Chih-Kuan Yeh , Yu-Chiang Frank Wang

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Though many ZSL methods rely on a direct mapping between the visual and the semantic space, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Yang Liu , Lei Zhou , Xiao Bai , Lin Gu , Tatsuya Harada , Jun Zhou

In recent years, few-shot and zero-shot learning, which learn to predict labels with limited annotated instances, have garnered significant attention. Traditional approaches often treat frequent-shot (freq-shot; labels with abundant…

Computation and Language · Computer Science 2024-03-07 Hanzi Xu , Muhao Chen , Lifu Huang , Slobodan Vucetic , Wenpeng Yin

This paper addresses the task of zero-shot image classification. The key contribution of the proposed approach is to control the semantic embedding of images -- one of the main ingredients of zero-shot learning -- by formulating it as a…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Maxime Bucher , Stéphane Herbin , Frédéric Jurie

Federated learning aims to tackle the ``isolated data island" problem, where it trains a collective model from physically isolated clients while safeguarding the privacy of users' data. However, supervised federated learning necessitates…

Artificial Intelligence · Computer Science 2024-04-18 Hao Yan , Yuhong Guo

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

The core problem in zero-shot open vocabulary detection is how to align visual and text features, so that the detector performs well on unseen classes. Previous approaches train the feature pyramid and detection head from scratch, which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Relja Arandjelović , Alex Andonian , Arthur Mensch , Olivier J. Hénaff , Jean-Baptiste Alayrac , Andrew Zisserman

State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information. In these formulations the current best complement to visual features are attributes: manually encoded…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Scott Reed , Zeynep Akata , Bernt Schiele , Honglak Lee

We propose a novel approach for unsupervised zero-shot learning (ZSL) of classes based on their names. Most existing unsupervised ZSL methods aim to learn a model for directly comparing image features and class names. However, this proves…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Berkan Demirel , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Zero-shot learning methods rely on fixed visual and semantic embeddings, extracted from independent vision and language models, both pre-trained for other large-scale tasks. This is a weakness of current zero-shot learning frameworks as…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Shah Nawaz , Jacopo Cavazza , Alessio Del Bue

Recently, large-scale pre-trained Vision and Language (VL) models have set a new state-of-the-art (SOTA) in zero-shot visual classification enabling open-vocabulary recognition of potentially unlimited set of categories defined as simple…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Mateusz Kozinski , Horst Possegger , Rogerio Feris , Horst Bischof

Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zihan Ye , Guanyu Yang , Xiaobo Jin , Youfa Liu , Kaizhu Huang

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can impact their…

Machine Learning · Computer Science 2024-02-13 Dyah Adila , Changho Shin , Linrong Cai , Frederic Sala