English
Related papers

Related papers: Harnessing GANs for Zero-shot Learning of New Clas…

200 papers

Zero-shot learning (ZSL) aims to recognize unseen classes by generalizing the relation between visual features and semantic attributes learned from the seen classes. A recent paradigm called transductive zero-shot learning further leverages…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Zhengbo Wang , Jian Liang , Zilei Wang , Tieniu Tan

Remarkable progress in zero-shot learning (ZSL) has been achieved using generative models. However, existing generative ZSL methods merely generate (imagine) the visual features from scratch guided by the strong class semantic vectors…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shiming Chen , Dingjie Fu , Salman Khan , Fahad Shahbaz Khan

To overcome the absence of training data for unseen classes, conventional zero-shot learning approaches mainly train their model on seen datapoints and leverage the semantic descriptions for both seen and unseen classes. Beyond exploiting…

Machine Learning · Computer Science 2019-10-22 Hyeonwoo Yu , Beomhee Lee

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han

Zero-Shot Learning (ZSL) targets at recognizing unseen categories by leveraging auxiliary information, such as attribute embedding. Despite the encouraging results achieved, prior ZSL approaches focus on improving the discriminant power of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Lianbo Zhang , Shaoli Huang , Xinchao Wang , Wei Liu , Dacheng Tao

We consider the problem of zero-shot recognition: learning a visual classifier for a category with zero training examples, just using the word embedding of the category and its relationship to other categories, which visual data are…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Xiaolong Wang , Yufei Ye , Abhinav Gupta

Zero-shot learning (ZSL) aims to recognize the novel classes which cannot be collected for training a prediction model. Accordingly, generative models (e.g., generative adversarial network (GAN)) are typically used to synthesize the visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Shiming Chen , Shihuang Chen , Wenjin Hou , Weiping Ding , Xinge You

Visual speech recognition (VSR) aims to recognize the content of speech based on lip movements, without relying on the audio stream. Advances in deep learning and the availability of large audio-visual datasets have led to the development…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Pingchuan Ma , Stavros Petridis , Maja Pantic

In the problem of generalized zero-shot learning, the datapoints from unknown classes are not available during training. The main challenge for generalized zero-shot learning is the unbalanced data distribution which makes it hard for the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-09 Hongguang Zhang , Piotr Koniusz

Zero-shot learning is a new paradigm to classify objects from classes that are not available at training time. Zero-shot learning (ZSL) methods have attracted considerable attention in recent years because of their ability to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

We introduce a simple yet effective episode-based training framework for zero-shot learning (ZSL), where the learning system requires to recognize unseen classes given only the corresponding class semantics. During training, the model is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yunlong Yu , Zhong Ji , Zhongfei Zhang , Jungong Han

Generalised zero-shot learning (GZSL) is a classification problem where the learning stage relies on a set of seen visual classes and the inference stage aims to identify both the seen visual classes and a new set of unseen visual classes.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

Vision-language models (VLMs) are impactful in part because they can be applied to a variety of visual understanding tasks in a zero-shot fashion, without any fine-tuning. We study $\textit{generative VLMs}$ that are trained for next-word…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zhiqiu Lin , Xinyue Chen , Deepak Pathak , Pengchuan Zhang , Deva Ramanan

We present a deep generative model for learning to predict classes not seen at training time. Unlike most existing methods for this problem, that represent each class as a point (via a semantic embedding), we represent each seen/unseen…

Machine Learning · Computer Science 2017-11-21 Wenlin Wang , Yunchen Pu , Vinay Kumar Verma , Kai Fan , Yizhe Zhang , Changyou Chen , Piyush Rai , Lawrence Carin

Zero-Shot Learning (ZSL) aims to recognize unseen classes by generalizing the knowledge, i.e., visual and semantic relationships, obtained from seen classes, where image augmentation techniques are commonly applied to improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Zhi Chen , Pengfei Zhang , Jingjing Li , Sen Wang , Zi Huang

Suffering from the extreme training data imbalance between seen and unseen classes, most of existing state-of-the-art approaches fail to achieve satisfactory results for the challenging generalized zero-shot learning task. To circumvent the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yongqin Xian , Tobias Lorenz , Bernt Schiele , Zeynep Akata

Existing methods using generative adversarial approaches for Zero-Shot Learning (ZSL) aim to generate realistic visual features from class semantics by a single generative network, which is highly under-constrained. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhi Chen , Jingjing Li , Yadan Luo , Zi Huang , Yang Yang

Zero-shot recognition (ZSR) deals with the problem of predicting class labels for target domain instances based on source domain side information (e.g. attributes) of unseen classes. We formulate ZSR as a binary prediction problem. Our…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Ziming Zhang , Venkatesh Saligrama

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

Zero-shot detection (ZSD) is a challenging task where we aim to recognize and localize objects simultaneously, even when our model has not been trained with visual samples of a few target ("unseen") classes. Recently, methods employing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Sandipan Sarma , Sushil Kumar , Arijit Sur