English
Related papers

Related papers: Probabilistic Zero-shot Classification with Semant…

200 papers

We present a new embedding-based framework for zero-shot learning (ZSL). Most embedding-based methods aim to learn the correspondence between an image classifier (visual representation) and its class prototype (semantic representation) for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Mei-Chen Yeh , Fang Li

Using a taxonomy to organize information requires classifying objects (documents, images, etc) with appropriate taxonomic classes. The flexible nature of zero-shot learning is appealing for this task because it allows classifiers to…

Computation and Language · Computer Science 2022-09-27 Thom Lake

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Extreme classification (XC) involves predicting over large numbers of classes (thousands to millions), with real-world applications like news article classification and e-commerce product tagging. The zero-shot version of this task requires…

Computation and Language · Computer Science 2023-06-23 Pranjal Aggarwal , Ameet Deshpande , Karthik Narasimhan

We address zero-shot (ZS) learning, building upon prior work in hierarchical classification by combining it with approaches based on semantic attribute estimation. For both non-novel and novel image classes we compare multiple formulations…

Computer Vision and Pattern Recognition · Computer Science 2017-12-11 Jared Markowitz , Aurora C. Schmidt , Philippe M. Burlina , I-Jeng Wang

We study universal zero-shot segmentation in this work to achieve panoptic, instance, and semantic segmentation for novel categories without any training samples. Such zero-shot segmentation ability relies on inter-class relationships in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shuting He , Henghui Ding , Wei Jiang

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Kai Li , Martin Renqiang Min , Yun Fu

The role of semantics in zero-shot learning is considered. The effectiveness of previous approaches is analyzed according to the form of supervision provided. While some learn semantics independently, others only supervise the semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Pedro Morgado , Nuno Vasconcelos

Semantic parsers map natural language utterances into meaning representations (e.g., programs). Such models are typically bottlenecked by the paucity of training data due to the required laborious annotation efforts. Recent studies have…

Computation and Language · Computer Science 2021-10-19 Pengcheng Yin , John Wieting , Avirup Sil , Graham Neubig

Recent work has demonstrated that pre-trained language models (PLMs) are zero-shot learners. However, most existing zero-shot methods involve heavy human engineering or complicated self-training pipelines, hindering their application to new…

Computation and Language · Computer Science 2022-11-24 Yu Fei , Ping Nie , Zhao Meng , Roger Wattenhofer , Mrinmaya Sachan

Contrastively trained text-image models have the remarkable ability to perform zero-shot classification, that is, classifying previously unseen images into categories that the model has never been explicitly trained to identify. However,…

Generalised zero-shot learning (GZSL) methods aim to classify previously seen and unseen visual classes by leveraging the semantic information of those classes. In the context of GZSL, semantic information is non-visual data such as a text…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Rafael Felix , Ben Harwood , Michele Sasdelli , Gustavo Carneiro

Despite progress in automated fact-checking, most systems require a significant amount of labeled training data, which is expensive. In this paper, we propose a novel zero-shot method, which instead of operating directly on the claim and…

Computation and Language · Computer Science 2023-12-20 Zhangdie Yuan , Andreas Vlachos

Prompt-based classifiers are an attractive approach for zero-shot classification. However, the precise choice of the prompt template and label words can largely influence performance, with semantically equivalent settings often showing…

Computation and Language · Computer Science 2023-09-12 Adian Liusie , Potsawee Manakul , Mark J. F. Gales

Zero-shot learning strives to classify unseen categories for which no data is available during training. In the generalized variant, the test samples can further belong to seen or unseen categories. The state-of-the-art relies on Generative…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Sanath Narayan , Akshita Gupta , Fahad Shahbaz Khan , Cees G. M. Snoek , Ling Shao

Masked language models like BERT can perform text classification in a zero-shot fashion by reformulating downstream tasks as text infilling. However, this approach is highly sensitive to the template used to prompt the model, yet…

Computation and Language · Computer Science 2022-10-27 Mozes van de Kar , Mengzhou Xia , Danqi Chen , Mikel Artetxe

Semantic Image Interpretation is the task of extracting a structured semantic description from images. This requires the detection of visual relationships: triples (subject,relation,object) describing a semantic relation between a subject…

Machine Learning · Computer Science 2019-10-02 Ivan Donadello , Luciano Serafini

Recent advancements in NLP have resulted in models with specialized strengths, such as processing multimodal inputs or excelling in specific domains. However, real-world tasks, like multimodal translation, often require a combination of…

Computation and Language · Computer Science 2024-11-05 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

Semantic matching is a mainstream paradigm of zero-shot relation extraction, which matches a given input with a corresponding label description. The entities in the input should exactly match their hypernyms in the description, while the…

Computation and Language · Computer Science 2023-06-09 Jun Zhao , Wenyu Zhan , Xin Zhao , Qi Zhang , Tao Gui , Zhongyu Wei , Junzhe Wang , Minlong Peng , Mingming Sun

This paper addresses the task of learning an image clas-sifier when some categories are defined by semantic descriptions only (e.g. visual attributes) while the others are defined by exemplar images as well. This task is often referred to…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Maxime Bucher , Stéphane Herbin , Frédéric Jurie