English
Related papers

Related papers: Learning Visually Consistent Label Embeddings for …

200 papers

Word embeddings are effective intermediate representations for capturing semantic regularities between words, when learning the representations of text sequences. We propose to view text classification as a label-word joint embedding…

Computation and Language · Computer Science 2018-05-14 Guoyin Wang , Chunyuan Li , Wenlin Wang , Yizhe Zhang , Dinghan Shen , Xinyuan Zhang , Ricardo Henao , Lawrence Carin

Zero-shot learning (ZSL) recognizes the unseen classes by conducting visual-semantic interactions to transfer semantic knowledge from seen classes to unseen ones, supported by semantic information (e.g., attributes). However, existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shiming Chen , Wenjin Hou , Salman Khan , Fahad Shahbaz Khan

Most existing zero-shot learning approaches exploit transfer learning via an intermediate-level semantic representation shared between an annotated auxiliary dataset and a target dataset with different classes and no annotation. A…

Computer Vision and Pattern Recognition · Computer Science 2015-03-04 Yanwei Fu , Timothy M. Hospedales , Tao Xiang , Shaogang Gong

We propose an approach to semantic segmentation that achieves state-of-the-art supervised performance when applied in a zero-shot setting. It thus achieves results equivalent to those of the supervised methods, on each of the major semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Wei Yin , Yifan Liu , Chunhua Shen , Baichuan Sun , Anton van den Hengel

Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions using knowledge learned from seen attribute-object compositions in the training set. Previous works mainly project an image and a composition into a common…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tian Zhang , Kongming Liang , Ruoyi Du , Xian Sun , Zhanyu Ma , Jun Guo

It is expensive and difficult to obtain the large number of sentence-level intent and token-level slot label annotations required to train neural network (NN)-based Natural Language Understanding (NLU) components of task-oriented dialog…

Computation and Language · Computer Science 2022-12-16 Rashmi Gangadharaiah , Balakrishnan Narayanaswamy

Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yuanqi Chen , Xiaoming Yu , Shan Liu , Ge Li

Text classification of unseen classes is a challenging Natural Language Processing task and is mainly attempted using two different types of approaches. Similarity-based approaches attempt to classify instances based on similarities between…

Computation and Language · Computer Science 2023-07-25 Tim Schopf , Daniel Braun , Florian Matthes

Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose a simple way to…

Computation and Language · Computer Science 2023-10-24 Lingyu Gao , Debanjan Ghosh , Kevin Gimpel

Many approaches in generalized zero-shot learning rely on cross-modal mapping between the image feature space and the class embedding space. As labeled images are expensive, one direction is to augment the dataset by generating either…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Edgar Schönfeld , Sayna Ebrahimi , Samarth Sinha , Trevor Darrell , Zeynep Akata

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Zero-Shot Learning (ZSL) promises to scale visual recognition by bypassing the conventional model training requirement of annotated examples for every category. This is achieved by establishing a mapping connecting low-level features and a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xun Xu , Timothy M. Hospedales , Shaogang Gong

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

Fully supervised semantic segmentation technologies bring a paradigm shift in scene understanding. However, the burden of expensive labeling cost remains as a challenge. To solve the cost problem, recent studies proposed language model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Sungguk Cha , Yooseung Wang

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to unseen ones so that the latter can be recognised without any training samples. This is made possible by learning a projection function between a feature space and a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Aoxue Li , Zhiwu Lu , Jiechao Guan , Tao Xiang , Liwei Wang , Ji-Rong Wen

Zero-shot learning (ZSL) aims to identify unseen classes with zero samples during training. Broadly speaking, present ZSL methods usually adopt class-level semantic labels and compare them with instance-level semantic predictions to infer…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zihan Ye , Guanyu Yang , Xiaobo Jin , Youfa Liu , Kaizhu Huang

Large multimodal models such as Stable Diffusion can generate, detect, and classify new visual concepts after fine-tuning just a single word embedding. Do models learn similar words for the same concepts (i.e. <orange-cat> = orange + cat)?…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Brandon Trabucco , Max Gurinas , Kyle Doherty , Ruslan Salakhutdinov

We propose a new zero-shot Event Detection method by Multi-modal Distributional Semantic embedding of videos. Our model embeds object and action concepts as well as other available modalities from videos into a distributional semantic…

Computer Vision and Pattern Recognition · Computer Science 2015-12-17 Mohamed Elhoseiny , Jingen Liu , Hui Cheng , Harpreet Sawhney , Ahmed Elgammal

Zero-shot object detection aims to localize and recognize objects of unseen classes. Most of existing works face two problems: the low recall of RPN in unseen classes and the confusion of unseen classes with background. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Lu Zhang , Chenbo Zhang , Jiajia Zhao , Jihong Guan , Shuigeng Zhou

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang