中文
相关论文

相关论文: ZEST: Zero-shot Learning from Text Descriptions us…

200 篇论文

Recent text-to-image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matching and subsequent zero-shot tasks, they are not capable of…

计算机视觉与模式识别 · 计算机科学 2022-04-01 Yoad Tewel , Yoav Shalev , Idan Schwartz , Lior Wolf

Zero-shot learning methods rely on fixed visual and semantic embeddings, extracted from independent vision and language models, both pre-trained for other large-scale tasks. This is a weakness of current zero-shot learning frameworks as…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Shah Nawaz , Jacopo Cavazza , Alessio Del Bue

Recent advances in large pretrained language models have increased attention to zero-shot text classification. In particular, models finetuned on natural language inference datasets have been widely adopted as zero-shot classifiers due to…

计算与语言 · 计算机科学 2022-11-01 Ariel Gera , Alon Halfon , Eyal Shnarch , Yotam Perlitz , Liat Ein-Dor , Noam Slonim

We propose a novel approach for unsupervised zero-shot learning (ZSL) of classes based on their names. Most existing unsupervised ZSL methods aim to learn a model for directly comparing image features and class names. However, this proves…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Berkan Demirel , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Large scale vision and language models can achieve impressive zero-shot recognition performance by mapping class specific text queries to image content. Two distinct challenges that remain however, are high sensitivity to the choice of…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Sarah Parisot , Yongxin Yang , Steven McDonagh

Zero-shot learning (ZSL) aims to classify objects that are not observed or seen during training. It relies on class semantic description to transfer knowledge from the seen classes to the unseen classes. Existing methods of obtaining class…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Fahimul Hoque Shubho , Townim Faisal Chowdhury , Ali Cheraghian , Morteza Saberi , Nabeel Mohammed , Shafin Rahman

To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then…

计算机视觉与模式识别 · 计算机科学 2020-01-07 Ziyu Wan , Dongdong Chen , Yan Li , Xingguang Yan , Junge Zhang , Yizhou Yu , Jing Liao

We address the challenge of building task-agnostic classifiers using only text descriptions, demonstrating a unified approach to image classification, 3D point cloud classification, and action recognition from scenes. Unlike approaches that…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Ohad Amosy , Tomer Volk , Eilam Shapira , Eyal Ben-David , Roi Reichart , Gal Chechik

Scaling up visual category recognition to large numbers of classes remains challenging. A promising research direction is zero-shot learning, which does not require any training data to recognize new classes, but rather relies on some form…

计算机视觉与模式识别 · 计算机科学 2016-04-12 Zeynep Akata , Mateusz Malinowski , Mario Fritz , Bernt Schiele

Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose a simple way to…

计算与语言 · 计算机科学 2023-10-24 Lingyu Gao , Debanjan Ghosh , Kevin Gimpel

Zero-shot learning (ZSL) aims at recognizing unseen class examples (e.g., images) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, e.g.,…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Jingcai Guo

Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of zero-shot learning, we model the visual learning process of unseen categories…

计算机视觉与模式识别 · 计算机科学 2019-12-04 Mohamed Elhoseiny , Mohamed Elfeki

Audio-visual generalized zero-shot learning is a rapidly advancing domain that seeks to understand the intricate relations between audio and visual cues within videos. The overarching goal is to leverage insights from seen classes to…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Shentong Mo , Pedro Morgado

Zero-Shot Learning (ZSL) aims to classify a test instance from an unseen category based on the training instances from seen categories, in which the gap between seen categories and unseen categories is generally bridged via visual-semantic…

计算机视觉与模式识别 · 计算机科学 2017-12-14 Li Niu , Jianfei Cai , Ashok Veeraraghavan

Zero-shot learning (ZSL) aims to train a model on seen classes and recognize unseen classes by knowledge transfer through shared auxiliary information. Recent studies reveal that documents from encyclopedias provide helpful auxiliary…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Xiangyan Qu , Jing Yu , Jiamin Zhuang , Gaopeng Gou , Gang Xiong , Qi Wu

Recent advances in zero-shot image recognition suggest that vision-language models learn generic visual representations with a high degree of semantic information that may be arbitrarily probed with natural language phrases. Understanding…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Kanchana Ranasinghe , Brandon McKinzie , Sachin Ravi , Yinfei Yang , Alexander Toshev , Jonathon Shlens

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Zero-shot entity and relation classification models leverage available external information of unseen classes -- e.g., textual descriptions -- to annotate input text data. Thanks to the minimum data requirement, Zero-Shot Learning (ZSL)…

Relation classification aims to extract semantic relations between entity pairs from the sentences. However, most existing methods can only identify seen relation classes that occurred during training. To recognize unseen relations at test…

计算与语言 · 计算机科学 2020-11-02 Juan Li , Ruoxu Wang , Ningyu Zhang , Wen Zhang , Fan Yang , Huajun Chen

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis