中文
相关论文

相关论文: Improving zero-shot learning by mitigating the hub…

200 篇论文

Recent advances in large pretrained language models have increased attention to zero-shot text classification. In particular, models finetuned on natural language inference datasets have been widely adopted as zero-shot classifiers due to…

计算与语言 · 计算机科学 2022-11-01 Ariel Gera , Alon Halfon , Eyal Shnarch , Yotam Perlitz , Liat Ein-Dor , Noam Slonim

Can we construct a neural model that is inductively biased towards learning human languages? Motivated by this question, we aim at constructing an informative prior over neural weights, in order to adapt quickly to held-out languages in the…

计算与语言 · 计算机科学 2021-08-10 Edoardo Maria Ponti , Ivan Vulić , Ryan Cotterell , Roi Reichart , Anna Korhonen

Recently, zero-shot learning (ZSL) has received increasing interest. The key idea underpinning existing ZSL approaches is to exploit knowledge transfer via an intermediate-level semantic representation which is assumed to be shared between…

机器学习 · 计算机科学 2015-03-30 Yanwei Fu , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Shaogang Gong

This paper tackles the problem of zero-shot sign language recognition (ZSSLR), where the goal is to leverage models learned over the seen sign classes to recognize the instances of unseen sign classes. In this context, readily available…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Yunus Can Bilge , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Masked language models like BERT can perform text classification in a zero-shot fashion by reformulating downstream tasks as text infilling. However, this approach is highly sensitive to the template used to prompt the model, yet…

计算与语言 · 计算机科学 2022-10-27 Mozes van de Kar , Mengzhou Xia , Danqi Chen , Mikel Artetxe

Zero-shot graph embedding is a major challenge for supervised graph learning. Although a recent method RECT has shown promising performance, its working mechanisms are not clear and still needs lots of training data. In this paper, we give…

机器学习 · 计算机科学 2021-03-24 Zheng Wang , Ruihang Shao , Changping Wang , Changjun Hu , Chaokun Wang , Zhiguo Gong

Zero-shot learning (ZSL) highly depends on a good semantic embedding to connect the seen and unseen classes. Recently, distributed word embeddings (DWE) pre-trained from large text corpus have become a popular choice to draw such a…

计算机视觉与模式识别 · 计算机科学 2017-07-19 Ruizhi Qiao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

A common problem with most zero and few-shot learning approaches is they suffer from bias towards seen classes resulting in sub-optimal performance. Existing efforts aim to utilize unlabeled images from unseen classes (i.e transductive…

计算机视觉与模式识别 · 计算机科学 2021-07-15 Gaurav Bhatt , Shivam Chandhok , Vineeth N Balasubramanian

Recent advances on prompt-tuning cast few-shot classification tasks as a masked language modeling problem. By wrapping input into a template and using a verbalizer which constructs a mapping between label space and label word space,…

计算与语言 · 计算机科学 2022-01-17 Yinyi Wei , Tong Mo , Yongtao Jiang , Weiping Li , Wen Zhao

The number of categories for action recognition is growing rapidly and it has become increasingly hard to label sufficient training data for learning conventional models for all categories. Instead of collecting ever more data and labelling…

计算机视觉与模式识别 · 计算机科学 2016-12-05 Xun Xu , Timothy Hospedales , Shaogang Gong

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

计算与语言 · 计算机科学 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

Vision-language models enable open-world classification of objects without the need for any retraining. While this zero-shot paradigm marks a significant advance, even today's best models exhibit skewed performance when objects are…

计算机视觉与模式识别 · 计算机科学 2024-04-26 Mazda Moayeri , Michael Rabbat , Mark Ibrahim , Diane Bouchacourt

A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is…

人工智能 · 计算机科学 2021-11-16 Nguyen Van Hoang , Soeren Hougaard Mulvad , Dexter Neo Yuan Rong , Yang Yue

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

信息检索 · 计算机科学 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian

Language grounding aims at linking the symbolic representation of language (e.g., words) into the rich perceptual knowledge of the outside world. The general approach is to embed both textual and visual information into a common space -the…

计算与语言 · 计算机科学 2021-09-15 Hassan Shahmohammadi , Hendrik P. A. Lensch , R. Harald Baayen

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

机器学习 · 计算机科学 2024-12-11 Yuli Slavutsky , Yuval Benjamini

Recent advances in zero-shot image recognition suggest that vision-language models learn generic visual representations with a high degree of semantic information that may be arbitrarily probed with natural language phrases. Understanding…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Kanchana Ranasinghe , Brandon McKinzie , Sachin Ravi , Yinfei Yang , Alexander Toshev , Jonathon Shlens

Visual Semantic Embedding (VSE) models, which map images into a rich semantic embedding space, have been a milestone in object recognition and zero-shot learning. Current approaches to VSE heavily rely on static word em-bedding techniques.…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Yue Jiao , Jonathon Hare , Adam Prügel-Bennett

This paper presents a novel approach to Zero-Shot Action Recognition. Recent works have explored the detection and classification of objects to obtain semantic information from videos with remarkable performance. Inspired by them, we…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Valter Estevam , Rayson Laroca , David Menotti , Helio Pedrini

Finetuning pretrained models on downstream generation tasks often leads to catastrophic forgetting in zero-shot conditions. In this work, we focus on summarization and tackle the problem through the lens of language-independent…

计算与语言 · 计算机科学 2024-04-09 Vladimir Solovyev , Danni Liu , Jan Niehues