English
Related papers

Related papers: Zero-Shot Task Transfer

200 papers

Large models support great zero-shot and few-shot capabilities. However, updating these models on new tasks can break performance on previous seen tasks and their zero/few-shot unseen tasks. Our work explores how to update zero/few-shot…

Machine Learning · Computer Science 2023-01-30 Siddhartha Datta , Nigel Shadbolt

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

Computation and Language · Computer Science 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

Neural networks have been successfully applied in applications with a large amount of labeled data. However, the task of rapid generalization on new concepts with small training data while preserving performances on previously learned ones…

Machine Learning · Computer Science 2017-06-09 Tsendsuren Munkhdalai , Hong Yu

Zero-shot learning (ZSL) refers to the problem of learning to classify instances from the novel classes (unseen) that are absent in the training set (seen). Most ZSL methods infer the correlation between visual features and attributes to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Zhe Liu , Yun Li , Lina Yao , Xianzhi Wang , Guodong Long

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to…

Machine Learning · Computer Science 2021-07-26 Pinzhuo Tian , Yao Gao

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

Machine Learning · Computer Science 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Deep neural networks (DNNs) have achieved state-of-the-art results on time series classification (TSC) tasks. In this work, we focus on leveraging DNNs in the often-encountered practical scenario where access to labeled training data is…

Machine Learning · Computer Science 2021-03-05 Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff , Vishnu Tv

We introduce meta-learning algorithms that perform zero-shot weight-space adaptation of neural network models to unseen tasks. Our methods repurpose the popular generative image synthesis techniques of natural language guidance and…

Machine Learning · Computer Science 2023-02-01 Elvis Nava , Seijin Kobayashi , Yifei Yin , Robert K. Katzschmann , Benjamin F. Grewe

Zero-shot learning (ZSL) can be defined by correctly solving a task where no training data is available, based on previous acquired knowledge from different, but related tasks. So far, this area has mostly drawn the attention from computer…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Joao Reis , Gil Gonçalves

Knowledge graphs (KGs) are ubiquitous and widely used in various applications. However, most real-world knowledge graphs are incomplete, which significantly degrades their performance on downstream tasks. Additionally, the relationships in…

Artificial Intelligence · Computer Science 2025-04-08 Lihui Liu , Zihao Wang , Dawei Zhou , Ruijie Wang , Yuchen Yan , Bo Xiong , Sihong He , Kai Shu , Hanghang Tong

An important aspect of intelligence is the ability to adapt to a novel task without any direct experience (zero-shot), based on its relationship to previous tasks. Humans can exhibit this cognitive flexibility. By contrast, models that…

Machine Learning · Computer Science 2021-03-17 Andrew K. Lampinen , James L. McClelland

How can deep learning systems flexibly reuse their knowledge? Toward this goal, we propose a new class of challenges, and a class of architectures that can solve them. The challenges are meta-mappings, which involve systematically…

Machine Learning · Computer Science 2019-11-14 Andrew K. Lampinen , James L. McClelland

This work introduces a model that can recognize objects in images even if no training data is available for the objects. The only necessary knowledge about the unseen categories comes from unsupervised large text corpora. In our zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2013-03-21 Richard Socher , Milind Ganjoo , Hamsa Sridhar , Osbert Bastani , Christopher D. Manning , Andrew Y. Ng

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

Machine Learning · Computer Science 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike…

Machine Learning · Computer Science 2020-10-27 Huimin Peng

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

We address the challenge of building task-agnostic classifiers using only text descriptions, demonstrating a unified approach to image classification, 3D point cloud classification, and action recognition from scenes. Unlike approaches that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Ohad Amosy , Tomer Volk , Eilam Shapira , Eyal Ben-David , Roi Reichart , Gal Chechik

Transductive inference is an effective means of tackling the data deficiency problem in few-shot learning settings. A popular transductive inference technique for few-shot metric-based approaches, is to update the prototype of each class…

Machine Learning · Computer Science 2020-06-25 Seong Min Kye , Hae Beom Lee , Hoirin Kim , Sung Ju Hwang