English
Related papers

Related papers: Few-Shot Task Learning through Inverse Generative …

200 papers

Goals for reinforcement learning problems are typically defined through hand-specified rewards. To design such problems, developers of learning algorithms must inherently be aware of what the task goals are, yet we often require agents to…

Machine Learning · Computer Science 2018-03-29 Ashley D. Edwards , Laura Downs , James C. Davidson

Existing approaches to lifelong language learning rely on plenty of labeled data for learning a new task, which is hard to obtain in most real scenarios. Considering that humans can continually learn new tasks from a handful of examples, we…

Computation and Language · Computer Science 2022-04-01 Chengwei Qin , Shafiq Joty

Image Generation models are a trending topic nowadays, with many people utilizing Artificial Intelligence models in order to generate images. There are many such models which, given a prompt of a text, will generate an image which depicts…

Machine Learning · Computer Science 2025-05-20 Udaya Shreyas , L. N. Aadarsh

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide

After learning a concept, humans are also able to continually generalize their learned concepts to new domains by observing only a few labeled instances without any interference with the past learned knowledge. In contrast, learning…

Machine Learning · Computer Science 2019-09-10 Mohammad Rostami , Soheil Kolouri , James McClelland , Praveen Pilly

Few-shot learning aims to learn novel categories from very few samples given some base categories with sufficient training samples. The main challenge of this task is the novel categories are prone to dominated by color, texture, shape of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Riquan Chen , Tianshui Chen , Xiaolu Hui , Hefeng Wu , Guanbin Li , Liang Lin

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

For many applications, robots will need to be incrementally trained to recognize the specific objects needed for an application. This paper presents a practical system for incrementally training a robot to recognize different object…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Ali Ayub , Alan R. Wagner

Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Lei Zhang , Fei Zhou , Wei Wei , Yanning Zhang

When trained at sufficient scale, auto-regressive language models exhibit the notable ability to learn a new language task after being prompted with just a few examples. Here, we present a simple, yet effective, approach for transferring…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Maria Tsimpoukelli , Jacob Menick , Serkan Cabi , S. M. Ali Eslami , Oriol Vinyals , Felix Hill

While humans and animals learn incrementally during their lifetimes and exploit their experience to solve new tasks, standard deep reinforcement learning methods specialize to solve only one task at a time. As a result, the information they…

Artificial Intelligence · Computer Science 2022-02-23 Diego Gomez , Nicanor Quijano , Luis Felipe Giraldo

We propose a Paired Few-shot GAN (PFS-GAN) model for learning generators with sufficient source data and a few target data. While generative model learning typically needs large-scale training data, our PFS-GAN not only uses the concept of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Chun-Chih Teng , Pin-Yu Chen , Wei-Chen Chiu

Multi-task learning (MTL) is frequently used in settings where a target task has to be learnt based on limited training data, but knowledge can be leveraged from related auxiliary tasks. While MTL can improve task performance overall…

Machine Learning · Computer Science 2020-12-18 Rafael Peres da Silva , Chayaporn Suphavilai , Niranjan Nagarajan

We propose a method of moments (MoM) algorithm for training large-scale implicit generative models. Moment estimation in this setting encounters two problems: it is often difficult to define the millions of moments needed to learn the model…

Machine Learning · Computer Science 2018-06-29 Suman Ravuri , Shakir Mohamed , Mihaela Rosca , Oriol Vinyals

Large language models (LLMs) based on the generative pre-training transformer (GPT) have demonstrated remarkable effectiveness across a diverse range of downstream tasks. Inspired by the advancements of the GPT, we present PointGPT, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Guangyan Chen , Meiling Wang , Yi Yang , Kai Yu , Li Yuan , Yufeng Yue

Constructing new and more challenging tasksets is a fruitful methodology to analyse and understand few-shot classification methods. Unfortunately, existing approaches to building those tasksets are somewhat unsatisfactory: they either…

Machine Learning · Computer Science 2021-04-16 Sébastien M. R. Arnold , Fei Sha

In this work we present a method for leveraging data from one source to learn how to do multiple new tasks. Task transfer is achieved using a self-model that encapsulates the dynamics of a system and serves as an environment for…

Robotics · Computer Science 2019-10-07 Robert Kwiatkowski , Hod Lipson

Deep generative models have been successfully applied to Zero-Shot Learning (ZSL) recently. However, the underlying drawbacks of GANs and VAEs (e.g., the hardness of training with ZSL-oriented regularizers and the limited generation…

Machine Learning · Computer Science 2020-07-10 Yuming Shen , Jie Qin , Lei Huang

Vision-Language Models (VLMs) perform well on multimodal benchmarks but lag behind humans and specialized models on visual perception tasks like depth estimation or object counting. Finetuning on one task can unpredictably affect…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bhuvan Sachdeva , Karan Uppal , Abhinav Java , Vineeth N. Balasubramanian

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

Machine Learning · Computer Science 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon