English
Related papers

Related papers: Deep Meta-Learning: Learning to Learn in the Conce…

200 papers

We propose a meta-learning algorithm utilizing a linear transformer that carries out null-space projection of neural network outputs. The main idea is to construct an alternative classification space such that the error signals during…

Machine Learning · Computer Science 2018-12-06 Sung Whan Yoon , Jun Seo , Jaekyun Moon

While deep learning has achieved remarkable results on various applications, it is usually data hungry and struggles to learn over non-stationary data stream. To solve these two limits, the deep learning model should not only be able to…

Machine Learning · Computer Science 2019-09-05 Canyu Le , Xihan Wei , Biao Wang , Lei Zhang , Zhonggui Chen

In order for a robot to be a generalist that can perform a wide range of jobs, it must be able to acquire a wide variety of skills quickly and efficiently in complex unstructured environments. High-capacity models such as deep neural…

Machine Learning · Computer Science 2017-09-15 Chelsea Finn , Tianhe Yu , Tianhao Zhang , Pieter Abbeel , Sergey Levine

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to significantly improve…

Machine Learning · Computer Science 2023-11-07 Ruohan Wang , Isak Falk , Massimiliano Pontil , Carlo Ciliberto

Deep neural networks can achieve great successes when presented with large data sets and sufficient computational resources. However, their ability to learn new concepts quickly is limited. Meta-learning is one approach to address this…

Machine Learning · Computer Science 2021-04-22 Mike Huisman , Jan N. van Rijn , Aske Plaat

Meta-learning has received a tremendous recent attention as a possible approach for mimicking human intelligence, i.e., acquiring new knowledge and skills with little or even no demonstration. Most of the existing meta-learning methods are…

Machine Learning · Computer Science 2019-05-24 Fan Zhou , Chengtai Cao , Kunpeng Zhang , Goce Trajcevski , Ting Zhong , Ji Geng

Meta-learning algorithms produce feature extractors which achieve state-of-the-art performance on few-shot classification. While the literature is rich with meta-learning methods, little is known about why the resulting feature extractors…

Machine Learning · Computer Science 2020-07-02 Micah Goldblum , Steven Reich , Liam Fowl , Renkun Ni , Valeriia Cherepanova , Tom Goldstein

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

One-shot fine-grained visual recognition often suffers from the problem of training data scarcity for new fine-grained classes. To alleviate this problem, an off-the-shelf image generator can be applied to synthesize additional training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Satoshi Tsutsui , Yanwei Fu , David Crandall

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

Few-shot semantic segmentation addresses the learning task in which only few images with ground truth pixel-level labels are available for the novel classes of interest. One is typically required to collect a large mount of data (i.e., base…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Yuan-Hao Lee , Fu-En Yang , Yu-Chiang Frank Wang

System identification has greatly benefited from deep learning techniques, particularly for modeling complex, nonlinear dynamical systems with partially unknown physics where traditional approaches may not be feasible. However, deep…

Machine Learning · Computer Science 2025-04-17 Marco Forgione , Ankush Chakrabarty , Dario Piga , Matteo Rufolo , Alberto Bemporad

We propose regression networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each class. In high dimensional embedding…

Machine Learning · Computer Science 2020-06-22 Arnout Devos , Matthias Grossglauser

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

Although few-shot learning research has advanced rapidly with the help of meta-learning, its practical usefulness is still limited because most of them assumed that all meta-training and meta-testing examples came from a single domain. We…

Machine Learning · Computer Science 2020-09-18 Yongseok Choi , Junyoung Park , Subin Yi , Dong-Yeon Cho

Viewpoint estimation for known categories of objects has been improved significantly thanks to deep networks and large datasets, but generalization to unknown categories is still very challenging. With an aim towards improving performance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Hung-Yu Tseng , Shalini De Mello , Jonathan Tremblay , Sifei Liu , Stan Birchfield , Ming-Hsuan Yang , Jan Kautz

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu