English
Related papers

Related papers: Improving Meta-Learning Generalization with Activa…

200 papers

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

Machine Learning · Computer Science 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

Machine Learning · Computer Science 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

Machine Learning · Computer Science 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang

Early stopping methods in deep learning face the challenge of balancing the volume of training and validation data, especially in the presence of label noise. Concretely, sparing more data for validation from training data would limit the…

Machine Learning · Computer Science 2025-02-12 Suqin Yuan , Lei Feng , Tongliang Liu

Unsupervised pre-training can equip reinforcement learning agents with prior knowledge and accelerate learning in downstream tasks. A promising direction, grounded in human development, investigates agents that learn by setting and pursuing…

Machine Learning · Computer Science 2026-01-28 Octavio Pappalardo

Early stopping of iterative algorithms is a widely-used form of regularization in statistics, commonly used in conjunction with boosting and related gradient-type algorithms. Although consistency results have been established in some…

Machine Learning · Statistics 2018-03-15 Yuting Wei , Fanny Yang , Martin J. Wainwright

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth

Few-shot learning with sequence-processing neural networks (NNs) has recently attracted a new wave of attention in the context of large language models. In the standard N-way K-shot learning setting, an NN is explicitly optimised to learn…

Machine Learning · Computer Science 2023-05-03 Kazuki Irie , Jürgen Schmidhuber

In real-world applications, data do not reflect the ones commonly used for neural networks training, since they are usually few, unlabeled and can be available as a stream. Hence many existing deep learning solutions suffer from a limited…

Machine Learning · Computer Science 2020-11-18 Alessia Bertugli , Stefano Vincenzi , Simone Calderara , Andrea Passerini

We extend first-order model agnostic meta-learning algorithms (including FOMAML and Reptile) to image segmentation, present a novel neural network architecture built for fast learning which we call EfficientLab, and leverage a formal…

Machine Learning · Computer Science 2020-05-11 Sean M. Hendryx , Andrew B. Leach , Paul D. Hein , Clayton T. Morrison

Most meta-learning methods assume that the (very small) context set used to establish a new task at test time is passively provided. In some settings, however, it is feasible to actively select which points to label; the potential gain from…

Machine Learning · Computer Science 2024-07-26 Wonho Bae , Jing Wang , Danica J. Sutherland

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen

Most existing works in few-shot learning rely on meta-learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross-domain few-shot learning where there is a large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Richard J. Radke

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

We study few-shot acoustic event detection (AED) in this paper. Few-shot learning enables detection of new events with very limited labeled data. Compared to other research areas like computer vision, few-shot learning for audio recognition…

Machine Learning · Computer Science 2020-02-24 Bowen Shi , Ming Sun , Krishna C. Puvvada , Chieh-Chi Kao , Spyros Matsoukas , Chao Wang

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

Meta-learning aims at learning quickly on novel tasks with limited data by transferring generic experience learned from previous tasks. Naturally, few-shot learning has been one of the most popular applications for meta-learning. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Yudong Chen , Chaoyu Guan , Zhikun Wei , Xin Wang , Wenwu Zhu

The paradigm of machine intelligence moves from purely supervised learning to a more practical scenario when many loosely related unlabeled data are available and labeled data is scarce. Most existing algorithms assume that the underlying…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhenyi Wang , Li Shen , Le Fang , Qiuling Suo , Donglin Zhan , Tiehang Duan , Mingchen Gao

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero