English
Related papers

Related papers: BOIL: Towards Representation Change for Few-shot L…

200 papers

Model-Agnostic Meta-Learning (MAML), a popular gradient-based meta-learning framework, assumes that the contribution of each task or instance to the meta-learner is equal. Hence, it fails to address the domain shift between base and novel…

Machine Learning · Computer Science 2021-12-02 Krishnateja Killamsetty , Changbin Li , Chen Zhao , Rishabh Iyer , Feng Chen

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

Machine Learning · Computer Science 2022-06-14 Kostiantyn Khabarlak

Gradient-based meta-learners such as MAML are able to learn a meta-prior from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. One important limitation of such frameworks is that they seek a common…

Machine Learning · Computer Science 2018-12-19 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

Machine Learning · Computer Science 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

We propose a new meta learning based framework for low resource speech recognition that improves the previous model agnostic meta learning (MAML) approach. The MAML is a simple yet powerful meta learning approach. However, the MAML presents…

Computation and Language · Computer Science 2022-05-13 Satwinder Singh , Ruili Wang , Feng Hou

Widely used traditional supervised deep learning methods require a large number of training samples but often fail to generalize on unseen datasets. Therefore, a more general application of any trained model is quite limited for medical…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Rabindra Khadga , Debesh Jha , Steven Hicks , Vajira Thambawita , Michael A. Riegler , Sharib Ali , Pål Halvorsen

Robust Model-Agnostic Meta-Learning (MAML) is usually adopted to train a meta-model which may fast adapt to novel classes with only a few exemplars and meanwhile remain robust to adversarial attacks. The conventional solution for robust…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Xiaoyue Duan , Guoliang Kang , Runqi Wang , Shumin Han , Song Xue , Tian Wang , Baochang Zhang

The representations of the Earth's surface vary from one geographic region to another. For instance, the appearance of urban areas differs between continents, and seasonality influences the appearance of vegetation. To capture the diversity…

Machine Learning · Computer Science 2020-04-29 Marc Rußwurm , Sherrie Wang , Marco Körner , David Lobell

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

Machine Learning · Computer Science 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Meta-learning algorithms enable rapid adaptation to new tasks with minimal data, a critical capability for real-world robotic systems. This paper evaluates Model-Agnostic Meta-Learning (MAML) combined with Trust Region Policy Optimization…

Robotics · Computer Science 2025-11-18 Sanjar Atamuradov

The goal of few-shot learning is to generalize and achieve high performance on new unseen learning tasks, where each task has only a limited number of examples available. Gradient-based meta-learning attempts to address this challenging…

Machine Learning · Computer Science 2024-06-13 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

Recently, images that distort or fabricate facts using generative models have become a social concern. To cope with continuous evolution of generative artificial intelligence (AI) models, model attribution (MA) is necessary beyond just…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hanbyul Lee , Juneho Yi

Although model-agnostic meta-learning (MAML) is a very successful algorithm in meta-learning practice, it can have high computational cost because it updates all model parameters over both the inner loop of task-specific adaptation and the…

Machine Learning · Computer Science 2020-10-26 Kaiyi Ji , Jason D. Lee , Yingbin Liang , H. Vincent Poor

We consider the problem of few-shot spoken word classification in a setting where a model is incrementally introduced to new word classes. This would occur in a user-defined keyword system where new words can be added as the system is used.…

Computation and Language · Computer Science 2023-05-31 Ruan van der Merwe , Herman Kamper

Deep learning based computer vision fails to work when labeled images are scarce. Recently, Meta learning algorithm has been confirmed as a promising way to improve the ability of learning from few images for computer vision. However,…

Machine Learning · Computer Science 2018-11-27 Yunxiao Qin , Chenxu Zhao , Zezheng Wang , Junliang Xing , Jun Wan , Zhen Lei

Learning general representations of text is a fundamental problem for many natural language understanding (NLU) tasks. Previously, researchers have proposed to use language model pre-training and multi-task learning to learn robust…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Keyi Yu , Antonios Anastasopoulos

Deep neural networks have been shown as a class of useful tools for addressing signal recognition issues in recent years, especially for identifying the nonlinear feature structures of signals. However, this power of most deep learning…

Machine Learning · Computer Science 2021-06-15 Yihong Dong , Ying Peng , Muqiao Yang , Songtao Lu , Qingjiang Shi

There is a growing interest in the learning-to-learn paradigm, also known as meta-learning, where models infer on new tasks using a few training examples. Recently, meta-learning based methods have been widely used in few-shot…

Machine Learning · Computer Science 2024-03-13 Anish Madan , Ranjitha Prasad

Model-Agnostic Meta-Learning (MAML) and its variants have achieved success in meta-learning tasks on many datasets and settings. On the other hand, we have just started to understand and analyze how they are able to adapt fast to new tasks.…

Machine Learning · Computer Science 2021-01-26 Sébastien M. R. Arnold , Shariq Iqbal , Fei Sha

Model-Agnostic Meta-Learning (MAML), a model-agnostic meta-learning method, is successfully employed in NLP applications including few-shot text classification and multi-domain low-resource language generation. Many impacting factors,…

Computation and Language · Computer Science 2024-04-25 Zequn Liu , Ruiyi Zhang , Yiping Song , Wei Ju , Ming Zhang