English
Related papers

Related papers: How to train your MAML

200 papers

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

Meta-learning model can quickly adapt to new tasks using few-shot labeled data. However, despite achieving good generalization on few-shot classification tasks, it is still challenging to improve the adversarial robustness of the…

Machine Learning · Computer Science 2021-07-02 Fan Liu , Shuyu Zhao , Xuelong Dai , Bin Xiao

Metric learning aims to build a distance metric typically by learning an effective embedding function that maps similar objects into nearby points in its embedding space. Despite recent advances in deep metric learning, it remains…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Deunsol Jung , Dahyun Kang , Suha Kwak , Minsu Cho

Few-shot learning (FSL) aims to generate a classifier using limited labeled examples. Many existing works take the meta-learning approach, constructing a few-shot learner that can learn from few-shot examples to generate a classifier.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Han-Jia Ye , Lu Ming , De-Chuan Zhan , Wei-Lun Chao

In the realm of recommender systems, the ubiquitous adoption of deep neural networks has emerged as a dominant paradigm for modeling diverse business objectives. As user bases continue to expand, the necessity of personalization and…

Optimization-based meta-learning aims to learn an initialization so that a new unseen task can be learned within a few gradient updates. Model Agnostic Meta-Learning (MAML) is a benchmark algorithm comprising two optimization loops. The…

Machine Learning · Computer Science 2024-05-28 S. Tiwari , M. Gogoi , S. Verma , K. P. Singh

A major problem of machine-learning approaches in structural dynamics is the frequent lack of structural data. Inspired by the recently-emerging field of population-based structural health monitoring (PBSHM), and the use of transfer…

Machine Learning · Computer Science 2023-02-17 G. Tsialiamanis , N. Dervilis , D. J. Wagg , K. Worden

Few-shot classification refers to learning a classifier for new classes given only a few examples. While a plethora of models have emerged to tackle it, we find the procedure and datasets that are used to assess their progress lacking. To…

Meta-learning leverages related source tasks to learn an initialization that can be quickly fine-tuned to a target task with limited labeled examples. However, many popular meta-learning algorithms, such as model-agnostic meta-learning…

Machine Learning · Statistics 2020-03-24 Diana Cai , Rishit Sheth , Lester Mackey , Nicolo Fusi

The representations of the Earth's surface vary from one geographic region to another. For instance, the appearance of urban areas differs between continents, and seasonality influences the appearance of vegetation. To capture the diversity…

Machine Learning · Computer Science 2020-04-29 Marc Rußwurm , Sherrie Wang , Marco Körner , David Lobell

Fine-grained action recognition is attracting increasing attention due to the emerging demand of specific action understanding in real-world applications, whereas the data of rare fine-grained categories is very limited. Therefore, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiahao Wang , Yunhong Wang , Sheng Liu , Annan Li

Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Shaobo Lin , Xingyu Zeng , Rui Zhao

The ability to learn from a small number of examples has been a difficult problem in machine learning since its inception. While methods have succeeded with large amounts of training data, research has been underway in how to accomplish…

Machine Learning · Computer Science 2017-08-24 Nathan Hilliard , Nathan O. Hodas , Courtney D. Corley

Recently, there has been a growing interest in developing machine learning (ML) models that can promote fairness, i.e., eliminating biased predictions towards certain populations (e.g., individuals from a specific demographic group). Most…

Machine Learning · Computer Science 2023-08-29 Song Wang , Jing Ma , Lu Cheng , Jundong Li

Although model-agnostic meta-learning (MAML) is a very successful algorithm in meta-learning practice, it can have high computational cost because it updates all model parameters over both the inner loop of task-specific adaptation and the…

Machine Learning · Computer Science 2020-10-26 Kaiyi Ji , Jason D. Lee , Yingbin Liang , H. Vincent Poor

Meta-learning involves multiple learners, each dedicated to specific tasks, collaborating in a data-constrained setting. In current meta-learning methods, task learners locally learn models from sensitive data, termed support sets. These…

Machine Learning · Computer Science 2024-06-05 Mina Rafiei , Mohammadmahdi Maheri , Hamid R. Rabiee

We introduce MetaICL (Meta-training for In-Context Learning), a new meta-training framework for few-shot learning where a pretrained language model is tuned to do in-context learning on a large set of training tasks. This meta-training…

Computation and Language · Computer Science 2022-05-04 Sewon Min , Mike Lewis , Luke Zettlemoyer , Hannaneh Hajishirzi

Meta-learning aims to solve unseen tasks with few labelled instances. Nevertheless, despite its effectiveness for quick learning in existing optimization-based methods, it has several flaws. Inconsequential connections are frequently seen…

Machine Learning · Computer Science 2023-04-07 Sambhavi Tiwari , Manas Gogoi , Shekhar Verma , Krishna Pratap Singh

Few-shot learning is devoted to training a model on few samples. Most of these approaches learn a model based on a pixel-level or global-level feature representation. However, using global features may lose local information, and using…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jordi Armengol-Estapé , Vincent Michalski , Ramnath Kumar , Pierre-Luc St-Charles , Doina Precup , Samira Ebrahimi Kahou