English
Related papers

Related papers: Perturbing the Gradient for Alleviating Meta Overf…

200 papers

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

Machine Learning · Computer Science 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun

Polythetic classifications, based on shared patterns of features that need neither be universal nor constant among members of a class, are common in the natural world and greatly outnumber monothetic classifications over a set of features.…

Machine Learning · Computer Science 2022-06-28 Ben Day , Ramon Viñas , Nikola Simidjievski , Pietro Liò

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

Current machine learning has made great progress on computer vision and many other fields attributed to the large amount of high-quality training samples, while it does not work very well on genomic data analysis, since they are notoriously…

Machine Learning · Computer Science 2020-09-04 Ziyi Yang , Jun Shu , Yong Liang , Deyu Meng , Zongben Xu

Few-shot natural language processing (NLP) refers to NLP tasks that are accompanied with merely a handful of labeled examples. This is a real-world challenge that an AI system must learn to handle. Usually we rely on collecting more…

Computation and Language · Computer Science 2020-07-21 Wenpeng Yin

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quantifying model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Deep Pandey , Qi Yu

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

Machine Learning · Computer Science 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to…

Machine Learning · Computer Science 2021-07-26 Pinzhuo Tian , Yao Gao

Machine learning models that are overfitted/overtrained are more vulnerable to knowledge leakage, which poses a risk to privacy. Suppose we download or receive a model from a third-party collaborator without knowing its training accuracy.…

Machine Learning · Computer Science 2023-06-01 Hossein Rezaei , Mohammad Sabokrou

Few-shot learning aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Baoquan Zhang , Xutao Li , Yunming Ye , Shanshan Feng

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

In this paper, we consider the framework of multi-task representation (MTR) learning where the goal is to use source tasks to learn a representation that reduces the sample complexity of solving a target task. We start by reviewing recent…

Machine Learning · Computer Science 2023-10-27 Quentin Bouniot , Ievgen Redko , Romaric Audigier , Angélique Loesch , Amaury Habrard

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

Machine Learning · Computer Science 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

An agent with an inaccurate model of its environment faces a difficult choice: it can ignore the errors in its model and act in the real world in whatever way it determines is optimal with respect to its model. Alternatively, it can take a…

Biased regularization and fine-tuning are two recent meta-learning approaches. They have been shown to be effective to tackle distributions of tasks, in which the tasks' target vectors are all close to a common meta-parameter vector.…

Machine Learning · Computer Science 2020-08-26 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Predicting a landslide susceptibility map (LSM) is essential for risk recognition and disaster prevention. Despite the successful application of data-driven approaches for LSM prediction, most methods generally apply a single global model…

Machine Learning · Computer Science 2023-08-24 Li Chen , Yulin Ding , Saeid Pirasteh , Han Hu , Qing Zhu , Haowei Zeng , Haojia Yu , Qisen Shang , Yongfei Song

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yiren Jian , Lorenzo Torresani

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Empirical studies suggest that machine learning models often rely on features, such as the background, that may be spuriously correlated with the label only during training time, resulting in poor accuracy during test-time. In this work, we…

Machine Learning · Computer Science 2024-09-10 Vaishnavh Nagarajan , Anders Andreassen , Behnam Neyshabur