中文
相关论文

相关论文: Perturbing the Gradient for Alleviating Meta Overf…

200 篇论文

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

机器学习 · 计算机科学 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun

Polythetic classifications, based on shared patterns of features that need neither be universal nor constant among members of a class, are common in the natural world and greatly outnumber monothetic classifications over a set of features.…

机器学习 · 计算机科学 2022-06-28 Ben Day , Ramon Viñas , Nikola Simidjievski , Pietro Liò

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

机器学习 · 计算机科学 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

Current machine learning has made great progress on computer vision and many other fields attributed to the large amount of high-quality training samples, while it does not work very well on genomic data analysis, since they are notoriously…

机器学习 · 计算机科学 2020-09-04 Ziyi Yang , Jun Shu , Yong Liang , Deyu Meng , Zongben Xu

Few-shot natural language processing (NLP) refers to NLP tasks that are accompanied with merely a handful of labeled examples. This is a real-world challenge that an AI system must learn to handle. Usually we rely on collecting more…

计算与语言 · 计算机科学 2020-07-21 Wenpeng Yin

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quantifying model…

计算机视觉与模式识别 · 计算机科学 2022-03-25 Deep Pandey , Qi Yu

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

机器学习 · 计算机科学 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

Meta-learning provides a promising way for learning to efficiently learn and achieves great success in many applications. However, most meta-learning literature focuses on dealing with tasks from a same domain, making it brittle to…

机器学习 · 计算机科学 2021-07-26 Pinzhuo Tian , Yao Gao

Machine learning models that are overfitted/overtrained are more vulnerable to knowledge leakage, which poses a risk to privacy. Suppose we download or receive a model from a third-party collaborator without knowing its training accuracy.…

机器学习 · 计算机科学 2023-06-01 Hossein Rezaei , Mohammad Sabokrou

Few-shot learning aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning.…

计算机视觉与模式识别 · 计算机科学 2021-08-21 Baoquan Zhang , Xutao Li , Yunming Ye , Shanshan Feng

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

计算机视觉与模式识别 · 计算机科学 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

In this paper, we consider the framework of multi-task representation (MTR) learning where the goal is to use source tasks to learn a representation that reduces the sample complexity of solving a target task. We start by reviewing recent…

机器学习 · 计算机科学 2023-10-27 Quentin Bouniot , Ievgen Redko , Romaric Audigier , Angélique Loesch , Amaury Habrard

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

机器学习 · 计算机科学 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

An agent with an inaccurate model of its environment faces a difficult choice: it can ignore the errors in its model and act in the real world in whatever way it determines is optimal with respect to its model. Alternatively, it can take a…

Biased regularization and fine-tuning are two recent meta-learning approaches. They have been shown to be effective to tackle distributions of tasks, in which the tasks' target vectors are all close to a common meta-parameter vector.…

机器学习 · 计算机科学 2020-08-26 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto

Predicting a landslide susceptibility map (LSM) is essential for risk recognition and disaster prevention. Despite the successful application of data-driven approaches for LSM prediction, most methods generally apply a single global model…

机器学习 · 计算机科学 2023-08-24 Li Chen , Yulin Ding , Saeid Pirasteh , Han Hu , Qing Zhu , Haowei Zeng , Haojia Yu , Qisen Shang , Yongfei Song

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Yiren Jian , Lorenzo Torresani

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

机器学习 · 计算机科学 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Empirical studies suggest that machine learning models often rely on features, such as the background, that may be spuriously correlated with the label only during training time, resulting in poor accuracy during test-time. In this work, we…

机器学习 · 计算机科学 2024-09-10 Vaishnavh Nagarajan , Anders Andreassen , Behnam Neyshabur