中文
相关论文

相关论文: Perturbing the Gradient for Alleviating Meta Overf…

200 篇论文

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose a method for…

机器学习 · 计算机科学 2023-05-18 Wenfang Sun , Yingjun Du , Xiantong Zhen , Fan Wang , Ling Wang , Cees G. M. Snoek

Meta-learning has been the most common framework for few-shot learning in recent years. It learns the model from collections of few-shot classification tasks, which is believed to have a key advantage of making the training objective…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Yinbo Chen , Zhuang Liu , Huijuan Xu , Trevor Darrell , Xiaolong Wang

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

机器学习 · 统计学 2025-03-11 James Schmidt

Overfitting and generalization is an important concept in Machine Learning as only models that generalize are interesting for general applications. Yet some students have trouble learning this important concept through lectures and…

机器学习 · 计算机科学 2022-09-08 Matias Valdenegro-Toro , Matthia Sabatelli

Data scarcity poses a serious threat to modern machine learning and artificial intelligence, as their practical success typically relies on the availability of big datasets. One effective strategy to mitigate the issue of insufficient data…

机器学习 · 计算机科学 2026-05-14 Chaozhi Zhang , Lin Liu , Xiaoqun Zhang

Reinforcement learning methods can achieve significant performance but require a large amount of training data collected on the same robotic platform. A policy trained with expensive data is rendered useless after making even a minor change…

机器人学 · 计算机科学 2021-03-08 Ali Ghadirzadeh , Xi Chen , Petra Poklukar , Chelsea Finn , Mårten Björkman , Danica Kragic

Reinforcement learning and planning methods require an objective or reward function that encodes the desired behavior. Yet, in practice, there is a wide range of scenarios where an objective is difficult to provide programmatically, such as…

机器学习 · 计算机科学 2018-10-02 Annie Xie , Avi Singh , Sergey Levine , Chelsea Finn

Few-shot Learning aims to learn classifiers for new classes with only a few training examples per class. Existing meta-learning or metric-learning based few-shot learning approaches are limited in handling diverse domains with various…

机器学习 · 计算机科学 2019-01-30 Yu Cheng , Mo Yu , Xiaoxiao Guo , Bowen Zhou

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

机器学习 · 计算机科学 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Meta-learning methods have been extensively studied and applied in computer vision, especially for few-shot classification tasks. The key idea of meta-learning for few-shot classification is to mimic the few-shot situations faced at test…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Chenghao Liu , Zhihao Wang , Doyen Sahoo , Yuan Fang , Kun Zhang , Steven C. H. Hoi

Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its…

机器学习 · 计算机科学 2024-03-07 Weihao Jiang , Guodong Liu , Di He , Kun He

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

计算机视觉与模式识别 · 计算机科学 2020-08-25 Jianyi Li , Guizhong Liu

Few-shot learning or meta-learning leverages the data scarcity problem in machine learning. Traditionally, training data requires a multitude of samples and labeling for supervised learning. To address this issue, we propose a one-shot…

机器学习 · 计算机科学 2023-10-23 Atik Faysal , Mohammad Rostami , Huaxia Wang , Avimanyu Sahoo , Ryan Antle

Gradient-based meta-learning techniques aim to distill useful prior knowledge from a set of training tasks such that new tasks can be learned more efficiently with gradient descent. While these methods have achieved successes in various…

机器学习 · 计算机科学 2023-10-16 Mike Huisman , Aske Plaat , Jan N. van Rijn

Meta-Learning has emerged as a research direction to better transfer knowledge from related tasks to unseen but related tasks. However, Meta-Learning requires many training tasks to learn representations that transfer well to unseen tasks;…

计算与语言 · 计算机科学 2022-10-13 Surya Kant Sahu

Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Jordi Armengol-Estapé , Vincent Michalski , Ramnath Kumar , Pierre-Luc St-Charles , Doina Precup , Samira Ebrahimi Kahou

Class imbalance poses a challenge for developing unbiased, accurate predictive models. In particular, in image segmentation neural networks may overfit to the foreground samples from small structures, which are often heavily…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Zeju Li , Konstantinos Kamnitsas , Ben Glocker

Meta-learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low-data regime. One of the most difficult benchmarks of such algorithms is a one-shot learning problem. In this setting many algorithms face…

机器学习 · 计算机科学 2022-10-04 Andrei Boiarov , Kostiantyn Khabarlak , Igor Yastrebov

Recent years have witnessed an abundance of new publications and approaches on meta-learning. This community-wide enthusiasm has sparked great insights but has also created a plethora of seemingly different frameworks, which can be hard to…

机器学习 · 计算机科学 2020-02-04 Wei-Lun Chao , Han-Jia Ye , De-Chuan Zhan , Mark Campbell , Kilian Q. Weinberger

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

机器学习 · 计算机科学 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah