中文
相关论文

相关论文: Invariant Meta Learning for Out-of-Distribution Ge…

200 篇论文

Nowadays, Deep Learning (DL) methods often overcome the limitations of traditional signal processing approaches. Nevertheless, DL methods are barely applied in real-life applications. This is mainly due to limited robustness and…

机器学习 · 计算机科学 2022-10-27 Julius Ott , Lorenzo Servadei , Gianfranco Mauro , Thomas Stadelmayer , Avik Santra , Robert Wille

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

机器学习 · 计算机科学 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

Neural networks have been successfully applied in applications with a large amount of labeled data. However, the task of rapid generalization on new concepts with small training data while preserving performances on previously learned ones…

机器学习 · 计算机科学 2017-06-09 Tsendsuren Munkhdalai , Hong Yu

In real world scenarios, out-of-distribution (OOD) datasets may have a large distributional shift from training datasets. This phenomena generally occurs when a trained classifier is deployed on varying dynamic environments, which causes a…

图像与视频处理 · 电气工程与系统科学 2022-09-08 Harshita Boonlia , Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Ankan Mullick

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

机器学习 · 计算机科学 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki

Machine learning methods adapt the parameters of a model, constrained to lie in a given model class, by using a fixed learning procedure based on data or active observations. Adaptation is done on a per-task basis, and retraining is needed…

机器学习 · 计算机科学 2021-10-22 Osvaldo Simeone , Sangwoo Park , Joonhyuk Kang

Meta-learning models have two objectives. First, they need to be able to make predictions over a range of task distributions while utilizing only a small amount of training data. Second, they also need to adapt to new novel unseen tasks at…

机器学习 · 计算机科学 2021-01-26 Edwin Pan , Pankaj Rajak , Shubham Shrivastava

With recent advancements in artificial intelligence, its applications can be seen in every aspect of humans' daily life. From voice assistants to mobile healthcare and autonomous driving, we rely on the performance of AI methods for many…

机器学习 · 计算机科学 2022-09-28 Navid Ghassemi , Ehsan Fazl-Ersi

Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically…

机器学习 · 计算机科学 2020-06-22 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

A central goal of unsupervised learning is to acquire representations from unlabeled data or experience that can be used for more effective learning of downstream tasks from modest amounts of labeled data. Many prior unsupervised learning…

机器学习 · 计算机科学 2019-03-25 Kyle Hsu , Sergey Levine , Chelsea Finn

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

机器学习 · 统计学 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

机器学习 · 计算机科学 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Sina Mohseni , Arash Vahdat , Jay Yadawa

The objective of meta-learning is to exploit the knowledge obtained from observed tasks to improve adaptation to unseen tasks. As such, meta-learners are able to generalize better when they are trained with a larger number of observed tasks…

机器学习 · 计算机科学 2022-10-11 Mert Kayaalp , Stefan Vlaski , Ali H. Sayed

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Although machine learning models typically experience a drop in performance on out-of-distribution data, accuracies on in- versus out-of-distribution data are widely observed to follow a single linear trend when evaluated across a testbed…

机器学习 · 计算机科学 2021-07-01 Anders Andreassen , Yasaman Bahri , Behnam Neyshabur , Rebecca Roelofs

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

机器学习 · 计算机科学 2019-04-22 Yingtian Zou , Jiashi Feng

In learning-to-learn the goal is to infer a learning algorithm that works well on a class of tasks sampled from an unknown meta distribution. In contrast to previous work on batch learning-to-learn, we consider a scenario where tasks are…

机器学习 · 统计学 2018-03-23 Giulia Denevi , Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

Learning with identical train and test distributions has been extensively investigated both practically and theoretically. Much remains to be understood, however, in statistical learning under distribution shifts. This paper focuses on a…

机器学习 · 计算机科学 2024-11-01 Omar Montasser , Han Shao , Emmanuel Abbe

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

机器学习 · 计算机科学 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi