中文
相关论文

相关论文: Invariant Meta Learning for Out-of-Distribution Ge…

200 篇论文

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

机器学习 · 计算机科学 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

Meta-learning has emerged as an effective methodology to model several real-world tasks and problems due to its extraordinary effectiveness in the low-data regime. There are many scenarios ranging from the classification of rare diseases to…

机器学习 · 计算机科学 2023-12-29 Prabhat Agarwal , Shreya Singh

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to new tasks by transferring the learned meta-knowledge, while assuming that all tasks come from the same distribution (in-distribution, ID). However, in the real world,…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Min Zhang , Zifeng Zhuang , Zhitao Wang , Donglin Wang , Wenbin Li

Equipping a deep model the abaility of few-shot learning, i.e., learning quickly from only few examples, is a core challenge for artificial intelligence. Gradient-based meta-learning approaches effectively address the challenge by learning…

机器学习 · 计算机科学 2024-01-09 Baoquan Zhang , Chuyao Luo , Demin Yu , Huiwei Lin , Xutao Li , Yunming Ye , Bowen Zhang

Deep neural networks are known to achieve superior results in classification tasks. However, it has been recently shown that they are incapable to detect examples that are generated by a distribution which is different than the one they…

机器学习 · 计算机科学 2019-12-09 Aristotelis-Angelos Papadopoulos , Nazim Shaikh , Mohammad Reza Rajati

Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large…

机器学习 · 计算机科学 2020-04-23 Qing Liu , Orchid Majumder , Alessandro Achille , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose a method for…

机器学习 · 计算机科学 2023-05-18 Wenfang Sun , Yingjun Du , Xiantong Zhen , Fan Wang , Ling Wang , Cees G. M. Snoek

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

机器学习 · 计算机科学 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

An overarching goal in machine learning is to build a generalizable model with few samples. To this end, overparameterization has been the subject of immense interest to explain the generalization ability of deep nets even when the size of…

机器学习 · 计算机科学 2022-01-19 Yue Sun , Adhyyan Narang , Halil Ibrahim Gulluk , Samet Oymak , Maryam Fazel

Automated machine learning has been widely researched and adopted in the field of supervised classification and regression, but progress in unsupervised settings has been limited. We propose a novel approach to automate outlier detection…

机器学习 · 计算机科学 2024-09-10 Prabhant Singh , Joaquin Vanschoren

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

机器学习 · 计算机科学 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Meta reinforcement learning aims to develop policies that generalize to unseen tasks sampled from a task distribution. While context-based meta-RL methods improve task representation using task latents, they often struggle with…

机器学习 · 计算机科学 2026-05-21 Jeongmo Kim , Yisak Park , Minung Kim , Seungyul Han

Deep neural network, despite its remarkable capability of discriminating targeted in-distribution samples, shows poor performance on detecting anomalous out-of-distribution data. To address this defect, state-of-the-art solutions choose to…

计算机视觉与模式识别 · 计算机科学 2022-08-30 Boxi Wu , Jie Jiang , Haidong Ren , Zifan Du , Wenxiao Wang , Zhifeng Li , Deng Cai , Xiaofei He , Binbin Lin , Wei Liu

Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key…

机器学习 · 计算机科学 2021-02-24 Sharu Theresa Jose , Osvaldo Simeone

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

计算机视觉与模式识别 · 计算机科学 2019-04-10 Qianru Sun , Yaoyao Liu , Tat-Seng Chua , Bernt Schiele

The success of gradient-based meta-learning is primarily attributed to its ability to leverage related tasks to learn task-invariant information. However, the absence of interactions between different tasks in the inner loop leads to…

机器学习 · 计算机科学 2023-12-15 Oscar Chang , Hod Lipson

Recently, data heterogeneity among the training datasets on the local clients (a.k.a., Non-IID data) has attracted intense interest in Federated Learning (FL), and many personalized federated learning methods have been proposed to handle…

机器学习 · 计算机科学 2022-11-22 Xueyang Tang , Song Guo , Jie Zhang

Deep Metric Learning (DML) aims to find representations suitable for zero-shot transfer to a priori unknown test distributions. However, common evaluation protocols only test a single, fixed data split in which train and test classes are…

机器学习 · 计算机科学 2021-11-30 Timo Milbich , Karsten Roth , Samarth Sinha , Ludwig Schmidt , Marzyeh Ghassemi , Björn Ommer

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

Empirical Risk Minimization (ERM) based machine learning algorithms have suffered from weak generalization performance on data obtained from out-of-distribution (OOD). To address this problem, Invariant Risk Minimization (IRM) objective was…

机器学习 · 计算机科学 2021-03-25 Jun-Hyun Bae , Inchul Choi , Minho Lee