English
Related papers

Related papers: PAC-Bayes meta-learning with implicit task-specifi…

200 papers

Few-shot learning has become essential for producing models that generalize from few examples. In this work, we identify that metric scaling and metric task conditioning are important to improve the performance of few-shot algorithms. Our…

Machine Learning · Computer Science 2019-01-28 Boris N. Oreshkin , Pau Rodriguez , Alexandre Lacoste

Few-shot learning aims to transfer the knowledge acquired from training on a diverse set of tasks to unseen tasks from the same task distribution with a limited amount of labeled data. The underlying requirement for effective few-shot…

Machine Learning · Computer Science 2023-05-09 Shounak Datta , Sankha Subhra Mullick , Anish Chakrabarty , Swagatam Das

Although few-shot learning and one-class classification (OCC), i.e., learning a binary classifier with data from only one class, have been separately well studied, their intersection remains rather unexplored. Our work addresses the…

Machine Learning · Computer Science 2021-02-12 Ahmed Frikha , Denis Krompaß , Hans-Georg Köpken , Volker Tresp

We consider the task of few shot link prediction on graphs. The goal is to learn from a distribution over graphs so that a model is able to quickly infer missing edges in a new graph after a small amount of training. We show that current…

Machine Learning · Computer Science 2020-03-03 Avishek Joey Bose , Ankit Jain , Piero Molino , William L. Hamilton

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

The success of deep learning methods hinges on the availability of large training datasets annotated for the task of interest. In contrast to human intelligence, these methods lack versatility and struggle to learn and adapt quickly to new…

Computation and Language · Computer Science 2020-10-13 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Currently available benchmarks for few-shot learning (machine learning with few training examples) are limited in the domains they cover, primarily focusing on image classification. This work aims to alleviate this reliance on image-based…

Sound · Computer Science 2022-04-12 Calum Heggan , Sam Budgett , Timothy Hospedales , Mehrdad Yaghoobi

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike…

Machine Learning · Computer Science 2020-10-27 Huimin Peng

Meta-learning can extract an inductive bias from previous learning experience and assist the training of new tasks. It is often realized through optimizing a meta-model with the evaluation loss of task-specific solvers. Most existing…

Machine Learning · Computer Science 2021-12-20 Su Lu , Han-Jia Ye , Le Gan , De-Chuan Zhan

Few-shot learning, which aims at extracting new concepts rapidly from extremely few examples of novel classes, has been featured into the meta-learning paradigm recently. Yet, the key challenge of how to learn a generalizable classifier…

Machine Learning · Computer Science 2019-10-08 Limeng Qiao , Yemin Shi , Jia Li , Yaowei Wang , Tiejun Huang , Yonghong Tian

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

Machine Learning · Computer Science 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

We consider a PAC-Bayes type learning rule for binary classification, balancing the training error of a randomized ''posterior'' predictor with its KL divergence to a pre-specified ''prior''. This can be seen as an extension of a modified…

Machine Learning · Statistics 2026-03-25 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Shaobo Lin , Xingyu Zeng , Rui Zhao

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

Few-shot image classification, where the goal is to generalize to tasks with limited labeled data, has seen great progress over the years. However, the classifiers are vulnerable to adversarial examples, posing a question regarding their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Akshayvarun Subramanya , Hamed Pirsiavash

A core capability of intelligent systems is the ability to quickly learn new tasks by drawing on prior experience. Gradient (or optimization) based meta-learning has recently emerged as an effective approach for few-shot learning. In this…

Machine Learning · Computer Science 2019-09-11 Aravind Rajeswaran , Chelsea Finn , Sham Kakade , Sergey Levine

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

Machine Learning · Computer Science 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich