English
Related papers

Related papers: Improving accuracy and power with transfer learnin…

200 papers

Meta-learning models transfer the knowledge acquired from previous tasks to quickly learn new ones. They are trained on benchmarks with a fixed number of data points per task. This number is usually arbitrary and it is unknown how it…

The use of meta-learning and transfer learning in the task of few-shot image classification is a well researched area with many papers showcasing the advantages of transfer learning over meta-learning in cases where data is plentiful and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Joshua Ball

The training of medical image analysis systems using machine learning approaches follows a common script: collect and annotate a large dataset, train the classifier on the training set, and test it on a hold-out test set. This process bears…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Gabriel Maicas , Andrew P. Bradley , Jacinto C. Nascimento , Ian Reid , Gustavo Carneiro

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Detection of Alzheimer's Disease (AD) from neuroimaging data such as MRI through machine learning has been a subject of intense research in recent years. Recent success of deep learning in computer vision has progressed such research…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Naimul Mefraz Khan , Marcia Hon , Nabila Abraham

Meta and transfer learning are two successful families of approaches to few-shot learning. Despite highly related goals, state-of-the-art advances in each family are measured largely in isolation of each other. As a result of diverging…

Machine Learning · Computer Science 2021-04-07 Vincent Dumoulin , Neil Houlsby , Utku Evci , Xiaohua Zhai , Ross Goroshin , Sylvain Gelly , Hugo Larochelle

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

Over the past decade, the field of machine learning has experienced remarkable advancements. While image recognition systems have achieved impressive levels of accuracy, they continue to rely on extensive training datasets. Additionally, a…

Machine Learning · Computer Science 2023-11-03 Benji Alwis

Learning with limited data is one of the biggest problems of machine learning. Current approaches to this issue consist in learning general representations from huge amounts of data before fine-tuning the model on a small dataset of…

Machine Learning · Computer Science 2023-02-22 Grégoire Mialon

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial…

Machine Learning · Statistics 2025-01-09 Hongzhe Zhang , Arnab Auddy , Hongzhe Lee

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Medical imaging machine learning algorithms are usually evaluated on a single dataset. Although training and testing are performed on different subsets of the dataset, models built on one study show limited capability to generalize to other…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ahmed Ashraf , Shehroz Khan , Nikhil Bhagwat , Mallar Chakravarty , Babak Taati

The goal of few-shot image recognition (FSIR) is to identify novel categories with a small number of annotated samples by exploiting transferable knowledge from training data (base categories). Most current studies assume that the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Shuqiang Jiang , Yaohui Zhu , Chenlong Liu , Xinhang Song , Xiangyang Li , Weiqing Min

Few-shot learning deals with the fundamental and challenging problem of learning from a few annotated samples, while being able to generalize well on new tasks. The crux of few-shot learning is to extract prior knowledge from related tasks…

Machine Learning · Computer Science 2021-05-11 Yingjun Du , Haoliang Sun , Xiantong Zhen , Jun Xu , Yilong Yin , Ling Shao , Cees G. M. Snoek

In meta-learning an agent extracts knowledge from observed tasks, aiming to facilitate learning of novel future tasks. Under the assumption that future tasks are 'related' to previous tasks, the accumulated knowledge should be learned in a…

Machine Learning · Statistics 2019-05-21 Ron Amit , Ron Meir

Meta-learning is widely used in few-shot classification and function regression due to its ability to quickly adapt to unseen tasks. However, it has not yet been well explored on regression tasks with high dimensional inputs such as images.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Ning Gao , Hanna Ziesche , Ngo Anh Vien , Michael Volpp , Gerhard Neumann

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

Few-shot classification aims to learn to classify new object categories well using only a few labeled examples. Transferring feature representations from other models is a popular approach for solving few-shot classification problems. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Chun-Nam Yu , Yi Xie

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza