English
Related papers

Related papers: Bayesian Meta-Learning for the Few-Shot Setting vi…

200 papers

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond

Meta-learning methods perform well on new within-distribution tasks but often fail when adapting to out-of-distribution target tasks, where transfer from source tasks can induce negative transfer. We propose a causally-aware Bayesian…

Machine Learning · Computer Science 2026-02-24 Lotta Mäkinen , Jorge Loría , Samuel Kaski

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Commercial iterative reconstruction techniques on modern CT scanners target radiation dose reduction but there are lingering concerns over their impact on image appearance and low contrast detectability. Recently, machine learning,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Hongming Shan , Atul Padole , Fatemeh Homayounieh , Uwe Kruger , Ruhani Doda Khera , Chayanin Nitiwarangkul , Mannudeep K. Kalra , Ge Wang

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Parameter-transfer is a well-known and versatile approach for meta-learning, with applications including few-shot learning, federated learning, and reinforcement learning. However, parameter-transfer algorithms often require sharing models…

Machine Learning · Computer Science 2020-02-24 Jeffrey Li , Mikhail Khodak , Sebastian Caldas , Ameet Talwalkar

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

Machine Learning · Statistics 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize spatial information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Xiangyu Chen , Guanghui Wang

Cross-workload design space exploration (DSE) is crucial in CPU architecture design. Existing DSE methods typically employ the transfer learning technique to leverage knowledge from source workloads, aiming to minimize the requirement of…

Hardware Architecture · Computer Science 2025-04-21 Runzhen Xue , Hao Wu , Mingyu Yan , Ziheng Xiao , Xiaochun Ye , Dongrui Fan

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…

Many real-world problems, including multi-speaker text-to-speech synthesis, can greatly benefit from the ability to meta-learn large models with only a few task-specific components. Updating only these task-specific modules then allows the…

Machine Learning · Computer Science 2020-10-23 Yutian Chen , Abram L. Friesen , Feryal Behbahani , Arnaud Doucet , David Budden , Matthew W. Hoffman , Nando de Freitas

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…

The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn…

Machine Learning · Computer Science 2018-11-09 Ivan Olier , Oghenejokpeme I. Orhobor , Joaquin Vanschoren , Ross D. King

Meta-learning optimizes the hyperparameters of a training procedure, such as its initialization, kernel, or learning rate, based on data sampled from a number of auxiliary tasks. A key underlying assumption is that the auxiliary tasks,…

Machine Learning · Computer Science 2021-11-10 Yunchuan Zhang , Sharu Theresa Jose , Osvaldo Simeone

When fitting Bayesian machine learning models on scarce data, the main challenge is to obtain suitable prior knowledge and encode it into the model. Recent advances in meta-learning offer powerful methods for extracting such prior knowledge…

Machine Learning · Statistics 2020-02-17 Vincent Fortuin , Heiko Strathmann , Gunnar Rätsch

Knowledge tracing (KT) has recently been an active research area of computational pedagogy. The task is to model students' mastery level of knowledge concepts based on their responses to the questions in the past, as well as predict the…

Machine Learning · Computer Science 2021-10-15 Shanghui Yang , Mengxia Zhu , Xuesong Lu

A core capability of intelligent systems is the ability to quickly learn new tasks by drawing on prior experience. Gradient (or optimization) based meta-learning has recently emerged as an effective approach for few-shot learning. In this…

Machine Learning · Computer Science 2019-09-11 Aravind Rajeswaran , Chelsea Finn , Sham Kakade , Sergey Levine

Pre-training a deep neural network on the ImageNet dataset is a common practice for training deep learning models, and generally yields improved performance and faster training times. The technique of pre-training on one task and then…

Machine Learning · Computer Science 2020-01-03 Nishai Kooverjee , Steven James , Terence van Zyl

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

Machine Learning · Computer Science 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi