English
Related papers

Related papers: Improving Few-Shot Learning through Multi-task Rep…

200 papers

Multi-task learning is effective for related applications, but its performance can deteriorate when the target sample size is small. Transfer learning can borrow strength from related studies; yet, many existing methods rely on restrictive…

Machine Learning · Computer Science 2026-04-23 Boxin Zhao , Mladen Kolar , Jinchi Lv

Few-shot learning is a challenging task that aims at training a classifier for unseen classes with only a few training examples. The main difficulty of few-shot learning lies in the lack of intra-class diversity within insufficient training…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Mengting Chen , Yuxin Fang , Xinggang Wang , Heng Luo , Yifeng Geng , Xinyu Zhang , Chang Huang , Wenyu Liu , Bo Wang

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

Multi-task learning (MTL) seeks to learn a single model to accomplish multiple tasks by leveraging shared information among the tasks. Existing MTL models, however, have been known to suffer from negative interference among tasks. Efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Chuntao Ding , Zhichao Lu , Shangguang Wang , Ran Cheng , Vishnu Naresh Boddeti

An overarching goal in machine learning is to build a generalizable model with few samples. To this end, overparameterization has been the subject of immense interest to explain the generalization ability of deep nets even when the size of…

Machine Learning · Computer Science 2022-01-19 Yue Sun , Adhyyan Narang , Halil Ibrahim Gulluk , Samet Oymak , Maryam Fazel

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot text classification has recently been promoted by the meta-learning paradigm which aims to identify target classes with knowledge transferred from source classes with sets of small tasks named episodes. Despite their success,…

Computation and Language · Computer Science 2023-05-17 Junfan Chen , Richong Zhang , Yongyi Mao , Jie Xu

Few-shot learning remains challenging for meta-learning that learns a learning algorithm (meta-learner) from many related tasks. In this work, we argue that this is due to the lack of a good representation for meta-learning, and propose…

Machine Learning · Computer Science 2018-02-13 Fengwei Zhou , Bin Wu , Zhenguo Li

An effective approach in meta-learning is to utilize multiple "train tasks" to learn a good initialization for model parameters that can help solve unseen "test tasks" with very few samples by fine-tuning from this initialization. Although…

Machine Learning · Computer Science 2021-06-30 Nikunj Saunshi , Arushi Gupta , Wei Hu

Few-shot learning is an important area of research. Conceptually, humans are readily able to understand new concepts given just a few examples, while in more pragmatic terms, limited-example training situations are common in practice.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Hongyang Li , David Eigen , Samuel Dodge , Matthew Zeiler , Xiaogang Wang

In this paper, we mainly focus on the problem of how to learn additional feature representations for few-shot image classification through pretext tasks (e.g., rotation or color permutation and so on). This additional knowledge generated by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Min Zhang , Siteng Huang , Wenbin Li , Donglin Wang

The goal of few-shot learning is to recognize new visual concepts with just a few amount of labeled samples in each class. Recent effective metric-based few-shot approaches employ neural networks to learn a feature similarity comparison…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Xiaomeng Li , Lequan Yu , Chi-Wing Fu , Meng Fang , Pheng-Ann Heng

Learning to Rank (LTR) technique is ubiquitous in the Information Retrieval system nowadays, especially in the Search Ranking application. The query-item relevance labels typically used to train the ranking model are often noisy…

Information Retrieval · Computer Science 2022-07-11 Debabrata Mahapatra , Chaosheng Dong , Yetian Chen , Deqiang Meng , Michinari Momma

Recently, different machine learning methods have been introduced to tackle the challenging few-shot learning scenario that is, learning from a small labeled dataset related to a specific task. Common approaches have taken the form of…

Machine Learning · Computer Science 2020-10-14 Massimiliano Patacchiola , Jack Turner , Elliot J. Crowley , Michael O'Boyle , Amos Storkey

Metalearning and multitask learning are two frameworks for solving a group of related learning tasks more efficiently than we could hope to solve each of the individual tasks on their own. In multitask learning, we are given a fixed set of…

Machine Learning · Computer Science 2024-04-02 Maryam Aliakbarpour , Konstantina Bairaktari , Gavin Brown , Adam Smith , Nathan Srebro , Jonathan Ullman

Multitask Representation Learning (MRL) has emerged as a prevalent technique to improve sample efficiency in Reinforcement Learning (RL). Empirical studies have found that training agents on multiple tasks simultaneously within online and…

Machine Learning · Computer Science 2025-03-04 Rui Lu , Yang Yue , Andrew Zhao , Simon Du , Gao Huang

Metric-based few-shot learning methods try to overcome the difficulty due to the lack of training examples by learning embedding to make comparison easy. We propose a novel algorithm to generate class representatives for few-shot…

Machine Learning · Computer Science 2019-06-06 Junyoung Park , Subin Yi , Yongseok Choi , Dong-Yeon Cho , Jiwon Kim

Multi-task learning (MTL) trains deep neural networks to optimize several objectives simultaneously using a shared backbone, which leads to reduced computational costs, improved data efficiency, and enhanced performance through cross-task…

Machine Learning · Computer Science 2025-09-30 Hoang Phan , Lam Tran , Quyen Tran , Ngoc N. Tran , Tuan Truong , Qi Lei , Nhat Ho , Dinh Phung , Trung Le

Many meta-learning approaches for few-shot learning rely on simple base learners such as nearest-neighbor classifiers. However, even in the few-shot regime, discriminatively trained linear predictors can offer better generalization. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Kwonjoon Lee , Subhransu Maji , Avinash Ravichandran , Stefano Soatto

Few-shot learning (FSL) is a central problem in meta-learning, where learners must efficiently learn from few labeled examples. Within FSL, feature pre-training has recently become an increasingly popular strategy to significantly improve…

Machine Learning · Computer Science 2023-11-07 Ruohan Wang , Isak Falk , Massimiliano Pontil , Carlo Ciliberto