English
Related papers

Related papers: Are LSTMs Good Few-Shot Learners?

200 papers

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

Machine Learning · Computer Science 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

In the context of few-shot learning, it is currently believed that a fixed pre-trained (PT) model, along with fine-tuning the final layer during evaluation, outperforms standard meta-learning algorithms. We re-evaluate these claims under an…

Machine Learning · Computer Science 2025-09-24 Brando Miranda , Patrick Yu , Saumya Goyal , Yu-Xiong Wang , Sanmi Koyejo

Meta-learning has been extensively applied in the domains of few-shot learning and fast adaptation, achieving remarkable performance. While Meta-learning methods like Model-Agnostic Meta-Learning (MAML) and its variants provide a good set…

Machine Learning · Computer Science 2024-08-09 Runxi Cheng , Yongxian Wei , Xianglong He , Wanyun Zhu , Songsong Huang , Fei Richard Yu , Fei Ma , Chun Yuan

Vision transformers combined with self-supervised learning have enabled the development of models which scale across large datasets for several downstream tasks like classification, segmentation and detection. The low-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Thanks to the availability of powerful computing resources, big data and deep learning algorithms, we have made great progress on computer vision in the last few years. Computer vision systems begin to surpass humans in some tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Fupin Yao

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

Conventional training of deep neural networks usually requires a substantial amount of data with expensive human annotations. In this paper, we utilize the idea of meta-learning to explain two very different streams of few-shot learning,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Shaobo Lin , Xingyu Zeng , Rui Zhao

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

Machine Learning · Computer Science 2021-03-18 Alberto Bernacchia

Few-shot segmentation~(FSS) performance has been extensively promoted by introducing episodic training and class-wise prototypes. However, the FSS problem remains challenging due to three limitations: (1) Models are distracted by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Jian-Wei Zhang , Lei Lv , Yawei Luo , Hao-Zhe Feng , Yi Yang , Wei Chen

The problem of open-set recognition is considered. While previous approaches only consider this problem in the context of large-scale classifier training, we seek a unified solution for this and the low-shot classification setting. It is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Bo Liu , Hao Kang , Haoxiang Li , Gang Hua , Nuno Vasconcelos

Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector…

Machine Learning · Computer Science 2022-03-04 Tristan Deleu , David Kanaa , Leo Feng , Giancarlo Kerg , Yoshua Bengio , Guillaume Lajoie , Pierre-Luc Bacon

In the field of few-shot learning (FSL), extensive research has focused on improving network structures and training strategies. However, the role of data processing modules has not been fully explored. Therefore, in this paper, we propose…

Machine Learning · Computer Science 2023-05-16 Wentao Hu , Xiurong Jiang , Jiarun Liu , Yuqi Yang , Hui Tian

Few-shot learning has recently attracted wide interest in image classification, but almost all the current public benchmarks are focused on natural images. The few-shot paradigm is highly relevant in medical-imaging applications due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Fereshteh Shakeri , Malik Boudiaf , Sina Mohammadi , Ivaxi Sheth , Mohammad Havaei , Ismail Ben Ayed , Samira Ebrahimi Kahou

Partial-label learning (PLL) generally focuses on inducing a noise-tolerant multi-class classifier by training on overly-annotated samples, each of which is annotated with a set of labels, but only one is the valid label. A basic promise of…

Computation and Language · Computer Science 2021-06-03 Yunfeng Zhao , Guoxian Yu , Lei Liu , Zhongmin Yan , Lizhen Cui , Carlotta Domeniconi

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto

Recent advances in machine learning have made significant contributions to drug discovery. Deep neural networks in particular have been demonstrated to provide significant boosts in predictive power when inferring the properties and…

Machine Learning · Computer Science 2016-11-11 Han Altae-Tran , Bharath Ramsundar , Aneesh S. Pappu , Vijay Pande

Few-shot learning (FSL) aims to learn novel visual categories from very few samples, which is a challenging problem in real-world applications. Many methods of few-shot classification work well on general images to learn global…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojian He , Jinfu Lin , Junming Shen

Long-tailed semi-supervised learning (LTSSL) presents a formidable challenge where models must overcome the scarcity of tail samples while mitigating the noise from unreliable pseudo-labels. Most prior LTSSL methods are designed to train…

Machine Learning · Computer Science 2026-04-09 Zhiyuan Huang , Jiahao Chen , Bing Su

Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at both forecasting tasks, and at quantifying the uncertainty associated with those forecasts (prediction intervals). One example is Multivariate…

Machine Learning · Computer Science 2022-02-28 Thabang Mathonsi , Terence L van Zyl