English
Related papers

Related papers: Improving Few-Shot Generalization by Exploring and…

200 papers

Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires…

In few-shot learning, the selection of samples has a significant impact on the performance of the model. While effective sample selection strategies are well-established in supervised settings, research on large language models largely…

Machine Learning · Computer Science 2026-04-20 Branislav Pecher , Ivan Srba , Maria Bielikova , Joaquin Vanschoren

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Recent few-shot object detection (FSOD) methods have focused on augmenting synthetic samples for novel classes, show promising results to the rise of diffusion models. However, the diversity of such datasets is often limited in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Anh-Khoa Nguyen Vu , Quoc-Truong Truong , Vinh-Tiep Nguyen , Thanh Duc Ngo , Thanh-Toan Do , Tam V. Nguyen

Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic…

Machine Learning · Computer Science 2023-12-08 Jaron Mar , Jiamou Liu

Existing continual relation learning (CRL) methods rely on plenty of labeled training data for learning a new task, which can be hard to acquire in real scenario as getting large and representative labeled data is often expensive and…

Computation and Language · Computer Science 2022-03-07 Chengwei Qin , Shafiq Joty

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Cross-domain few-shot classification task (CD-FSC) combines few-shot classification with the requirement to generalize across domains represented by datasets. This setup faces challenges originating from the limited labeled data in each…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jiamei Sun , Sebastian Lapuschkin , Wojciech Samek , Yunqing Zhao , Ngai-Man Cheung , Alexander Binder

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Although few-shot learning and one-class classification (OCC), i.e., learning a binary classifier with data from only one class, have been separately well studied, their intersection remains rather unexplored. Our work addresses the…

Machine Learning · Computer Science 2021-02-12 Ahmed Frikha , Denis Krompaß , Hans-Georg Köpken , Volker Tresp

Few-shot object detection, the problem of modelling novel object detection categories with few training instances, is an emerging topic in the area of few-shot learning and object detection. Contemporary techniques can be divided into two…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Berkan Demirel , Orhun Buğra Baran , Ramazan Gokberk Cinbis

Few-shot object detection (FSOD) aims at extending a generic detector for novel object detection with only a few training examples. It attracts great concerns recently due to the practical meanings. Meta-learning has been demonstrated to be…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Zichen Wang , Bo Yang , Haonan Yue , Zhenghao Ma

End-to-end approaches have recently become popular as a means of simplifying the training and deployment of speech recognition systems. However, they often require large amounts of data to perform well on large vocabulary tasks. With the…

Computation and Language · Computer Science 2019-03-25 Bertrand Higy , Peter Bell

Both generalized and incremental few-shot learning have to deal with three major challenges: learning novel classes from only few samples per class, preventing catastrophic forgetting of base classes, and classifier calibration across novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Anna Kukleva , Hilde Kuehne , Bernt Schiele

Medical image analysis faces two critical challenges: scarcity of labeled data and lack of model interpretability, both hindering clinical AI deployment. Few-shot learning (FSL) addresses data limitations but lacks transparency in…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh

In this paper, we propose to tackle the challenging few-shot learning (FSL) problem by learning global class representations using both base and novel class training samples. In each training episode, an episodic class mean computed from a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Tiange Luo , Aoxue Li , Tao Xiang , Weiran Huang , Liwei Wang

Adapting pretrained large language models (LLMs) to various downstream tasks in tens or hundreds of human languages is computationally expensive. Parameter-efficient fine-tuning (PEFT) significantly reduces the adaptation cost, by tuning…

Computation and Language · Computer Science 2024-08-02 Chu-Cheng Lin , Xinyi Wang , Jonathan H. Clark , Han Lu , Yun Zhu , Chenxi Whitehouse , Hongkun Yu

Few-shot image classification aims at training a model from only a few examples for each of the "novel" classes. This paper proposes the idea of associative alignment for leveraging part of the base data by aligning the novel training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

This work studies the problem of few-shot object counting, which counts the number of exemplar objects (i.e., described by one or several support images) occurring in the query image. The major challenge lies in that the target objects can…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zhiyuan You , Kai Yang , Wenhan Luo , Xin Lu , Lei Cui , Xinyi Le

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi