English
Related papers

Related papers: Multimodality Helps Unimodality: Cross-Modal Few-S…

200 papers

Pre-trained vision-language models have inspired much research on few-shot learning. However, with only a few training images, there exist two crucial problems: (1) the visual feature distributions are easily distracted by class-irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Runqi Wang , Hao Zheng , Xiaoyue Duan , Jianzhuang Liu , Yuning Lu , Tian Wang , Songcen Xu , Baochang Zhang

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose a method for…

Machine Learning · Computer Science 2023-05-18 Wenfang Sun , Yingjun Du , Xiantong Zhen , Fan Wang , Ling Wang , Cees G. M. Snoek

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Imagine a robot is shown new concepts visually together with spoken tags, e.g. "milk", "eggs", "butter". After seeing one paired audio-visual example per class, it is shown a new set of unseen instances of these objects, and asked to pick…

Computation and Language · Computer Science 2019-04-16 Ryan Eloff , Herman A. Engelbrecht , Herman Kamper

Image modality recognition is essential for efficient imaging workflows in current clinical environments, where multiple imaging modalities are used to better comprehend complex diseases. Emerging biomarkers from novel, rare modalities are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Santi Puch , Irina Sánchez , Matt Rowe

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

The goal of few-shot classification is to learn a model that can classify novel classes using only a few training examples. Despite the promising results shown by existing meta-learning algorithms in solving the few-shot classification…

Machine Learning · Computer Science 2020-11-03 Shuman Peng , Weilian Song , Martin Ester

We introduce SONO, a novel method leveraging Second-Order Neural Ordinary Differential Equations (Second-Order NODEs) to enhance cross-modal few-shot learning. By employing a simple yet effective architecture consisting of a Second-Order…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yi Zhang , Chun-Wun Cheng , Junyi He , Zhihai He , Carola-Bibiane Schönlieb , Yuyan Chen , Angelica I Aviles-Rivero

Although few-shot learning research has advanced rapidly with the help of meta-learning, its practical usefulness is still limited because most of them assumed that all meta-training and meta-testing examples came from a single domain. We…

Machine Learning · Computer Science 2020-09-18 Yongseok Choi , Junyoung Park , Subin Yi , Dong-Yeon Cho

A family of recent successful approaches to few-shot learning relies on learning an embedding space in which predictions are made by computing similarities between examples. This corresponds to combining information between support and…

Machine Learning · Computer Science 2018-12-04 Hugo Prol , Vincent Dumoulin , Luis Herranz

In neuroscience research, achieving single-neuron matching across different imaging modalities is critical for understanding the relationship between neuronal structure and function. However, modality gaps and limited annotations present…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Wenwei Li , Liyi Cai , Wu Chen , Anan Li

Few-shot classification refers to learning a classifier for new classes given only a few examples. While a plethora of models have emerged to tackle it, we find the procedure and datasets that are used to assess their progress lacking. To…

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

State-of-the-art deep learning algorithms generally require large amounts of data for model training. Lack thereof can severely deteriorate the performance, particularly in scenarios with fine-grained boundaries between categories. To this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Frederik Pahde , Patrick Jähnichen , Tassilo Klein , Moin Nabi

Recent vision-language models are driven by large-scale pretrained models. However, adapting pretrained models on limited data presents challenges such as overfitting, catastrophic forgetting, and the cross-modal gap between vision and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Deniz Engin , Yannis Avrithis

Few-shot classification is a challenging problem that aims to learn a model that can adapt to unseen classes given a few labeled samples. Recent approaches pre-train a feature extractor, and then fine-tune for episodic meta-learning. Other…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Philip Chikontwe , Soopil Kim , Sang Hyun Park

The focus of recent meta-learning research has been on the development of learning algorithms that can quickly adapt to test time tasks with limited data and low computational cost. Few-shot learning is widely used as one of the standard…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Yonglong Tian , Yue Wang , Dilip Krishnan , Joshua B. Tenenbaum , Phillip Isola

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…