English
Related papers

Related papers: Will Multi-modal Data Improves Few-shot Learning?

200 papers

Few-shot learning is devoted to training a model on few samples. Most of these approaches learn a model based on a pixel-level or global-level feature representation. However, using global features may lose local information, and using…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

In few-shot learning, the selection of samples has a significant impact on the performance of the model. While effective sample selection strategies are well-established in supervised settings, research on large language models largely…

Machine Learning · Computer Science 2026-04-20 Branislav Pecher , Ivan Srba , Maria Bielikova , Joaquin Vanschoren

Effective deep feature extraction via feature-level fusion is crucial for multimodal object detection. However, previous studies often involve complex training processes that integrate modality-specific features by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Lei Hao , Lina Xu , Chang Liu , Yanni Dong

Currently, the state-of-the-art methods treat few-shot semantic segmentation task as a conditional foreground-background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta-class, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhonghua Wu , Xiangxi Shi , Guosheng lin , Jianfei Cai

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

In this paper, we propose an approach to improve few-shot classification performance using a composite rotation based auxiliary task. Few-shot classification methods aim to produce neural networks that perform well for classes with a large…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Pratik Mazumder , Pravendra Singh , Vinay P. Namboodiri

Few-shot object detection aims to detect instances of specific categories in a query image with only a handful of support samples. Although this takes less effort than obtaining enough annotated images for supervised object detection, it…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Hojun Lee , Myunggi Lee , Nojun Kwak

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a…

Computation and Language · Computer Science 2021-05-26 Qing Lin , Yongbin Liu , Wen Wen , Zhihua Tao

With the rapid development of the Internet and social media, multi-modal data (text and image) is increasingly important in sentiment analysis tasks. However, the existing methods are difficult to effectively fuse text and image features,…

Computation and Language · Computer Science 2024-12-06 JiaLe Ren

The goal of few-shot relation extraction is to predict relations between name entities in a sentence when only a few labeled instances are available for training. Existing few-shot relation extraction methods focus on uni-modal information…

Computation and Language · Computer Science 2024-03-04 Jiaying Gong , Hoda Eldardiry

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Guangming Wang , Chensheng Peng , Jinpeng Zhang , Hesheng Wang

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

Humans possess remarkable ability to accurately classify new, unseen images after being exposed to only a few examples. Such ability stems from their capacity to identify common features shared between new and previously seen images while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Weihao Jiang , Chang Liu , Kun He

In few-shot learning, classifiers are expected to generalize to unseen classes given only a small number of instances of each new class. One of the popular solutions to few-shot learning is metric-based meta-learning. However, it highly…

Machine Learning · Computer Science 2025-11-18 Qiuhao Zeng

Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jordi Armengol-Estapé , Vincent Michalski , Ramnath Kumar , Pierre-Luc St-Charles , Doina Precup , Samira Ebrahimi Kahou

Few-shot segmentation (FSS) methods perform image segmentation for a particular object class in a target (query) image, using a small set of (support) image-mask pairs. Recent deep neural network based FSS methods leverage high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Siddhartha Gairola , Mayur Hemani , Ayush Chopra , Balaji Krishnamurthy

While few-shot learning as a transfer learning paradigm has gained significant traction for scenarios with limited data, it has primarily been explored in the context of building unimodal and unilingual models. Furthermore, a significant…

Machine Learning · Computer Science 2023-03-23 Aman Chadha , Vinija Jain

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Despite the recent developments in vision-related problems using deep neural networks, there still remains a wide scope in the improvement of generalizing these models to unseen examples. In this paper, we explore the domain of few-shot…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Rohit Jena , Shirsendu Sukanta Halder , Katia Sycara

The goal of few-shot learning is to learn a classifier that can recognize unseen classes from limited support data with labels. A common practice for this task is to train a model on the base set first and then transfer to novel classes…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Zhiqiang Shen , Zechun Liu , Jie Qin , Marios Savvides , Kwang-Ting Cheng