English
Related papers

Related papers: Few-shot Multimodal Multitask Multilingual Learnin…

200 papers

Pretrained Language Models (PLMs) have achieved tremendous success in natural language understanding tasks. While different learning schemes -- fine-tuning, zero-shot, and few-shot learning -- have been widely explored and compared for…

Computation and Language · Computer Science 2021-09-30 Liang Xu , Xiaojing Lu , Chenyang Yuan , Xuanwei Zhang , Huilin Xu , Hu Yuan , Guoao Wei , Xiang Pan , Xin Tian , Libo Qin , Hu Hai

Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph…

Artificial Intelligence · Computer Science 2026-05-26 Renchu Guan , Yajun Wang , Chunli Guo , Bowen Cao , Fausto Giunchiglia , Wei Pang , Yonghao Liu , Xiaoyue Feng

Large-scale pre-trained models have achieved remarkable success in language and image tasks, leading an increasing number of studies to explore the application of pre-trained image models, such as CLIP, in the domain of few-shot action…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Congqi Cao , Peiheng Han , Yueran zhang , Yating Yu , Qinyi Lv , Lingtong Min , Yanning zhang

Few-Shot learning aims to train and optimize a model that can adapt to unseen visual classes with only a few labeled examples. The existing few-shot learning (FSL) methods, heavily rely only on visual data, thus fail to capture the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Mohamed Afham , Ranga Rodrigo

We demonstrate the potential of few-shot translation systems, trained with unpaired language data, for both high and low-resource language pairs. We show that with only 5 examples of high-quality translation data shown at inference, a…

Computation and Language · Computer Science 2023-02-06 Xavier Garcia , Yamini Bansal , Colin Cherry , George Foster , Maxim Krikun , Fangxiaoyu Feng , Melvin Johnson , Orhan Firat

Few-shot crosslingual transfer has been shown to outperform its zero-shot counterpart with pretrained encoders like multilingual BERT. Despite its growing popularity, little to no attention has been paid to standardizing and analyzing the…

Computation and Language · Computer Science 2021-06-03 Mengjie Zhao , Yi Zhu , Ehsan Shareghi , Ivan Vulić , Roi Reichart , Anna Korhonen , Hinrich Schütze

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

This paper studies zero-shot cross-lingual transfer of vision-language models. Specifically, we focus on multilingual text-to-video search and propose a Transformer-based model that learns contextualized multilingual multimodal embeddings.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Po-Yao Huang , Mandela Patrick , Junjie Hu , Graham Neubig , Florian Metze , Alexander Hauptmann

We present a novel visual instruction tuning strategy to improve the zero-shot task generalization of multimodal large language models by building a firm text-only knowledge base. Existing work lacks sufficient experimentation on the…

Computation and Language · Computer Science 2025-07-01 Jianhong Tu , Zhuohao Ni , Nicholas Crispino , Zihao Yu , Michael Bendersky , Beliz Gunel , Ruoxi Jia , Xin Liu , Lingjuan Lyu , Dawn Song , Chenguang Wang

Pre-trained large language models can efficiently interpolate human-written prompts in a natural way. Multitask prompted learning can help generalization through a diverse set of tasks at once, thus enhancing the potential for more…

Computation and Language · Computer Science 2022-12-22 M Saiful Bari , Aston Zhang , Shuai Zheng , Xingjian Shi , Yi Zhu , Shafiq Joty , Mu Li

Multilingual neural machine translation (NMT) has recently been investigated from different aspects (e.g., pivot translation, zero-shot translation, fine-tuning, or training from scratch) and in different settings (e.g., rich resource and…

Computation and Language · Computer Science 2019-12-30 Xu Tan , Yichong Leng , Jiale Chen , Yi Ren , Tao Qin , Tie-Yan Liu

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

Pre-trained language models (PLM) based on transformer neural networks developed in the field of natural language processing (NLP) offer great opportunities to improve automatic content analysis in communication science, especially for the…

Few-shot learning has recently attracted wide interest in image classification, but almost all the current public benchmarks are focused on natural images. The few-shot paradigm is highly relevant in medical-imaging applications due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Fereshteh Shakeri , Malik Boudiaf , Sina Mohammadi , Ivaxi Sheth , Mohammad Havaei , Ismail Ben Ayed , Samira Ebrahimi Kahou

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a…

Computation and Language · Computer Science 2021-05-26 Qing Lin , Yongbin Liu , Wen Wen , Zhihua Tao

Prior work on language models (LMs) shows that training on a large number of diverse tasks improves few-shot learning (FSL) performance on new tasks. We take this to the extreme, automatically extracting 413,299 tasks from internet tables -…

Computation and Language · Computer Science 2022-08-09 Jun Shern Chan , Michael Pieler , Jonathan Jao , Jérémy Scheurer , Ethan Perez

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

Cross-domain few-shot hyperspectral image classification focuses on learning prior knowledge from a large number of labeled samples from source domains and then transferring the knowledge to the tasks which contain few labeled samples in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chun Liu , Longwei Yang , Zheng Li , Wei Yang , Zhigang Han , Jianzhong Guo , Junyong Yu

The performance of meta-learning approaches for few-shot learning generally depends on three aspects: features suitable for comparison, the classifier ( base learner ) suitable for low-data scenarios, and valuable information from the…

Machine Learning · Computer Science 2020-09-15 Haoqing Wang , Zhi-Hong Deng