English
Related papers

Related papers: Meta Learning to Bridge Vision and Language Models…

200 papers

Without explicit feedback, humans can rapidly learn the meaning of words. Children can acquire a new word after just a few passive exposures, a process known as fast mapping. This word learning capability is believed to be the most…

Computation and Language · Computer Science 2023-06-02 Guangyuan Jiang , Manjie Xu , Shiji Xin , Wei Liang , Yujia Peng , Chi Zhang , Yixin Zhu

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Few-shot prompting elicits the remarkable abilities of large language models by equipping them with a few demonstration examples in the input. However, the traditional method of providing large language models with all demonstration…

Computation and Language · Computer Science 2023-12-27 Yu Ji , Wen Wu , Yi Hu , Hong Zheng , Liang He

Meta learning has attracted much attention recently in machine learning community. Contrary to conventional machine learning aiming to learn inherent prediction rules to predict labels for new query data, meta learning aims to learn the…

Machine Learning · Computer Science 2023-07-04 Jun Shu , Deyu Meng , Zongben Xu

Learning good feature embeddings for images often requires substantial training data. As a consequence, in settings where training data is limited (e.g., few-shot and zero-shot learning), we are typically forced to use a generic feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xin Wang , Fisher Yu , Ruth Wang , Trevor Darrell , Joseph E. Gonzalez

Pre-trained language models are still far from human performance in tasks that need understanding of properties (e.g. appearance, measurable quantity) and affordances of everyday objects in the real world since the text lacks such…

Computation and Language · Computer Science 2022-03-18 Woojeong Jin , Dong-Ho Lee , Chenguang Zhu , Jay Pujara , Xiang Ren

Few-shot learning aims to transfer the knowledge acquired from training on a diverse set of tasks to unseen tasks from the same task distribution with a limited amount of labeled data. The underlying requirement for effective few-shot…

Machine Learning · Computer Science 2023-05-09 Shounak Datta , Sankha Subhra Mullick , Anish Chakrabarty , Swagatam Das

Most uses of Meta-Learning in visual recognition are very often applied to image classification, with a relative lack of works in other tasks {such} as segmentation and detection. We propose a generic Meta-Learning framework for few-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Hugo Oliveira , Pedro H. T. Gama , Isabelle Bloch , Roberto Marcondes Cesar

Large language models have demonstrated robust performance on various language tasks using zero-shot or few-shot learning paradigms. While being actively researched, multimodal models that can additionally handle images as input have yet to…

Computation and Language · Computer Science 2023-05-24 Sherzod Hakimov , David Schlangen

Large Multimodal Models (LMMs) often rely on in-context learning (ICL) to perform new visual question answering (VQA) tasks with minimal supervision. However, ICL performance, especially in smaller LMMs, does not always improve…

Artificial Intelligence · Computer Science 2026-03-03 Akash Gupta , Amos Storkey , Mirella Lapata

Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-training tasks are still required for generalization to unseen…

Machine Learning · Computer Science 2024-10-24 Seanie Lee , Bruno Andreis , Kenji Kawaguchi , Juho Lee , Sung Ju Hwang

Language grounding aims at linking the symbolic representation of language (e.g., words) into the rich perceptual knowledge of the outside world. The general approach is to embed both textual and visual information into a common space -the…

Computation and Language · Computer Science 2021-09-15 Hassan Shahmohammadi , Hendrik P. A. Lensch , R. Harald Baayen

Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph…

Artificial Intelligence · Computer Science 2026-05-26 Renchu Guan , Yajun Wang , Chunli Guo , Bowen Cao , Fausto Giunchiglia , Wei Pang , Yonghao Liu , Xiaoyue Feng

Although providing exceptional results for many computer vision tasks, state-of-the-art deep learning algorithms catastrophically struggle in low data scenarios. However, if data in additional modalities exist (e.g. text) this can…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Frederik Pahde , Mihai Puscas , Tassilo Klein , Moin Nabi

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

In visual recognition tasks, few-shot learning requires the ability to learn object categories with few support examples. Its re-popularity in light of the deep learning development is mainly in image classification. This work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Miao Zhang , Miaojing Shi , Li Li

Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks. This paper presents mPLUG, a new vision-language…

Computation and Language · Computer Science 2023-07-06 Chenliang Li , Haiyang Xu , Junfeng Tian , Wei Wang , Ming Yan , Bin Bi , Jiabo Ye , Hehong Chen , Guohai Xu , Zheng Cao , Ji Zhang , Songfang Huang , Fei Huang , Jingren Zhou , Luo Si

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

Machine Learning · Computer Science 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

Artificial intelligence nowadays plays an increasingly prominent role in our life since decisions that were once made by humans are now delegated to automated systems. A machine learning algorithm trained based on biased data, however,…

Machine Learning · Computer Science 2020-09-29 Chen Zhao , Changbin Li , Jincheng Li , Feng Chen

Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning techniques for few-shot learning. It uses gradient descent to learn commonalities between various tasks, enabling the model to learn the meta-initialization of…

Machine Learning · Computer Science 2022-08-18 Lin Ding , Peng Liu , Wenfeng Shen , Weijia Lu , Shengbo Chen