English
Related papers

Related papers: Investigating Zero- and Few-shot Generalization in…

200 papers

Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need. Existing methods mostly adopt pipeline approaches with different components for knowledge matching and extraction, feature learning,…

Artificial Intelligence · Computer Science 2021-10-19 Zhuo Chen , Jiaoyan Chen , Yuxia Geng , Jeff Z. Pan , Zonggang Yuan , Huajun Chen

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

The prominence of generalized foundation models in vision-language integration has witnessed a surge, given their multifarious applications. Within the natural domain, the procurement of vision-language datasets to construct these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Keumgang Cha , Donggeun Yu , Junghoon Seo

The existing few-shot video classification methods often employ a meta-learning paradigm by designing customized temporal alignment module for similarity calculation. While significant progress has been made, these methods fail to focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhenxi Zhu , Limin Wang , Sheng Guo , Gangshan Wu

Abstractive multi-document summarization (MDS) is the task of automatically summarizing information in multiple documents, from news articles to conversations with multiple speakers. The training approaches for current MDS models can be…

Computation and Language · Computer Science 2025-08-01 Alexandra DeLucia , Mark Dredze

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization…

Machine Learning · Computer Science 2021-06-18 Wouter M. Kouw , Marco Loog

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel…

Computation and Language · Computer Science 2022-06-17 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

Few-shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta-learning algorithms, and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wei-Yu Chen , Yen-Cheng Liu , Zsolt Kira , Yu-Chiang Frank Wang , Jia-Bin Huang

In contemporary deep learning, a prevalent and effective workflow for solving low-data problems is adapting powerful pre-trained foundation models (FMs) to new tasks via parameter-efficient fine-tuning (PEFT). However, while empirically…

Machine Learning · Computer Science 2025-05-29 Fady Rezk , Royson Lee , Henry Gouk , Timothy Hospedales , Minyoung Kim

Few shot learning aims to solve the data scarcity problem. If there is a domain shift between the test set and the training set, their performance will decrease a lot. This setting is called Cross-domain few-shot learning. However, this is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-21 Fupin Yao

Few-shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long-lasting problem due to the inherent long-tail distribution of real-world data and the urgent demands to cut costs of data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Leng Jiaxu , Chen Taiyue , Gao Xinbo , Yu Yongtao , Wang Ye , Gao Feng , Wang Yue

Few-shot dense retrieval (DR) aims to effectively generalize to novel search scenarios by learning a few samples. Despite its importance, there is little study on specialized datasets and standardized evaluation protocols. As a result,…

Computation and Language · Computer Science 2023-04-13 Si Sun , Yida Lu , Shi Yu , Xiangyang Li , Zhonghua Li , Zhao Cao , Zhiyuan Liu , Deiming Ye , Jie Bao

We propose a visual analytics system to help a user analyze and steer zero-shot learning models. Zero-shot learning has emerged as a viable scenario for categorizing data that consists of no labeled examples, and thus a promising approach…

Human-Computer Interaction · Computer Science 2020-09-14 Saroj Sahoo , Matthew Berger

The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Oindrila Saha , Grant Van Horn , Subhransu Maji

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state-of-the-art pre-trained models typically need fine-tuning on…

Computation and Language · Computer Science 2021-10-13 Rakesh Chada , Pradeep Natarajan

Single-source domain generalization attempts to learn a model on a source domain and deploy it to unseen target domains. Limiting access only to source domain data imposes two key challenges - how to train a model that can generalize and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Nikos Efthymiadis , Giorgos Tolias , Ondřej Chum

Training generative models, such as GANs, on a target domain containing limited examples (e.g., 10) can easily result in overfitting. In this work, we seek to utilize a large source domain for pretraining and transfer the diversity…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Utkarsh Ojha , Yijun Li , Jingwan Lu , Alexei A. Efros , Yong Jae Lee , Eli Shechtman , Richard Zhang

The grammatical analysis of texts in any written language typically involves a number of basic processing tasks, such as tokenization, morphological tagging, and dependency parsing. State-of-the-art systems can achieve high accuracy on…

Computation and Language · Computer Science 2023-01-09 Angelina Aquino , Franz de Leon

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram