English
Related papers

Related papers: Zero-shot Transfer Learning for Semantic Parsing

200 papers

Few-shot slot tagging is an emerging research topic in the field of Natural Language Understanding (NLU). With sufficient annotated data from source domains, the key challenge is how to train and adapt the model to another target domain…

Computation and Language · Computer Science 2021-09-14 Zezhong Wang , Hongru Wang , Kwan Wai Chung , Jia Zhu , Gabriel Pui Cheong Fung , Kam-Fai Wong

Generalization capability to unseen domains is crucial for machine learning models when deploying to real-world conditions. We investigate the challenging problem of domain generalization, i.e., training a model on multi-domain source data…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Qi Dou , Daniel C. Castro , Konstantinos Kamnitsas , Ben Glocker

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

Computation and Language · Computer Science 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram

This paper addresses the challenge of fault root cause identification in cloud computing environments. The difficulty arises from complex system structures, dense service coupling, and limited fault information. To solve this problem, an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-04 Bruce Fang , Danyi Gao

Transfer learning is an exciting area of Natural Language Processing that has the potential to both improve model performance and increase data efficiency. This study explores the effects of varying quantities of target task training data…

Computation and Language · Computer Science 2022-10-24 Josiah Ross , Luke Yoffe , Alon Albalak , William Yang Wang

This work explores the zero-shot adaptation capability of semantic skills, semantically interpretable experts' behavior patterns, in cross-domain settings, where a user input in interleaved multi-modal snippets can prompt a new long-horizon…

Artificial Intelligence · Computer Science 2024-02-13 Sangwoo Shin , Minjong Yoo , Jeongwoo Lee , Honguk Woo

Measuring the similarity between two different sentential arguments is an important task in argument mining. However, one of the challenges in this field is that the dataset must be annotated using expertise in a variety of topics, making…

Computation and Language · Computer Science 2021-02-22 ChaeHun Park , Sangwoo Seo

Unsupervised domain adaptation for semantic segmentation aims to make models trained on synthetic data (source domain) adapt to real images (target domain). Previous feature-level adversarial learning methods only consider adapting models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Hongruixuan Chen , Chen Wu , Yonghao Xu , Bo Du

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Zero-shot learning (ZSL) has received increasing attention in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. The key to ZSL is to transfer knowledge from the seen to the unseen classes…

Machine Learning · Computer Science 2020-02-12 Zhizhe Liu , Xingxing Zhang , Zhenfeng Zhu , Shuai Zheng , Yao Zhao , Jian Cheng

Zero-Shot Learning (ZSL) learns models for recognizing new classes. One of the main challenges in ZSL is the domain discrepancy caused by the category inconsistency between training and testing data. Domain adaptation is the most intuitive…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Fengmao Lv , Jianyang Zhang , Guowu Yang , Lei Feng , Yufeng Yu , Lixin Duan

Negative transfer in training of acoustic models for automatic speech recognition has been reported in several contexts such as domain change or speaker characteristics. This paper proposes a novel technique to overcome negative transfer by…

Machine Learning · Computer Science 2015-09-18 Mortaza Doulaty , Oscar Saz , Thomas Hain

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

How can we reuse existing knowledge, in the form of available datasets, when solving a new and apparently unrelated target task from a set of unlabeled data? In this work we make a first contribution to answer this question in the context…

Computer Vision and Pattern Recognition · Computer Science 2015-10-07 Efstratios Gavves , Thomas Mensink , Tatiana Tommasi , Cees G. M. Snoek , Tinne Tuytelaars

Text style transfer without parallel data has achieved some practical success. However, in the scenario where less data is available, these methods may yield poor performance. In this paper, we examine domain adaptation for text style…

Computation and Language · Computer Science 2019-08-27 Dianqi Li , Yizhe Zhang , Zhe Gan , Yu Cheng , Chris Brockett , Ming-Ting Sun , Bill Dolan

Zero-shot learning for visual recognition, e.g., object and action recognition, has recently attracted a lot of attention. However, it still remains challenging in bridging the semantic gap between visual features and their underlying…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Qian Wang , Ke Chen

Most approaches in few-shot learning rely on costly annotated data related to the goal task domain during (pre-)training. Recently, unsupervised meta-learning methods have exchanged the annotation requirement for a reduction in few-shot…

Machine Learning · Computer Science 2020-06-23 Carlos Medina , Arnout Devos , Matthias Grossglauser

The ultimate goal of transfer learning is to reduce labeled data requirements by exploiting a pre-existing embedding model trained for different datasets or tasks. The visual and language communities have established benchmarks to compare…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-11 Joel Shor , Aren Jansen , Ronnie Maor , Oran Lang , Omry Tuval , Felix de Chaumont Quitry , Marco Tagliasacchi , Ira Shavitt , Dotan Emanuel , Yinnon Haviv

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney