English
Related papers

Related papers: Transfer Learning for Sequence Labeling Using Sour…

200 papers

Transfer learning (TL) enables the transfer of knowledge gained in learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labeling, potential computational power…

Machine Learning · Computer Science 2022-12-20 Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

The goal of semantic parsing is to map natural language to a machine interpretable meaning representation language (MRL). One of the constraints that limits full exploration of deep learning technologies for semantic parsing is the lack of…

Computation and Language · Computer Science 2017-06-15 Xing Fan , Emilio Monti , Lambert Mathias , Markus Dreyer

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong

Sequence labeling is an important technique employed for many Natural Language Processing (NLP) tasks, such as Named Entity Recognition (NER), slot tagging for dialog systems and semantic parsing. Large-scale pre-trained language models…

Computation and Language · Computer Science 2020-12-14 Yaqing Wang , Subhabrata Mukherjee , Haoda Chu , Yuancheng Tu , Ming Wu , Jing Gao , Ahmed Hassan Awadallah

Transfer learning methods address the situation where little labeled training data from the "target" problem exists, but much training data from a related "source" domain is available. However, the overwhelming majority of transfer learning…

Machine Learning · Computer Science 2017-12-27 Aubrey Gress , Ian Davidson

It is a strong prerequisite to access source data freely in many existing unsupervised domain adaptation approaches. However, source data is agnostic in many practical scenarios due to the constraints of expensive data transmission and data…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Weijie Chen , Luojun Lin , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang , Wenqi Ren

We propose Regularized Learning under Label shifts (RLLS), a principled and a practical domain-adaptation algorithm to correct for shifts in the label distribution between a source and a target domain. We first estimate importance weights…

Machine Learning · Computer Science 2020-08-10 Kamyar Azizzadenesheli , Anqi Liu , Fanny Yang , Animashree Anandkumar

For many text classification tasks, there is a major problem posed by the lack of labeled data in a target domain. Although classifiers for a target domain can be trained on labeled text data from a related source domain, the accuracy of…

Computation and Language · Computer Science 2018-11-06 Radu Tudor Ionescu , Andrei M. Butnaru

Deep neural networks have shown promising results for various clinical prediction tasks such as diagnosis, mortality prediction, predicting duration of stay in hospital, etc. However, training deep networks -- such as those based on…

Machine Learning · Computer Science 2018-07-06 Priyanka Gupta , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Domain adaptation aims to leverage knowledge from a well-labeled source domain to a poorly-labeled target domain. A majority of existing works transfer the knowledge at either feature level or sample level. Recent researches reveal that…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Li Jingjing , Jing Mengmeng , Lu Ke , Zhu Lei , Shen Heng Tao

The prevalence of noisy labels in real-world datasets poses a significant impediment to the effective deployment of deep learning models. While meta-learning strategies have emerged as a promising approach for addressing this challenge,…

Machine Learning · Computer Science 2025-02-12 Mengyang Li

Transfer learning aims at transferring knowledge from a well-labeled domain to a similar but different domain with limited or no labels. Unfortunately, existing learning-based methods often involve intensive model selection and…

Machine Learning · Computer Science 2019-04-11 Jindong Wang , Yiqiang Chen , Han Yu , Meiyu Huang , Qiang Yang

In this paper, we propose the problem of domain transfer structured output learn- ing and the first solution to solve it. The problem is defined on two different data domains sharing the same input and output spaces, named as source domain…

Machine Learning · Computer Science 2014-09-04 Jim Jing-Yan Wang

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

We propose a new framework for binary classification in transfer learning settings where both covariate and label distributions may shift between source and target domains. Unlike traditional covariate shift or label shift assumptions, we…

Methodology · Statistics 2025-09-29 Manli Cheng , Subha Maity , Qinglong Tian , Pengfei Li

Learning with label proportions (LLP), which is a learning task that only provides unlabeled data in bags and each bag's label proportion, has widespread successful applications in practice. However, most of the existing LLP methods don't…

Machine Learning · Computer Science 2019-08-20 Yanshan Xiao , HuaiPei Wang , Bo Liu

The use of transfer learning (TL) techniques has become common practice in fields such as computer vision (CV) and natural language processing (NLP). Leveraging prior knowledge gained from data with different distributions, TL offers higher…

Signal Processing · Electrical Eng. & Systems 2022-06-17 Lauren J. Wong , Sean McPherson , Alan J. Michaels

In this paper, we propose a novel learning framework for the problem of domain transfer learning. We map the data of two domains to one single common space, and learn a classifier in this common space. Then we adapt the common classifier to…

Machine Learning · Computer Science 2016-08-17 Ru-Ze Liang , Wei Xie , Weizhi Li , Hongqi Wang , Jim Jing-Yan Wang , Lisa Taylor

We present two architectures for multi-task learning with neural sequence models. Our approach allows the relationships between different tasks to be learned dynamically, rather than using an ad-hoc pre-defined structure as in previous…

Computation and Language · Computer Science 2018-11-27 Pengfei Liu , Jie Fu , Yue Dong , Xipeng Qiu , Jackie Chi Kit Cheung

In many practical applications, it is often difficult and expensive to obtain large-scale labeled data to train state-of-the-art deep neural networks. Therefore, transferring the learned knowledge from a separate, labeled source domain to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Sicheng Zhao , Hui Chen , Hu Huang , Pengfei Xu , Guiguang Ding