English
Related papers

Related papers: Modelling Domain Relationships for Transfer Learni…

200 papers

Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has…

Machine Learning · Statistics 2023-12-22 Piotr M. Suder , Jason Xu , David B. Dunson

This study proposes a novel way of identifying the sentiment of the phrases used in the legal domain. The added complexity of the language used in law, and the inability of the existing systems to accurately predict the sentiments of words…

Computation and Language · Computer Science 2018-10-05 Viraj Gamage , Menuka Warushavithana , Nisansa de Silva , Amal Shehan Perera , Gathika Ratnayaka , Thejan Rupasinghe

Unsupervised domain adaptation has recently emerged as an effective paradigm for generalizing deep neural networks to new target domains. However, there is still enormous potential to be tapped to reach the fully supervised performance. In…

Machine Learning · Computer Science 2022-03-10 Binhui Xie , Longhui Yuan , Shuang Li , Chi Harold Liu , Xinjing Cheng , Guoren Wang

Getting deep convolutional neural networks to perform well requires a large amount of training data. When the available labelled data is small, it is often beneficial to use transfer learning to leverage a related larger dataset (source) in…

Machine Learning · Computer Science 2021-10-26 Lukas Hedegaard Morsing , Omar Ali Sheikh-Omar , Alexandros Iosifidis

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza

Many machine intelligence techniques are developed in E-commerce and one of the most essential components is the representation of IDs, including user ID, item ID, product ID, store ID, brand ID, category ID etc. The classical encoding…

Machine Learning · Computer Science 2018-05-23 Kui Zhao , Yuechuan Li , Zhaoqian Shuai , Cheng Yang

Domain adaptation, adapting models from domains rich in labeled training data to domains poor in such data, is a fundamental NLP challenge. We introduce a neural network model that marries together ideas from two prominent strands of…

Computation and Language · Computer Science 2017-06-20 Yftah Ziser , Roi Reichart

Domain adaptation has been a fundamental technology for transferring knowledge from a source domain to a target domain. The key issue of domain adaptation is how to reduce the distribution discrepancy between two domains in a proper way…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Lei Tian , Yongqiang Tang , Liangchen Hu , Zhida Ren , Wensheng Zhang

Transfer learning is known to perform efficiently in many applications empirically, yet limited literature reports the mechanism behind the scene. This study establishes both formal derivations and heuristic analysis to formulate the theory…

Machine Learning · Computer Science 2023-05-10 Huan-Hsin Tseng , Hsin-Yi Lin , Kuo-Hsuan Hung , Yu Tsao

Supervised learning models are typically trained on a single dataset and the performance of these models rely heavily on the size of the dataset, i.e., amount of data available with the ground truth. Learning algorithms try to generalize…

Computation and Language · Computer Science 2018-02-19 Somnath Basu Roy Chowdhury , K M Annervaz , Ambedkar Dukkipati

Transfer learning, where a model is first pre-trained on a data-rich task before being fine-tuned on a downstream task, has emerged as a powerful technique in natural language processing (NLP). The effectiveness of transfer learning has…

Machine Learning · Computer Science 2023-09-20 Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , Peter J. Liu

One of the difficulties in training dialogue systems is the lack of training data. We explore the possibility of creating dialogue data through the interaction between a dialogue system and a user simulator. Our goal is to develop a…

Computation and Language · Computer Science 2021-07-27 Bo-Hsiang Tseng , Yinpei Dai , Florian Kreyssig , Bill Byrne

Aided target recognition (AiTR), the problem of classifying objects from sensor data, is an important problem with applications across industry and defense. While classification algorithms continue to improve, they often require more…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Samuel Rivera , Olga Mendoza-Schrock , Ashley Diehl

Reading comprehension is a challenging task in natural language processing and requires a set of skills to be solved. While current approaches focus on solving the task as a whole, in this paper, we propose to use a neural network `skill'…

Computation and Language · Computer Science 2017-11-13 Todor Mihaylov , Zornitsa Kozareva , Anette Frank

In recent years, researchers have been paying increasing attention to the threats brought by deep learning models to data security and privacy, especially in the field of domain adaptation. Existing unsupervised domain adaptation (UDA)…

Machine Learning · Computer Science 2021-08-31 Kunhong Wu , Yucheng Shi , Yahong Han , Yunfeng Shao , Bingshuai Li , Qi Tian

We address the problem of visual knowledge adaptation by leveraging labeled patterns from source domain and a very limited number of labeled instances in target domain to learn a robust classifier for visual categorization. This paper…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Lei Zhang , David Zhang

Transfer of pre-trained representations can improve sample efficiency and reduce computational requirements for new tasks. However, representations used for transfer are usually generic, and are not tailored to a particular distribution of…

Transfer learning is an exciting area of Natural Language Processing that has the potential to both improve model performance and increase data efficiency. This study explores the effects of varying quantities of target task training data…

Computation and Language · Computer Science 2022-10-24 Josiah Ross , Luke Yoffe , Alon Albalak , William Yang Wang

While unsupervised domain adaptation methods based on deep architectures have achieved remarkable success in many computer vision tasks, they rely on a strong assumption, i.e. labeled source data must be available. In this work we overcome…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Willi Menapace , Stéphane Lathuilière , Elisa Ricci

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand