中文
相关论文

相关论文: Modelling Domain Relationships for Transfer Learni…

200 篇论文

Transfer learning aims to leverage knowledge from pre-trained models to benefit the target task. Prior transfer learning work mainly transfers from a single model. However, with the emergence of deep models pre-trained from different…

机器学习 · 计算机科学 2022-11-07 Yang Shu , Zhangjie Cao , Ziyang Zhang , Jianmin Wang , Mingsheng Long

We present an algorithm that learns to imitate expert behavior and can transfer to previously unseen domains without retraining. Such an algorithm is extremely relevant in real-world applications such as robotic learning because 1) reward…

机器学习 · 计算机科学 2023-10-11 Alvaro Cauderan , Gauthier Boeshertz , Florian Schwarb , Calvin Zhang

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

计算机视觉与模式识别 · 计算机科学 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Transfer learning refers to the transfer of knowledge or information from a relevant source task to a target task. However, most existing works assume both tasks are sampled from a stationary task distribution, thereby leading to the…

机器学习 · 计算机科学 2022-07-06 Jun Wu , Jingrui He

Spoken language understanding (SLU) is a key component of task-oriented dialogue systems. SLU parses natural language user utterances into semantic frames. Previous work has shown that incorporating context information significantly…

计算与语言 · 计算机科学 2020-03-04 Qian Chen , Zhu Zhuo , Wen Wang , Qiuyun Xu

Transfer learning enhances learning across tasks, by leveraging previously learned representations -- if they are properly chosen. We describe an efficient method to accurately estimate the appropriateness of a previously trained model for…

Accurate recognition of personally identifiable information (PII) is central to automated text anonymization. This paper investigates the effectiveness of cross-domain model transfer, multi-domain data fusion, and sample-efficient learning…

计算与语言 · 计算机科学 2026-01-13 Junhong Ye , Xu Yuan , Xinying Qiu

Transfer learning refers to the process of adapting a model trained on a source task to a target task. While kernel methods are conceptually and computationally simple machine learning models that are competitive on a variety of tasks, it…

机器学习 · 计算机科学 2022-11-02 Adityanarayanan Radhakrishnan , Max Ruiz Luyten , Neha Prasad , Caroline Uhler

Neural Transfer Learning (TL) is becoming ubiquitous in Natural Language Processing (NLP), thanks to its high performance on many tasks, especially in low-resourced scenarios. Notably, TL is widely used for neural domain adaptation to…

计算与语言 · 计算机科学 2021-06-10 Sara Meftah , Nasredine Semmar , Youssef Tamaazousti , Hassane Essafi , Fatiha Sadat

In recent years, deep neural networks have emerged as a dominant machine learning tool for a wide variety of application domains. However, training a deep neural network requires a large amount of labeled data, which is an expensive process…

计算机视觉与模式识别 · 计算机科学 2017-06-26 Hemanth Venkateswara , Jose Eusebio , Shayok Chakraborty , Sethuraman Panchanathan

In the recommendation systems, there are multiple business domains to meet the diverse interests and needs of users, and the click-through rate(CTR) of each domain can be quite different, which leads to the demand for CTR prediction…

信息检索 · 计算机科学 2023-06-30 Wei Zhang , Pengye Zhang , Bo Zhang , Xingxing Wang , Dong Wang

Pre-training a deep neural network on the ImageNet dataset is a common practice for training deep learning models, and generally yields improved performance and faster training times. The technique of pre-training on one task and then…

机器学习 · 计算机科学 2020-01-03 Nishai Kooverjee , Steven James , Terence van Zyl

Measuring the similarity between two different sentential arguments is an important task in argument mining. However, one of the challenges in this field is that the dataset must be annotated using expertise in a variety of topics, making…

计算与语言 · 计算机科学 2021-02-22 ChaeHun Park , Sangwoo Seo

The high prevalence of depression in society has given rise to the need for new digital tools to assist in its early detection. To this end, existing research has mainly focused on detecting depression in the domain of social media, where…

计算与语言 · 计算机科学 2022-04-25 Petr Lorenc , Ana-Sabina Uban , Paolo Rosso , Jan Šedivý

Transfer learning aims at transferring knowledge from a well-labeled domain to a similar but different domain with limited or no labels. Unfortunately, existing learning-based methods often involve intensive model selection and…

机器学习 · 计算机科学 2019-04-11 Jindong Wang , Yiqiang Chen , Han Yu , Meiyu Huang , Qiang Yang

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

机器学习 · 计算机科学 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

机器学习 · 计算机科学 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Most Transformer language models are primarily pretrained on English text, limiting their use for other languages. As the model sizes grow, the performance gap between English and other languages with fewer compute and data resources…

计算与语言 · 计算机科学 2023-01-24 Malte Ostendorff , Georg Rehm

The meaning of a word often varies depending on its usage in different domains. The standard word embedding models struggle to represent this variation, as they learn a single global representation for a word. We propose a method to learn…

计算与语言 · 计算机科学 2019-10-22 Lahari Poddar , Gyorgy Szarvas , Lea Frermann

Current generative-based dialogue systems are data-hungry and fail to adapt to new unseen domains when only a small amount of target data is available. Additionally, in real-world applications, most domains are underrepresented, so there is…

计算与语言 · 计算机科学 2021-02-23 Rui Ribeiro , Alberto Abad , José Lopes