中文
相关论文

相关论文: Mitigating Negative Transfer with Task Awareness f…

200 篇论文

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

机器学习 · 计算机科学 2021-03-30 Yu Zhang , Qiang Yang

Generative models of language exhibit impressive capabilities but still place non-negligible probability mass over undesirable outputs. In this work, we address the task of updating a model to avoid unwanted outputs while minimally changing…

计算与语言 · 计算机科学 2024-06-21 Lily H. Zhang , Rajesh Ranganath , Arya Tafvizi

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

机器学习 · 计算机科学 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

In recent years, thanks to the rapid development of deep learning (DL), DL-based multi-task learning (MTL) has made significant progress, and it has been successfully applied to recommendation systems (RS). However, in a recommender system,…

信息检索 · 计算机科学 2023-02-13 Jie Zhou , Qian Yu , Chuan Luo , Jing Zhang

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

机器学习 · 计算机科学 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

Measuring task relatedness and mitigating negative transfer remain a critical open challenge in Multitask Learning (MTL). This work extends data attribution -- which quantifies the influence of individual training data points on model…

机器学习 · 计算机科学 2025-05-28 Yiwen Tu , Ziqi Liu , Jiaqi W. Ma , Weijing Tang

Modern multilingual models are trained on concatenated text from multiple languages in hopes of conferring benefits to each (positive transfer), with the most pronounced benefits accruing to low-resource languages. However, recent work has…

计算与语言 · 计算机科学 2020-10-08 Zirui Wang , Zachary C. Lipton , Yulia Tsvetkov

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

计算与语言 · 计算机科学 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Generated hateful and toxic content by a portion of users in social media is a rising phenomenon that motivated researchers to dedicate substantial efforts to the challenging direction of hateful content identification. We not only need an…

社会与信息网络 · 计算机科学 2019-10-29 Marzieh Mozafari , Reza Farahbakhsh , Noel Crespi

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

机器学习 · 计算机科学 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

Multi-task learning (MTL) is a machine learning technique aiming to improve model performance by leveraging information across many tasks. It has been used extensively on various data modalities, including electronic health record (EHR)…

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

计算与语言 · 计算机科学 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

As the functionality of dialogue systems evolves, hybrid dialogue systems that accomplish user-specific goals and participate in open-topic chitchat with users are attracting growing attention. Existing research learns both tasks…

计算与语言 · 计算机科学 2022-12-15 Shimin Li , Qinyuan Cheng , Linyang Li , Xipeng Qiu

Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as…

计算与语言 · 计算机科学 2020-10-06 Farhad Nooralahzadeh , Giannis Bekoulis , Johannes Bjerva , Isabelle Augenstein

Machine translation and other NLP systems often contain significant biases regarding sensitive attributes, such as gender or race, that worsen system performance and perpetuate harmful stereotypes. Recent preliminary research suggests that…

计算与语言 · 计算机科学 2022-03-22 Eve Fleisig , Christiane Fellbaum

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

机器学习 · 统计学 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

机器学习 · 计算机科学 2017-09-21 Davis Liang , Yan Shu

Meta-learning has emerged as an effective methodology to model several real-world tasks and problems due to its extraordinary effectiveness in the low-data regime. There are many scenarios ranging from the classification of rare diseases to…

机器学习 · 计算机科学 2023-12-29 Prabhat Agarwal , Shreya Singh

Weakly Labelled learning has garnered lot of attention in recent years due to its potential to scale Sound Event Detection (SED) and is formulated as Multiple Instance Learning (MIL) problem. This paper proposes a Multi-Task Learning (MTL)…

音频与语音处理 · 电气工程与系统科学 2020-11-02 Soham Deshmukh , Bhiksha Raj , Rita Singh

Multi-Task Learning (MTL) aims at boosting the overall performance of each individual task by leveraging useful information contained in multiple related tasks. It has shown great success in natural language processing (NLP). Currently, a…

计算与语言 · 计算机科学 2020-08-10 Jianquan Li , Xiaokang Liu , Wenpeng Yin , Min Yang , Liqun Ma , Yaohong Jin