中文
相关论文

相关论文: Deep Mutual Learning across Task Towers for Effect…

200 篇论文

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

机器学习 · 计算机科学 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different…

多智能体系统 · 计算机科学 2024-10-07 Lingzhou Hong , Alfredo Garcia

Jointly learning multiple tasks with a unified model can improve accuracy and data efficiency, but it faces the challenge of task interference, where optimizing one task objective may inadvertently compromise the performance of another. A…

Implicit sentiment analysis is challenging because sentiment toward an aspect is often inferred from events rather than expressed through explicit opinion words. Existing models typically learn from the final polarity label, which provides…

计算与语言 · 计算机科学 2026-05-21 Yaping Chai , Haoran Xie , Joe S. Qin

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

人工智能 · 计算机科学 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

机器学习 · 计算机科学 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht

This paper explores learned-context neural networks. It is a multi-task learning architecture based on a fully shared neural network and an augmented input vector containing trainable task parameters. The architecture is interesting due to…

机器学习 · 计算机科学 2025-08-07 Anders T. Sandnes , Bjarne Grimstad , Odd Kolbjørnsen

We consider the problem of decentralized deep learning where multiple agents collaborate to learn from a distributed dataset. While there exist several decentralized deep learning approaches, the majority consider a central parameter-server…

机器学习 · 计算机科学 2020-12-01 Aditya Balu , Zhanhong Jiang , Sin Yong Tan , Chinmay Hedge , Young M Lee , Soumik Sarkar

Multitask learning, i.e. learning several tasks at once with the same neural network, can improve performance in each of the tasks. Designing deep neural network architectures for multitask learning is a challenge: There are many ways to…

神经与进化计算 · 计算机科学 2018-04-19 Jason Liang , Elliot Meyerson , Risto Miikkulainen

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

最优化与控制 · 数学 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

Deep neural network based recommendation systems have achieved great success as information filtering techniques in recent years. However, since model training from scratch requires sufficient data, deep learning-based recommendation…

信息检索 · 计算机科学 2022-06-10 Chunyang Wang , Yanmin Zhu , Haobing Liu , Tianzi Zang , Jiadi Yu , Feilong Tang

Click-Through Rate (CTR) prediction has become an essential task in digital industries, such as digital advertising or online shopping. Many deep learning-based methods have been implemented and have become state-of-the-art models in the…

信息检索 · 计算机科学 2024-06-19 Ibrahim Can Yilmaz , Said Aldemir

In this paper, we present a new MTL framework that searches for structures optimized for multiple tasks with diverse graph topologies and shares features among tasks. We design a restricted DAG-based central network with read-in/read-out…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Wonhyeok Choi , Sunghoon Im

Multi-task learning leverages potential correlations among related tasks to extract common features and yield performance gains. However, most previous works only consider simple or weak interactions, thereby failing to model complex…

计算与语言 · 计算机科学 2017-07-11 Honglun Zhang , Liqiang Xiao , Yongkun Wang , Yaohui Jin

Personalized learning is a student-centered educational approach that adapts content, pace, and assessment to meet each learner's unique needs. As the key technique to implement the personalized learning, learning path recommendation…

信息检索 · 计算机科学 2025-07-09 Afsana Nasrin , Lijun Qian , Pamela Obiomon , Xishuang Dong

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

机器学习 · 计算机科学 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun

Deep learning methods have predominantly been applied to large artificial neural networks. Despite their state-of-the-art performance, these large networks typically do not generalize well to datasets with limited sample sizes. In this…

机器学习 · 统计学 2016-11-17 Eric Strobl , Shyam Visweswaran

Multi-task learning (MTL) has achieved great success in various research domains, such as CV, NLP and IR etc. Due to the complex and competing task correlation, naive training all tasks may lead to inequitable learning, i.e. some tasks are…

机器学习 · 计算机科学 2023-06-21 Jun Yuan , Rui Zhang

In industrial recommendation systems, multi-task learning (learning multiple tasks simultaneously on a single model) is a predominant approach to save training/serving resources and improve recommendation performance via knowledge transfer…