中文
相关论文

相关论文: RotoGrad: Gradient Homogenization in Multitask Lea…

200 篇论文

Multi-Task Reinforcement Learning (MTRL) tackles the long-standing problem of endowing agents with skills that generalize across a variety of problems. To this end, sharing representations plays a fundamental role in capturing both unique…

机器学习 · 计算机科学 2024-05-07 Ahmed Hendawy , Jan Peters , Carlo D'Eramo

Semantic segmentation is one of the most fundamental problems in computer vision with significant impact on a wide variety of applications. Adversarial learning is shown to be an effective approach for improving semantic segmentation…

计算机视觉与模式识别 · 计算机科学 2021-01-22 Hadi Jamali-Rad , Attila Szabo

Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task.…

计算与语言 · 计算机科学 2022-01-28 Jixuan Wang , Kuan-Chieh Wang , Frank Rudzicz , Michael Brudno

Developing Audio-Visual Large Language Models (AV-LLMs) for unified scene understanding is pivotal in multimodal intelligence. While instruction tuning enables pre-trained models with multi-task abilities, we observe that conventional…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Dongnuan Cai , Henghui Du , Chang Zhou , Xi Chen , Dan Guo , Hongyuan Zhang , Xuelong Li , Di Hu

Regularization and transfer learning are two popular techniques to enhance generalization on unseen data, which is a fundamental problem of machine learning. Regularization techniques are versatile, as they are task- and…

机器学习 · 计算机科学 2022-02-16 Jeongun Ryu , Jaewoong Shin , Hae Beom Lee , Sung Ju Hwang

Achieving state-of-the-art performance on natural language understanding tasks typically relies on fine-tuning a fresh model for every task. Consequently, this approach leads to a higher overall parameter cost, along with higher technical…

计算与语言 · 计算机科学 2020-07-14 Yi Tay , Zhe Zhao , Dara Bahri , Donald Metzler , Da-Cheng Juan

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

统计方法学 · 统计学 2023-04-27 Akira Okazaki , Shuichi Kawano

Classification is an essential and fundamental task in machine learning, playing a cardinal role in the field of natural language processing (NLP) and computer vision (CV). In a supervised learning setting, labels are always needed for the…

计算与语言 · 计算机科学 2021-02-04 Irene Li

Multimodal meta-learning is a recent problem that extends conventional few-shot meta-learning by generalizing its setup to diverse multimodal task distributions. This setup makes a step towards mimicking how humans make use of a diverse set…

机器学习 · 计算机科学 2021-10-28 Milad Abdollahzadeh , Touba Malekzadeh , Ngai-Man Cheung

Multi-relational graph clustering has demonstrated remarkable success in uncovering underlying patterns in complex networks. Representative methods manage to align different views motivated by advances in contrastive learning. Our empirical…

机器学习 · 计算机科学 2024-07-25 Zhixiang Shen , Haolan He , Zhao Kang

How to mitigate negative transfer in transfer learning is a long-standing and challenging issue, especially in the application of medical image segmentation. Existing methods for reducing negative transfer focus on classification or…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Shutong Duan , Jingyun Yang , Yang Tan , Guoqing Zhang , Yang Li , Xiao-Ping Zhang

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

机器学习 · 计算机科学 2024-10-16 Yuntian Gu , Xuzheng Chen

Multitask learning, i.e. learning several tasks at once with the same neural network, can improve performance in each of the tasks. Designing deep neural network architectures for multitask learning is a challenge: There are many ways to…

神经与进化计算 · 计算机科学 2018-04-19 Jason Liang , Elliot Meyerson , Risto Miikkulainen

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

机器学习 · 计算机科学 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Multi-task learning (MTL) can improve performance on a task by sharing representations with one or more related auxiliary-tasks. Usually, MTL-networks are trained on a composite loss function formed by a constant weighted combination of the…

机器学习 · 计算机科学 2020-08-31 Sam Verboven , Muhammad Hafeez Chaudhary , Jeroen Berrevoets , Wouter Verbeke

Collaborative learning has successfully applied knowledge transfer to guide a pool of small student networks towards robust local minima. However, previous approaches typically struggle with drastically aggravated student homogenization…

机器学习 · 计算机科学 2021-02-23 Shaoxiong Feng , Hongshen Chen , Xuancheng Ren , Zhuoye Ding , Kan Li , Xu Sun

Distance metric learning (DML) plays a crucial role in diverse machine learning algorithms and applications. When the labeled information in target domain is limited, transfer metric learning (TML) helps to learn the metric by leveraging…

机器学习 · 统计学 2019-04-09 Yong Luo , Yonggang Wen , Dacheng Tao

Nowadays, autonomous service robots are becoming an important topic in robotic research. Differently from typical industrial scenarios, with highly controlled environments, service robots must show an additional robustness to task…

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Multi-task learning is effective for related applications, but its performance can deteriorate when the target sample size is small. Transfer learning can borrow strength from related studies; yet, many existing methods rely on restrictive…

机器学习 · 计算机科学 2026-04-23 Boxin Zhao , Mladen Kolar , Jinchi Lv