English
Related papers

Related papers: Robust Multi-Task Learning with Excess Risks

200 papers

Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it…

Machine Learning · Computer Science 2020-06-03 Sungjae Lee , Youngdoo Son

Developing meta-learning algorithms that are un-biased toward a subset of training tasks often requires hand-designed criteria to weight tasks, potentially resulting in sub-optimal solutions. In this paper, we introduce a new principled and…

Machine Learning · Computer Science 2023-01-05 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

Meta-learning is a general approach to equip machine learning models with the ability to handle few-shot scenarios when dealing with many tasks. Most existing meta-learning methods work based on the assumption that all tasks are of equal…

Machine Learning · Computer Science 2024-10-25 Zhaofeng Si , Shu Hu , Kaiyi Ji , Siwei Lyu

Although recent multi-task learning methods have shown to be effective in improving the generalization of deep neural networks, they should be used with caution for safety-critical applications, such as clinical risk prediction. This is…

Machine Learning · Computer Science 2021-02-19 A. Tuan Nguyen , Hyewon Jeong , Eunho Yang , Sung Ju Hwang

In recent years, Multi-Task Learning (MTL) has attracted much attention due to its good performance in many applications. However, many existing MTL models cannot guarantee that their performance is no worse than their single-task…

Machine Learning · Computer Science 2022-10-04 Zhixiong Yue , Feiyang Ye , Yu Zhang , Christy Liang , Ivor W. Tsang

Multi-task learning has recently emerged as a promising solution for a comprehensive understanding of complex scenes. In addition to being memory-efficient, multi-task models, when appropriately designed, can facilitate the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ivan Lopes , Tuan-Hung Vu , Raoul de Charette

Multi-task learning (MTL) refers to the paradigm of learning multiple related tasks together. In contrast, in single-task learning (STL) each individual task is learned independently. MTL often leads to better trained models because they…

Machine Learning · Statistics 2019-07-03 Jian Liang , Ziqi Liu , Jiayu Zhou , Xiaoqian Jiang , Changshui Zhang , Fei Wang

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

Machine Learning · Computer Science 2018-07-17 Adam Gleave , Oliver Habryka

Anomaly detection in medical images is a challenging task, since anomalies are not typically available during training. Recent methods leverage a single pretext task coupled with a large-scale pre-trained model to reach state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bogdan Alexandru Bercean , Florinel Alin Croitoru , Vlad Hondru , Ciprian Mihai Ceausescu , Andreea Iuliana Ionescu , Radu Tudor Ionescu

Leveraging weak or noisy supervision for building effective machine learning models has long been an important research problem. Its importance has further increased recently due to the growing need for large-scale datasets to train deep…

Machine Learning · Computer Science 2021-08-09 Guoqing Zheng , Ahmed Hassan Awadallah , Susan Dumais

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

Multi-Task Learning (MTL) is a foundational machine learning problem that has seen extensive development over the past decade. Recently, various optimization-based MTL approaches have been proposed to learn multiple tasks simultaneously by…

Machine Learning · Computer Science 2026-04-13 Zhipeng Zhou , Linxiao Cao , Pengcheng Wu , Peilin Zhao , Chunyan Miao

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

Machine Learning · Computer Science 2017-09-21 Davis Liang , Yan Shu

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

Machine Learning · Computer Science 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

By leveraging large amounts of product data collected across hundreds of live e-commerce websites, we construct 1000 unique classification tasks that share similarly-structured input data, comprised of both text and images. These…

Artificial Intelligence · Computer Science 2021-07-29 Cameron R. Wolfe , Keld T. Lundgaard

Given the ubiquity of multi-task in practical systems, Multi-Task Learning (MTL) has found widespread application across diverse domains. In real-world scenarios, these tasks often have different priorities. For instance, In web search,…

Machine Learning · Computer Science 2024-12-17 Zhengxing Cheng , Yuheng Huang , Zhixuan Zhang , Dan Ou , Qingwen Liu

In many personalized recommendation scenarios, the generalization ability of a target task can be improved via learning with additional auxiliary tasks alongside this target task on a multi-task network. However, this method often suffers…

Machine Learning · Computer Science 2022-03-15 Yun He , Xue Feng , Cheng Cheng , Geng Ji , Yunsong Guo , James Caverlee

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Abdullah-Al-Zubaer Imran , Chao Huang , Hui Tang , Wei Fan , Yuan Xiao , Dingjun Hao , Zhen Qian , Demetri Terzopoulos

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, but developing high-performing models for specialized applications often requires substantial human annotation -- a process that is…

Computation and Language · Computer Science 2025-07-30 Abhinav Arabelly , Jagrut Nemade , Robert D Nowak , Jifan Zhang