中文
相关论文

相关论文: Injecting Imbalance Sensitivity for Multi-Task Lea…

200 篇论文

Numerous deep learning applications benefit from multi-task learning with multiple regression and classification objectives. In this paper we make the observation that the performance of such systems is strongly dependent on the relative…

计算机视觉与模式识别 · 计算机科学 2018-04-25 Alex Kendall , Yarin Gal , Roberto Cipolla

This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Richa Upadhyay , Prakash Chandra Chhipa , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

In this paper, we empirically study the optimization dynamics of multi-task learning, particularly focusing on those that govern a collection of tasks with significant data imbalance. We present a simple yet effective method of pre-training…

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

机器学习 · 计算机科学 2020-09-22 Michael Crawshaw

Multi-label class-incremental learning (MLCIL) is essential for real-world multi-label applications, allowing models to learn new labels while retaining previously learned knowledge continuously. However, recent MLCIL approaches can only…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Kaile Du , Yifan Zhou , Fan Lyu , Yuyang Li , Junzhou Xie , Yixi Shen , Fuyuan Hu , Guangcan Liu

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

机器学习 · 计算机科学 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily annotated when streamed…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Eden Belouadah , Adrian Popescu , Umang Aggarwal , Léo Saci

Multi-task learning (MTL) is a novel framework to learn several tasks simultaneously with a single shared network where each task has its distinct personalized header network for fine-tuning. MTL can be implemented in federated learning…

机器学习 · 计算机科学 2022-03-28 Matin Mortaheb , Cemil Vahapoglu , Sennur Ulukus

There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many…

机器学习 · 计算机科学 2023-10-09 Xinyu Yang , Huaxiu Yao , Allan Zhou , Chelsea Finn

Jointly learning multiple tasks with a unified model can improve accuracy and data efficiency, but it faces the challenge of task interference, where optimizing one task objective may inadvertently compromise the performance of another. A…

Multi-task learning (MTL) is useful for domains in which data originates from multiple sources that are individually under-sampled. MTL methods are able to learn classification models that have higher performance as compared to learning a…

计算机视觉与模式识别 · 计算机科学 2016-08-02 Bilal Ahmed , Thomas Thesen , Karen E. Blackmon , Ruben Kuzniecky , Orrin Devinsky , Jennifer G. Dy , Carla E. Brodley

Measuring task relatedness and mitigating negative transfer remain a critical open challenge in Multitask Learning (MTL). This work extends data attribution -- which quantifies the influence of individual training data points on model…

机器学习 · 计算机科学 2025-05-28 Yiwen Tu , Ziqi Liu , Jiaqi W. Ma , Weijing Tang

Real-world image super-resolution (Real-SR) is a challenging problem due to the complex degradation patterns in low-resolution images. Unlike approaches that assume a broadly encompassing degradation space, we focus specifically on…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Shuchen Lin , Mingtao Feng , Weisheng Dong , Fangfang Wu , Jianqiao Luo , Yaonan Wang , Guangming Shi

The classical approach to non-linear regression in physics, is to take a mathematical model describing the functional dependence of the dependent variable from a set of independent variables, and then, using non-linear fitting algorithms,…

机器学习 · 计算机科学 2020-07-29 Umberto , Michelucci , Francesca Venturini

Multi-Task Learning (MTL) aims to learn multiple tasks simultaneously while exploiting their mutual relationships. By using shared resources to simultaneously calculate multiple outputs, this learning paradigm has the potential to have…

机器学习 · 计算机科学 2024-08-29 Maxime Fontana , Michael Spratling , Miaojing Shi

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

机器学习 · 计算机科学 2018-07-17 Adam Gleave , Oliver Habryka

When modeling class-imbalanced data, it is crucial to address the imbalance, as models trained on such data tend to be biased towards the majority classes. This problem is amplified under partial supervision, where pseudo-labels for…

机器学习 · 统计学 2026-05-08 Heegeon Yoon , Heeyoung Kim

In order to create machine learning systems that serve a variety of users well, it is vital to not only achieve high average performance but also ensure equitable outcomes across diverse groups. However, most machine learning methods are…

机器学习 · 计算机科学 2024-03-01 Atharva Kulkarni , Lucio Dery , Amrith Setlur , Aditi Raghunathan , Ameet Talwalkar , Graham Neubig

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

机器学习 · 计算机科学 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

机器学习 · 计算机科学 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis