English
Related papers

Related papers: Multi-task Bias-Variance Trade-off Through Functio…

200 papers

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

Machine Learning · Computer Science 2022-07-05 Guangji Bai , Liang Zhao

Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a…

Neural and Evolutionary Computing · Computer Science 2023-04-25 William G. La Cava

In Multi-Task Learning (MTL), it is a common practice to train multi-task networks by optimizing an objective function, which is a weighted average of the task-specific objective functions. Although the computational advantages of this…

Machine Learning · Computer Science 2022-07-19 Lucas Pascal , Pietro Michiardi , Xavier Bost , Benoit Huet , Maria A. Zuluaga

In multi-task learning, a learner is given a collection of prediction tasks and needs to solve all of them. In contrast to previous work, which required that annotated training data is available for all tasks, we consider a new setting, in…

Machine Learning · Statistics 2017-06-09 Anastasia Pentina , Christoph H. Lampert

Continual and multi-task learning are common machine learning approaches to learning from multiple tasks. The existing works in the literature often assume multi-task learning as a sensible performance upper bound for various continual…

Machine Learning · Computer Science 2022-10-27 Zihao Wu , Huy Tran , Hamed Pirsiavash , Soheil Kolouri

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

Machine Learning · Computer Science 2024-06-14 Jiawei Huang , Niao He

In multi-task learning several related tasks are considered simultaneously, with the hope that by an appropriate sharing of information across tasks, each task may benefit from the others. In the context of learning linear functions for…

Machine Learning · Computer Science 2008-09-12 Laurent Jacob , Francis Bach , Jean-Philippe Vert

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

Machine Learning · Computer Science 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot

Meta-learning aims to extract useful inductive biases from a set of related datasets. In Bayesian meta-learning, this is typically achieved by constructing a prior distribution over neural network parameters. However, specifying families of…

Machine Learning · Computer Science 2023-06-13 Krunoslav Lehman Pavasovic , Jonas Rothfuss , Andreas Krause

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Hal Daume

Multi--task learning seeks to improve the generalization error by leveraging the common information shared by multiple related tasks. One challenge in multi--task learning is identifying formulations capable of uncovering the common…

Machine Learning · Computer Science 2026-03-06 Ayed M. Alrashdi , Oussama Dhifallah , Houssem Sifaou

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2014-08-12 Hal Daume

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2009-07-07 Hal Daumé

One of the challenges in applying reinforcement learning in a complex real-world environment lies in providing the agent with a sufficiently detailed reward function. Any misalignment between the reward and the desired behavior can result…

Machine Learning · Computer Science 2025-10-24 Neta Glazer , Aviv Navon , Aviv Shamsian , Ethan Fetaya

We study the problem of multiset prediction. The goal of multiset prediction is to train a predictor that maps an input to a multiset consisting of multiple items. Unlike existing problems in supervised learning, such as classification,…

Machine Learning · Computer Science 2018-10-29 Sean Welleck , Zixin Yao , Yu Gai , Jialin Mao , Zheng Zhang , Kyunghyun Cho

Continual learning is inherently a constrained learning problem. The goal is to learn a predictor under a no-forgetting requirement. Although several prior studies formulate it as such, they do not solve the constrained problem explicitly.…

Machine Learning · Computer Science 2024-06-03 Juan Elenter , Navid NaderiAlizadeh , Tara Javidi , Alejandro Ribeiro

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

Machine Learning · Computer Science 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li