English
Related papers

Related papers: Leveraging convergence behavior to balance conflic…

200 papers

Meta-learning enables algorithms to quickly learn a newly encountered task with just a few labeled examples by transferring previously learned knowledge. However, the bottleneck of current meta-learning algorithms is the requirement of a…

Machine Learning · Computer Science 2022-03-18 Huaxiu Yao , Linjun Zhang , Chelsea Finn

Time-series representation learning can extract representations from data with temporal dynamics and sparse labels. When labeled data are sparse but unlabeled data are abundant, contrastive learning, i.e., a framework to learn a latent…

Machine Learning · Computer Science 2023-03-03 Heejeong Choi , Pilsung Kang

Multi-task learning (MTL) aims at solving multiple related tasks simultaneously and has experienced rapid growth in recent years. However, MTL models often suffer from performance degeneration with negative transfer due to learning several…

Machine Learning · Computer Science 2023-02-01 Xin Dong , Ruize Wu , Chao Xiong , Hai Li , Lei Cheng , Yong He , Shiyou Qian , Jian Cao , Linjian Mo

We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential…

Machine Learning · Computer Science 2019-12-10 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

In this work we consider multitasking in the context of solving multiple optimization problems simultaneously by conducting a single search process. The principal goal when dealing with this scenario is to dynamically exploit the existing…

Neural and Evolutionary Computing · Computer Science 2021-08-20 Eneko Osaba , Aritz D. Martinez , Javier Del Ser

Multi-task learning is a popular machine learning approach that enables simultaneous learning of multiple related tasks, improving algorithmic efficiency and effectiveness. In the hard parameter sharing approach, an encoder shared through…

Machine Learning · Statistics 2024-09-26 Seokwon Shin , Hyungrok Do , Youngdoo Son

Auxiliary learning is an effective method for enhancing the generalization capabilities of trained models, particularly when dealing with small datasets. However, this approach may present several difficulties: (i) optimizing multiple…

Machine Learning · Computer Science 2023-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Kenji Kawaguchi , Gal Chechik , Ethan Fetaya

Multi-party learning provides solutions for training joint models with decentralized data under legal and practical constraints. However, traditional multi-party learning approaches are confronted with obstacles such as system…

Machine Learning · Computer Science 2021-05-26 Yuan Gao , Jiawei Li , Maoguo Gong , Yu Xie , A. K. Qin

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

Real-world decision-making tasks are generally complex, requiring trade-offs between multiple, often conflicting, objectives. Despite this, the majority of research in reinforcement learning and decision-theoretic planning either assumes…

Multi-task learning (MTL) has been widely applied in online advertising and recommender systems. To address the negative transfer issue, recent studies have proposed optimization methods that thoroughly focus on the gradient alignment of…

Information Retrieval · Computer Science 2023-03-13 Xuanhua Yang , Jianxin Zhao , Shaoguo Liu , Liang Wang , Bo Zheng

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

As an effective learning paradigm against insufficient training samples, Multi-Task Learning (MTL) encourages knowledge sharing across multiple related tasks so as to improve the overall performance. In MTL, a major challenge springs from…

Machine Learning · Computer Science 2020-04-30 Zhiyong Yang , Qianqian Xu , Xiaochun Cao , Qingming Huang

With the popularity of massive open online courses, grading through crowdsourcing has become a prevalent approach towards large scale classes. However, for getting grades for complex tasks, which require specific skills and efforts for…

Artificial Intelligence · Computer Science 2017-03-31 Lingyu Lyu , Mehmed Kantardzic

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Machine Learning · Computer Science 2024-05-17 Han Cao , Sivanesan Rajan , Bianka Hahn , Ersoy Kocak , Daniel Durstewitz , Emanuel Schwarz , Verena Schneider-Lindner

Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task…

Machine Learning · Computer Science 2018-06-13 Elliot Meyerson , Risto Miikkulainen

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

Multitask learning has shown promising performance in many applications and many multitask models have been proposed. In order to identify an effective multitask model for a given multitask problem, we propose a learning framework called…

Machine Learning · Computer Science 2018-05-22 Yu Zhang , Ying Wei , Qiang Yang

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

Machine Learning · Computer Science 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun
‹ Prev 1 8 9 10 Next ›