English
Related papers

Related papers: Multitask Protein Function Prediction Through Task…

200 papers

Predicting node labels on a given graph is a widely studied problem with many applications, including community detection and molecular graph prediction. This paper considers predicting multiple node labeling functions on graphs…

Machine Learning · Computer Science 2024-03-18 Dongyue Li , Haotian Ju , Aneesh Sharma , Hongyang R. Zhang

Foundation models have emerged as a powerful tool for many AI problems. Despite the tremendous success of foundation models, effective adaptation to new tasks, particularly those with limited labels, remains an open question and lacks…

Machine Learning · Computer Science 2024-02-26 Zhuoyan Xu , Zhenmei Shi , Junyi Wei , Fangzhou Mu , Yin Li , Yingyu Liang

This paper introduces self-paced task selection to multitask learning, where instances from more closely related tasks are selected in a progression of easier-to-harder tasks, to emulate an effective human education strategy, but applied to…

Machine Learning · Statistics 2017-06-20 Keerthiram Murugesan , Jaime Carbonell

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

Despite the popularity of Model Compression and Multitask Learning, how to effectively compress a multitask model has been less thoroughly analyzed due to the challenging entanglement of tasks in the parameter space. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Xinglong Sun , Ali Hassani , Zhangyang Wang , Gao Huang , Humphrey Shi

Multitask learning (MTL) aims to learn multiple tasks simultaneously through the interdependence between different tasks. The way to measure the relatedness between tasks is always a popular issue. There are mainly two ways to measure…

Machine Learning · Computer Science 2019-04-04 Ya Li , Xinmei Tian , Tongliang Liu , Dacheng Tao

This article conducts a large dimensional study of a simple yet quite versatile classification model, encompassing at once multi-task and semi-supervised learning, and taking into account uncertain labeling. Using tools from random matrix…

Machine Learning · Statistics 2024-02-22 Victor Leger , Romain Couillet

Protein function prediction is a pivotal task in drug discovery, significantly impacting the development of effective and safe therapeutics. Traditional machine learning models often struggle with the complexity and variability inherent in…

Machine Learning · Computer Science 2024-09-24 Bohao Xu , Yingzhou Lu , Yoshitaka Inoue , Namkyeong Lee , Tianfan Fu , Jintai Chen

The reinforcement learning community has made great strides in designing algorithms capable of exceeding human performance on specific tasks. These algorithms are mostly trained one task at the time, each new task requiring to train a brand…

Machine Learning · Computer Science 2018-09-13 Matteo Hessel , Hubert Soyer , Lasse Espeholt , Wojciech Czarnecki , Simon Schmitt , Hado van Hasselt

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

Computation and Language · Computer Science 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

This paper investigates the use of nonparametric kernel-regression to obtain a tasksimilarity aware meta-learning algorithm. Our hypothesis is that the use of tasksimilarity helps meta-learning when the available tasks are limited and may…

Machine Learning · Computer Science 2020-10-13 Arun Venkitaraman , Anders Hansson , Bo Wahlberg

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed

Recent advances in meta-learning has led to remarkable performances on several few-shot learning benchmarks. However, such success often ignores the similarity between training and testing tasks, resulting in a potential bias evaluation.…

Machine Learning · Computer Science 2021-01-28 Cuong Nguyen , Thanh-Toan Do , Gustavo Carneiro

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

Machine Learning · Computer Science 2022-07-05 Guangji Bai , Liang Zhao

Multi-task learning (MTL) has recently contributed to learning better representations in service of various NLP tasks. MTL aims at improving the performance of a primary task, by jointly training on a secondary task. This paper introduces…

Machine Learning · Computer Science 2017-09-21 Davis Liang , Yan Shu

Large language models achieve high performance on many but not all downstream tasks. The interaction between pretraining data and task data is commonly assumed to determine this variance: a task with data that is more similar to a model's…

Computation and Language · Computer Science 2023-11-16 Gregory Yauney , Emily Reif , David Mimno

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

Multi-task learning is an open and challenging problem in computer vision. The typical way of conducting multi-task learning with deep neural networks is either through handcrafted schemes that share all initial layers and branch out at an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Ximeng Sun , Rameswar Panda , Rogerio Feris , Kate Saenko

BACKGROUND: One of the most evident achievements of bioinformatics is the development of methods that transfer biological knowledge from characterised proteins to uncharacterised sequences. This mode of protein function assignment is mostly…

Quantitative Methods · Quantitative Biology 2007-09-28 Emmanuel D. Levy , Christos A. Ouzounis , Walter R. Gilks , Benjamin Audit

We study the benefit of sharing representations among tasks to enable the effective use of deep neural networks in Multi-Task Reinforcement Learning. We leverage the assumption that learning from different tasks, sharing common properties,…

Machine Learning · Computer Science 2024-01-19 Carlo D'Eramo , Davide Tateo , Andrea Bonarini , Marcello Restelli , Jan Peters