English
Related papers

Related papers: Massively Multitask Networks for Drug Discovery

200 papers

Metadata are general characteristics of the data in a well-curated and condensed format, and have been proven to be useful for decision making, knowledge discovery, and also heterogeneous data organization of biobank. Among all data types…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Wei-Hung Weng , Yuannan Cai , Angela Lin , Fraser Tan , Po-Hsuan Cameron Chen

Modern discriminative predictors have been shown to match natural intelligences in specific perceptual tasks in image classification, object and part detection, boundary extraction, etc. However, a major advantage that natural intelligences…

Machine Learning · Statistics 2016-11-30 Hakan Bilen , Andrea Vedaldi

We present methods for multi-task learning that take advantage of natural groupings of related tasks. Task groups may be defined along known properties of the tasks, such as task domain or language. Such task groups represent supervised…

Computation and Language · Computer Science 2019-07-04 Shiva Pentyala , Mengwen Liu , Markus Dreyer

Multi-task learning (MTL) is a powerful approach in deep learning that leverages the information from multiple tasks during training to improve model performance. In medical imaging, MTL has shown great potential to solve various tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sangwook Kim , Thomas G. Purdie , Chris McIntosh

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2014-08-12 Hal Daume

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2009-07-07 Hal Daumé

Multi-task learning (MTL) in deep neural networks for NLP has recently received increasing interest due to some compelling benefits, including its potential to efficiently regularize models and to reduce the need for labeled data. While it…

Computation and Language · Computer Science 2017-02-28 Joachim Bingel , Anders Søgaard

Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely…

Robotics · Computer Science 2026-02-03 Ozgur Erkent

We study three general multi-task learning (MTL) approaches on 11 sequence tagging tasks. Our extensive empirical results show that in about 50% of the cases, jointly learning all 11 tasks improves upon either independent or pairwise…

Computation and Language · Computer Science 2018-08-14 Soravit Changpinyo , Hexiang Hu , Fei Sha

In post-disaster scenarios, efficient search and rescue operations involve collaborative efforts between robots and humans. Existing planning approaches focus on specific aspects but overlook crucial elements like information gathering,…

Robotics · Computer Science 2023-09-25 Hamid Osooli , Paul Robinette , Kshitij Jerath , S. Reza Ahmadzadeh

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Deep neural networks have achieved impressive performance in various areas, but they are shown to be vulnerable to adversarial attacks. Previous works on adversarial attacks mainly focused on the single-task setting. However, in real…

Machine Learning · Computer Science 2020-11-20 Pengxin Guo , Yuancheng Xu , Baijiong Lin , Yu Zhang

While large language models (LLMs) have demonstrated superior multi-task capabilities, understanding the learning mechanisms behind this is still a challenging problem. In this paper, we attempt to understand such mechanisms from the…

Computation and Language · Computer Science 2025-01-14 Yongqi Leng , Deyi Xiong

In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Konstantinos Spathis , Nikolaos Kardaris , Petros Maragos

Major depressive disorder (MDD) requires study of brain functional connectivity alterations for patients, which can be uncovered by resting-state functional magnetic resonance imaging (rs-fMRI) data. We consider the problem of identifying…

Machine Learning · Statistics 2022-06-10 Shuai Liu , Yixuan Qiu , Baojuan Li , Huaning Wang , Xiangyu Chang

Multi-task learning has the potential to improve generalization by maximizing positive transfer between tasks while reducing task interference. Fully achieving this potential is hindered by manually designed architectures that remain static…

Machine Learning · Computer Science 2023-05-02 Naresh Kumar Gurulingan , Bahram Zonooz , Elahe Arani

Datasets for training object recognition systems are steadily increasing in size. This paper investigates the question of whether existing detectors will continue to improve as data grows, or saturate in performance due to limited model…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 Xiangxin Zhu , Carl Vondrick , Charless Fowlkes , Deva Ramanan

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

Machine Learning · Computer Science 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Mixed-precision Deep Neural Networks achieve the energy efficiency and throughput needed for hardware deployment, particularly when the resources are limited, without sacrificing accuracy. However, the optimal per-layer bit precision that…

Machine Learning · Computer Science 2022-08-15 Mariam Rakka , Mohammed E. Fouda , Pramod Khargonekar , Fadi Kurdahi