English
Related papers

Related papers: Multi-Task Learning with Deep Neural Networks: A S…

200 papers

The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent years. Contrary to conventional approaches to AI where tasks are solved from scratch using a fixed learning algorithm, meta-learning aims to…

Machine Learning · Computer Science 2020-11-10 Timothy Hospedales , Antreas Antoniou , Paul Micaelli , Amos Storkey

The key to success in machine learning (ML) is the use of effective data representations. Traditionally, data representations were hand-crafted. Recently it has been demonstrated that, given sufficient data, deep neural networks can learn…

Machine Learning · Computer Science 2018-11-09 Ivan Olier , Oghenejokpeme I. Orhobor , Joaquin Vanschoren , Ross D. King

Multi-task learning has been widely applied in computational vision, natural language processing and other fields, which has achieved well performance. In recent years, a lot of work about multi-task learning recommender system has been…

Information Retrieval · Computer Science 2023-05-24 Mingzhu Zhang , Ruiping Yin , Zhen Yang , Yipeng Wang , Kan Li

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Matthias Langer , Zhen He , Wenny Rahayu , Yanbo Xue

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

Computation and Language · Computer Science 2022-10-31 Guy Rotman , Roi Reichart

Meta-learning has gained wide popularity as a training framework that is more data-efficient than traditional machine learning methods. However, its generalization ability in complex task distributions, such as multimodal tasks, has not…

Machine Learning · Computer Science 2022-05-10 Yao Ma , Shilin Zhao , Weixiao Wang , Yaoman Li , Irwin King

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

An increasingly popular machine learning paradigm is to pretrain a neural network (NN) on many tasks offline, then adapt it to downstream tasks, often by re-training only the last linear layer of the network. This approach yields strong…

Machine Learning · Computer Science 2024-06-10 Liam Collins , Hamed Hassani , Mahdi Soltanolkotabi , Aryan Mokhtari , Sanjay Shakkottai

Simultaneously considering multiple objectives in machine learning has been a popular approach for several decades, with various benefits for multi-task learning, the consideration of secondary goals such as sparsity, or multicriteria…

Machine Learning · Computer Science 2024-12-04 Sebastian Peitz , Sedjro Salomon Hotegni

Multitask learning is a common approach in machine learning, which allows to train multiple objectives with a shared architecture. It has been shown that by training multiple tasks together inference time and compute resources can be saved,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Falk Heuer , Sven Mantowsky , Syed Saqib Bukhari , Georg Schneider

While the promises of Multi-Task Learning (MTL) are attractive, characterizing the conditions of its success is still an open problem in Deep Learning. Some tasks may benefit from being learned together while others may be detrimental to…

Machine Learning · Computer Science 2023-01-10 Raphael Azorin , Massimo Gallo , Alessandro Finamore , Dario Rossi , Pietro Michiardi

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Hal Daume

We study and quantify the generalization patterns of multitask learning (MTL) models for sequence labeling tasks. MTL models are trained to optimize a set of related tasks jointly. Although multitask learning has achieved improved…

Machine Learning · Computer Science 2020-09-29 Gabriele Bettgenhäuser , Michael A. Hedderich , Dietrich Klakow

Recent advances in Federated Learning (FL) have paved the way towards the design of novel strategies for solving multiple learning tasks simultaneously, by leveraging cooperation among networked devices. Multi-Task Learning (MTL) exploits…

Machine Learning · Computer Science 2022-12-23 Stefano Savazzi , Vittorio Rampa , Sanaz Kianoush , Mehdi Bennis

We propose a multi-task learning (MTL) model for jointly performing three tasks that are commonly solved in a text-to-speech (TTS) front-end: text normalization (TN), part-of-speech (POS) tagging, and homograph disambiguation (HD). Our…

Computation and Language · Computer Science 2024-04-04 Wonjune Kang , Yun Wang , Shun Zhang , Arthur Hinsvark , Qing He

Large language models (LLM) have recently shown the extraordinary ability to perform unseen tasks based on few-shot examples provided as text, also known as in-context learning (ICL). While recent works have attempted to understand the…

Computation and Language · Computer Science 2024-04-05 Harmon Bhasin , Timothy Ossowski , Yiqiao Zhong , Junjie Hu

Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the…

Machine Learning · Computer Science 2022-09-27 Mohammad Shiri , Jiangwen Sun

State-of-the-art studies have demonstrated the superiority of joint modelling over pipeline implementation for medical named entity recognition and normalization due to the mutual benefits between the two processes. To exploit these…

Computation and Language · Computer Science 2018-12-17 Sendong Zhao , Ting Liu , Sicheng Zhao , Fei Wang

This paper addresses the challenge of training a single network to jointly perform multiple dense prediction tasks, such as segmentation and depth estimation, i.e., multi-task learning (MTL). Current approaches mainly capture cross-task…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xiaoye Wang , Chen Tang , Xiangyu Yue , Wei-Hong Li

Traditional neural network approaches for traffic flow forecasting are usually single task learning (STL) models, which do not take advantage of the information provided by related tasks. In contrast to STL, multitask learning (MTL) has the…

Machine Learning · Computer Science 2017-12-27 Feng Jin , Shiliang Sun