English
Related papers

Related papers: Better Together: Using Multi-task Learning to Impr…

200 papers

In Multi-Task Learning (MTL), it is a common practice to train multi-task networks by optimizing an objective function, which is a weighted average of the task-specific objective functions. Although the computational advantages of this…

Machine Learning · Computer Science 2022-07-19 Lucas Pascal , Pietro Michiardi , Xavier Bost , Benoit Huet , Maria A. Zuluaga

Federated learning (FL) has shown promising potential in safeguarding data privacy in healthcare collaborations. While the term "FL" was originally coined by the engineering community, the statistical field has also explored similar…

The increasing adoption of natural language processing (NLP) models across industries has led to practitioners' need for machine learning systems to handle these models efficiently, from training to serving them in production. However,…

Computation and Language · Computer Science 2023-08-17 Lovre Torbarina , Tin Ferkovic , Lukasz Roguski , Velimir Mihelcic , Bruno Sarlija , Zeljko Kraljevic

Multi-task learning (MTL) for dense prediction has shown promising results but still faces challenges in balancing shared representations with task-specific specialization. In this paper, we introduce a novel Fine-Grained Mixture of Experts…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Xi Ye , Duo Su

Machine learning has played a pivotal role in advancing physics, with deep learning notably contributing to solving complex classification problems such as jet tagging in the field of jet physics. In this experiment, we aim to harness the…

High Energy Physics - Phenomenology · Physics 2023-11-27 Mauricio A. Diaz , Giorgio Cerro , Jacan Chaplais , Srinandan Dasmahapatra , Stefano Moretti

This article proposes a distributed multi-task learning (MTL) algorithm based on supervised principal component analysis (SPCA) which is: (i) theoretically optimal for Gaussian mixtures, (ii) computationally cheap and scalable. Supporting…

Machine Learning · Computer Science 2021-10-12 Sami Fakhry , Romain Couillet , Malik Tiomoko

In this paper, we address self-supervised representation learning from human skeletons for action recognition. Previous methods, which usually learn feature presentations from a single reconstruction task, may come across the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Lilang Lin , Sijie Song , Wenhan Yan , Jiaying Liu

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Is there a way for a designer to evaluate the performance of a given hood frame geometry without spending significant time on simulation setup? This paper seeks to address this challenge by developing a multimodal machine-learning (MMML)…

Machine Learning · Computer Science 2025-09-16 Abhishek Indupally , Satchit Ramnath

Predicting multiple heterogeneous biological and medical targets is a challenge for traditional deep learning models. In contrast to single-task learning, in which a separate model is trained for each target, multi-task learning (MTL)…

Machine Learning · Computer Science 2022-05-31 Raquel Aoki , Frederick Tung , Gabriel L. Oliveira

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

Computation and Language · Computer Science 2007-05-23 Radu Florian , Grace Ngai

This paper introduces a novel tree-based model, Learning Hyperplane Tree (LHT), which outperforms state-of-the-art (SOTA) tree models for classification tasks on several public datasets. The structure of LHT is simple and efficient: it…

Machine Learning · Computer Science 2025-01-16 Hongyi Li , Jun Xu , William Ward Armstrong

Multi-view clustering integrates multiple feature sets, which reveal distinct aspects of the data and provide complementary information to each other, to improve the clustering performance. It remains challenging to effectively exploit…

Machine Learning · Computer Science 2020-07-28 Shi-Xun Lina , Guo Zhongb , Ting Shu

Multi-Task Learning (MTL) plays a crucial role in real-world advertising applications such as recommender systems, aiming to achieve robust representations while minimizing resource consumption. MTL endeavors to simultaneously optimize…

Information Retrieval · Computer Science 2024-06-06 Furkan Durmus , Hasan Saribas , Said Aldemir , Junyan Yang , Hakan Cevikalp

We propose a multi-task learning (MTL) model for jointly performing three tasks that are commonly solved in a text-to-speech (TTS) front-end: text normalization (TN), part-of-speech (POS) tagging, and homograph disambiguation (HD). Our…

Computation and Language · Computer Science 2024-04-04 Wonjune Kang , Yun Wang , Shun Zhang , Arthur Hinsvark , Qing He

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

Computation and Language · Computer Science 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing…

Computation and Language · Computer Science 2024-10-29 Zi Gong , Hang Yu , Cong Liao , Bingchang Liu , Chaoyu Chen , Jianguo Li

Click-Through Rate (CTR) prediction has become an essential task in digital industries, such as digital advertising or online shopping. Many deep learning-based methods have been implemented and have become state-of-the-art models in the…

Information Retrieval · Computer Science 2024-06-19 Ibrahim Can Yilmaz , Said Aldemir

We showcase machine learning (ML) inspired target selection algorithms to determine which of all potential targets should be selected first for spectroscopic follow up. Efficient target selection can improve the ML redshift uncertainties as…

Instrumentation and Methods for Astrophysics · Physics 2016-06-16 Ben Hoyle , Kerstin Paech , Markus Michael Rau , Stella Seitz , Jochen Weller

We investigate whether and where multi-task learning (MTL) can improve performance on NLP problems related to argumentation mining (AM), in particular argument component identification. Our results show that MTL performs particularly well…

Computation and Language · Computer Science 2018-05-07 Claudia Schulz , Steffen Eger , Johannes Daxenberger , Tobias Kahse , Iryna Gurevych