English
Related papers

Related papers: Emerging Relation Network and Task Embedding for M…

200 papers

Multi-task learning (MTL) trains deep neural networks to optimize several objectives simultaneously using a shared backbone, which leads to reduced computational costs, improved data efficiency, and enhanced performance through cross-task…

Machine Learning · Computer Science 2025-09-30 Hoang Phan , Lam Tran , Quyen Tran , Ngoc N. Tran , Tuan Truong , Qi Lei , Nhat Ho , Dinh Phung , Trung Le

With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neural network training to improve performance and efficiency…

Machine Learning · Computer Science 2024-08-16 Lukas Kirchdorfer , Cathrin Elich , Simon Kutsche , Heiner Stuckenschmidt , Lukas Schott , Jan M. Köhler

Meta-learning enables algorithms to quickly learn a newly encountered task with just a few labeled examples by transferring previously learned knowledge. However, the bottleneck of current meta-learning algorithms is the requirement of a…

Machine Learning · Computer Science 2022-03-18 Huaxiu Yao , Linjun Zhang , Chelsea Finn

Multi-task learning (MTL) has achieved remarkable success in natural language processing applications. In this work, we study a multi-task learning model with multiple decoders on varieties of biomedical and clinical natural language…

Computation and Language · Computer Science 2020-05-07 Yifan Peng , Qingyu Chen , Zhiyong Lu

Human Settlement Extent (HSE) and Local Climate Zone (LCZ) maps are both essential sources, e.g., for sustainable urban development and Urban Heat Island (UHI) studies. Remote sensing (RS)- and deep learning (DL)-based classification…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Chunping Qiu , Lukas Liebel , Lloyd H. Hughes , Michael Schmitt , Marco Körner , Xiao Xiang Zhu

Named entity recognition (NER) and entity linking (EL) are two fundamentally related tasks, since in order to perform EL, first the mentions to entities have to be detected. However, most entity linking approaches disregard the mention…

Computation and Language · Computer Science 2019-07-22 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

Multi-task learning (MTL) aims at achieving a better model by leveraging data and knowledge from multiple tasks. However, MTL does not always work -- sometimes negative transfer occurs between tasks, especially when aggregating loosely…

Computation and Language · Computer Science 2023-05-24 Jingwei Ni , Zhijing Jin , Qian Wang , Mrinmaya Sachan , Markus Leippold

Merge trees are a valuable tool in the scientific visualization of scalar fields; however, current methods for merge tree comparisons are computationally expensive, primarily due to the exhaustive matching between tree nodes. To address…

Machine Learning · Computer Science 2024-10-07 Yu Qin , Brittany Terese Fasy , Carola Wenk , Brian Summa

Representation-based multi-task learning (MTL) improves efficiency by learning a shared structure across tasks, but its practical application is often hindered by contamination, outliers, or adversarial tasks. Most existing methods and…

Machine Learning · Statistics 2025-09-09 Yian Huang , Yang Feng , Zhiliang Ying

Multi-task learning (MTL) has led to successes in many applications of machine learning, from natural language processing and speech recognition to computer vision and drug discovery. This article aims to give a general overview of MTL,…

Machine Learning · Computer Science 2017-06-19 Sebastian Ruder

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

We analyze a dataset of retinal images using linear probes: linear regression models trained on some "target" task, using embeddings from a deep convolutional (CNN) model trained on some "source" task as input. We use this method across all…

Machine Learning · Computer Science 2021-07-27 Katy Blumer , Subhashini Venugopalan , Michael P. Brenner , Jon Kleinberg

Intermediate task fine-tuning has been shown to culminate in large transfer gains across many NLP tasks. With an abundance of candidate datasets as well as pre-trained language models, it has become infeasible to run the cross-product of…

Computation and Language · Computer Science 2021-09-13 Clifton Poth , Jonas Pfeiffer , Andreas Rücklé , Iryna Gurevych

The performance analytics domain in High Performance Computing (HPC) uses tabular data to solve regression problems, such as predicting the execution time. Existing Machine Learning (ML) techniques leverage the correlations among features…

Machine Learning · Computer Science 2024-01-22 Tarek Ramadan , Ankur Lahiry , Tanzima Z. Islam

In meta-learning, the knowledge learned from previous tasks is transferred to new ones, but this transfer only works if tasks are related. Sharing information between unrelated tasks might hurt performance, and it is unclear how to transfer…

Multi-task learning (MTL) optimizes several learning tasks simultaneously and leverages their shared information to improve generalization and the prediction of the model for each task. Auxiliary tasks can be added to the main task to…

Machine Learning · Computer Science 2020-07-03 Partoo Vafaeikia , Khashayar Namdar , Farzad Khalvati

Multilingual text recognition (MLTR) systems typically focus on a fixed set of languages, which makes it difficult to handle newly added languages or adapt to ever-changing data distribution. In this paper, we propose the Incremental MLTR…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Tianlun Zheng , Zhineng Chen , BingChen Huang , Wei Zhang , Yu-Gang Jiang

In this paper, we introduce multi-task learning (MTL) to data harmonization (DH); where we aim to harmonize images across different acquisition platforms and sites. This allows us to integrate information from multiple acquisitions and…

Machine Learning · Computer Science 2019-07-29 Stefano B. Blumberg , Marco Palombo , Can Son Khoo , Chantal M. W. Tax , Ryutaro Tanno , Daniel C. Alexander

When modeling related tasks in computer vision, Multi-Task Learning (MTL) can outperform Single-Task Learning (STL) due to its ability to capture intrinsic relatedness among tasks. However, MTL may encounter the insufficient training…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Caoyun Fan , Wenqing Chen , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

Machine Learning · Computer Science 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot