English
Related papers

Related papers: Synchronizing Task Behavior: Aligning Multiple Tas…

200 papers

The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex mappings from X to Y. The advent of each task often…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Junnan Li , Ziwei Xu , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often challenging because there is an exponential number of…

Machine Learning · Computer Science 2024-05-28 Ammar Sherif , Abubakar Abid , Mustafa Elattar , Mohamed ElHelw

Data are often sampled irregularly in time. Dealing with this using Recurrent Neural Networks (RNNs) traditionally involved ignoring the fact, feeding the time differences as additional inputs, or resampling the data. All these methods have…

Machine Learning · Computer Science 2024-07-03 Mantas Lukoševičius , Arnas Uselis

Speech recognition and speech synthesis models are typically trained separately, each with its own set of learning objectives, training data, and model parameters, resulting in two distinct large networks. We propose a parameter-efficient…

Computation and Language · Computer Science 2024-10-25 Hawau Olamide Toyin , Hao Li , Hanan Aldarmaki

Deep neural networks (DNNs) are increasingly being used in autonomous systems. However, DNNs do not generalize well to domain shift. Adapting to a continuously evolving environment is a safety-critical challenge inevitably faced by all…

Robotics · Computer Science 2025-09-04 Uddeshya Upadhyay

Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering…

Machine Learning · Computer Science 2026-05-12 Hans Hao-Hsun Hsu , Shikun Liu , Han Zhao , Pan Li

Multi-task prompt tuning utilizes multiple high-resource source tasks to improve performance on low-source target tasks. Existing approaches transfer the soft prompt trained by combining all source tasks or a single ``high-similar'' source…

Computation and Language · Computer Science 2025-03-25 Pieyi Zhang , Richong Zhang , Zhijie Nie

Despite domain generalization (DG) has significantly addressed the performance degradation of pre-trained models caused by domain shifts, it often falls short in real-world deployment. Test-time adaptation (TTA), which adjusts a learned…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xingguo Lv , Xingbo Dong , Liwen Wang , Jiewen Yang , Lei Zhao , Bin Pu , Zhe Jin , Xuejun Li

Many computer vision tasks address the problem of scene understanding and are naturally interrelated e.g. object classification, detection, scene segmentation, depth estimation, etc. We show that we can leverage the inherent relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yao Lu , Sören Pirk , Jan Dlabal , Anthony Brohan , Ankita Pasad , Zhao Chen , Vincent Casser , Anelia Angelova , Ariel Gordon

This paper explores a new research problem of unsupervised transfer learning across multiple spatiotemporal prediction tasks. Unlike most existing transfer learning methods that focus on fixing the discrepancy between supervised tasks, we…

Machine Learning · Computer Science 2020-09-25 Zhiyu Yao , Yunbo Wang , Mingsheng Long , Jianmin Wang

Spatio-temporal graph neural networks have proven efficacy in capturing complex dependencies for urban computing tasks such as forecasting and kriging. Yet, their performance is constrained by the reliance on extensive data for training on…

Machine Learning · Computer Science 2024-11-08 Junfeng Hu , Xu Liu , Zhencheng Fan , Yifang Yin , Shili Xiang , Savitha Ramasamy , Roger Zimmermann

Domain adaptation helps generalizing object detection models to target domain data with distribution shift. It is often achieved by adapting with access to the whole target domain data. In a more realistic scenario, target distribution is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Yijin Chen , Xun Xu , Yongyi Su , Kui Jia

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Multi-task neural networks learn tasks simultaneously to improve individual task performance. There are three mechanisms of multi-task learning (MTL) which are explored here for the context of structural health monitoring (SHM): (i) the…

Machine Learning · Computer Science 2023-05-17 Sarah Bee , Lawrence Bull , Nikolas Dervilis , Keith Worden

Multi-task learning (MTL) is a paradigm that simultaneously learns multiple tasks by sharing information at different levels, enhancing the performance of each individual task. While previous research has primarily focused on feature-level…

Machine Learning · Computer Science 2024-04-02 Xiangming Xi , Feng Gao , Jun Xu , Fangtai Guo , Tianlei Jin

Multi-task learning enables the acquisition of task-generic knowledge by training multiple tasks within a unified architecture. However, training all tasks together in a single architecture can lead to performance degradation, known as…

Machine Learning · Computer Science 2025-04-23 Wooseong Jeong , Kuk-Jin Yoon

This paper proposes a novelty approach to mitigate the negative transfer problem. In the field of machine learning, the common strategy is to apply the Single-Task Learning approach in order to train a supervised model to solve a specific…

Computation and Language · Computer Science 2023-07-10 Angel Felipe Magnossão de Paula , Paolo Rosso , Damiano Spina

Real-time artificial intelligence (AI) applications mapped onto edge computing need to perform data capture, process data, and device actuation within given bounds while using the available devices. Task synchronization across the devices…

Artificial Intelligence · Computer Science 2020-12-23 Richard Olaniyan , Muthucumaru Maheswaran

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

Machine Learning · Computer Science 2022-07-05 Guangji Bai , Liang Zhao

Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it…

Machine Learning · Computer Science 2020-06-03 Sungjae Lee , Youngdoo Son