中文
相关论文

相关论文: Gradient Similarity Surgery in Multi-Task Deep Lea…

200 篇论文

The training of deep neural networks is inherently a nonconvex optimization problem, yet standard approaches such as stochastic gradient descent (SGD) require simultaneous updates to all parameters, often leading to unstable convergence and…

机器学习 · 计算机科学 2025-08-07 Chengcheng Yan , Jiawei Xu , Zheng Peng , Qingsong Wang

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

机器学习 · 计算机科学 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

机器学习 · 计算机科学 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

人工智能 · 计算机科学 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Yi Xin , Junlong Du , Qiang Wang , Ke Yan , Shouhong Ding

The goal of Continual Learning (CL) is to continuously learn from new data streams and accomplish the corresponding tasks. Previously studied CL assumes that data are given in sequence nose-to-tail for different tasks, thus indeed belonging…

机器学习 · 计算机科学 2024-01-03 Fan Lyu , Wei Feng , Yuepan Li , Qing Sun , Fanhua Shang , Liang Wan , Liang Wang

Noises, artifacts, and loss of information caused by the magnetic resonance (MR) reconstruction may compromise the final performance of the downstream applications. In this paper, we develop a re-weighted multi-task deep learning method to…

计算机视觉与模式识别 · 计算机科学 2020-11-30 Kehan Qi , Yu Gong , Xinfeng Liu , Xin Liu , Hairong Zheng , Shanshan Wang

Over the past decade a wide spectrum of machine learning models have been developed to model the neurodegenerative diseases, associating biomarkers, especially non-intrusive neuroimaging markers, with key clinical scores measuring the…

机器学习 · 计算机科学 2018-03-02 Mengying Sun , Inci M. Baytas , Liang Zhan , Zhangyang Wang , Jiayu Zhou

Multitask learning aims at solving a set of related tasks simultaneously, by exploiting the shared knowledge for improving the performance on individual tasks. Hence, an important aspect of multitask learning is to understand the…

机器学习 · 计算机科学 2019-10-22 Changjian Shui , Mahdieh Abbasi , Louis-Émile Robitaille , Boyu Wang , Christian Gagné

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than…

计算机视觉与模式识别 · 计算机科学 2020-05-07 Abdullah-Al-Zubaer Imran , Chao Huang , Hui Tang , Wei Fan , Yuan Xiao , Dingjun Hao , Zhen Qian , Demetri Terzopoulos

In multi-task learning (MTL), gradient balancing has recently attracted more research interest than loss balancing since it often leads to better performance. However, loss balancing is much more efficient than gradient balancing, and thus…

机器学习 · 计算机科学 2023-07-31 Yanqi Dai , Nanyi Fei , Zhiwu Lu

Multi-modality fusion and multi-task learning are becoming trendy in 3D autonomous driving scenario, considering robust prediction and computation budget. However, naively extending the existing framework to the domain of multi-modality…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Zhijian Huang , Sihao Lin , Guiyu Liu , Mukun Luo , Chaoqiang Ye , Hang Xu , Xiaojun Chang , Xiaodan Liang

Across engineering and scientific domains, traditional deep learning (TDL) models perform well when training and test data share the same distribution. However, the dynamic nature of real-world data, broadly termed \textit{data shift},…

机器学习 · 计算机科学 2026-01-15 Samuel Myren , Nidhi Parikh , Natalie Klein

We propose generative multitask learning (GMTL), a simple and scalable approach to causal representation learning for multitask learning. Our approach makes a minor change to the conventional multitask inference objective, and improves…

机器学习 · 计算机科学 2022-10-25 Taro Makino , Krzysztof J. Geras , Kyunghyun Cho

Multi-task learning (MTL) aims to improve generalization performance by learning multiple related tasks simultaneously. While sometimes the underlying task relationship structure is known, often the structure needs to be estimated from data…

Semantic segmentation and depth completion are two challenging tasks in scene understanding, and they are widely used in robotics and autonomous driving. Although several works are proposed to jointly train these two tasks using some small…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Chongzhen Zhang , Yang Tang , Chaoqiang Zhao , Qiyu Sun , Zhencheng Ye , Jürgen Kurths

In many personalized recommendation scenarios, the generalization ability of a target task can be improved via learning with additional auxiliary tasks alongside this target task on a multi-task network. However, this method often suffers…

机器学习 · 计算机科学 2022-03-15 Yun He , Xue Feng , Cheng Cheng , Geng Ji , Yunsong Guo , James Caverlee

Multi-task learning (MTL) improves prediction performance in different contexts by learning models jointly on multiple different, but related tasks. Network data, which are a priori data with a rich relational structure, provide an…

机器学习 · 统计学 2014-11-11 Chen Fang , Daniel N. Rockmore

In this study, we address the intricate challenge of multi-task dense prediction, encompassing tasks such as semantic segmentation, depth estimation, and surface normal estimation, particularly when dealing with partially annotated data…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Meixuan Li , Tianyu Li , Guoqing Wang , Peng Wang , Yang Yang , Heng Tao Shen