中文
相关论文

相关论文: When is an SHM problem a Multi-Task-Learning probl…

200 篇论文

Multi-task learning is a natural approach for computer vision applications that require the simultaneous solution of several distinct but related problems, e.g. object detection, classification, tracking of multiple agents, or denoising, to…

机器学习 · 计算机科学 2015-04-14 Carlo Ciliberto , Lorenzo Rosasco , Silvia Villa

Multi-task learning (MTL) is useful for domains in which data originates from multiple sources that are individually under-sampled. MTL methods are able to learn classification models that have higher performance as compared to learning a…

计算机视觉与模式识别 · 计算机科学 2016-08-02 Bilal Ahmed , Thomas Thesen , Karen E. Blackmon , Ruben Kuzniecky , Orrin Devinsky , Jennifer G. Dy , Carla E. Brodley

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

机器学习 · 计算机科学 2019-04-22 Yingtian Zou , Jiashi Feng

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

计算与语言 · 计算机科学 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

We consider a problem of learning kernels for use in SVM classification in the multi-task and lifelong scenarios and provide generalization bounds on the error of a large margin classifier. Our results show that, under mild conditions on…

机器学习 · 统计学 2016-08-19 Anastasia Pentina , Shai Ben-David

In this work we address task interference in universal networks by considering that a network is trained on multiple tasks, but performs one task at a time, an approach we refer to as "single-tasking multiple tasks". The network thus…

计算机视觉与模式识别 · 计算机科学 2019-04-19 Kevis-Kokitsi Maninis , Ilija Radosavovic , Iasonas Kokkinos

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

机器学习 · 计算机科学 2022-07-05 Guangji Bai , Liang Zhao

Continual (sequential) training and multitask (simultaneous) training are often attempting to solve the same overall objective: to find a solution that performs well on all considered tasks. The main difference is in the training regimes,…

机器学习 · 计算机科学 2020-10-12 Seyed Iman Mirzadeh , Mehrdad Farajtabar , Dilan Gorur , Razvan Pascanu , Hassan Ghasemzadeh

In recent years, the parameters of backbones of Video Understanding tasks continue to increase and even reach billion-level. Whether fine-tuning a specific task on the Video Foundation Model or pre-training the model designed for the…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Zeyi Bo , Wuxi Sun , Ye Jin

The optimal solution to an optimization problem depends on the problem's objective function, constraints, and size. While deep neural networks (DNNs) have proven effective in solving optimization problems, changes in the problem's size,…

In mobile communication scenarios, the acquired channel state information (CSI) rapidly becomes outdated due to fast-changing channels. Opportunistic transmitter selection based on current CSI for secrecy improvement may be outdated during…

信号处理 · 电气工程与系统科学 2024-05-02 Shashi Bhushan Kotwal , Chinmoy Kundu , Sudhakar Modem , Holger Claussen , Lester Ho

Multi-task learning (MTL) aims to improve estimation and prediction performance by sharing common information among related tasks. One natural assumption in MTL is that tasks are classified into clusters based on their characteristics.…

统计方法学 · 统计学 2024-05-28 Akira Okazaki , Shuichi Kawano

While multi-task learning (MTL) has gained significant attention in recent years, its underlying mechanisms remain poorly understood. Recent methods did not yield consistent performance improvements over single task learning (STL)…

机器学习 · 计算机科学 2024-08-16 Cathrin Elich , Lukas Kirchdorfer , Jan M. Köhler , Lukas Schott

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Fine-tuning pre-trained large language models (LLMs) on a diverse array of tasks has become a common approach for building models that can solve various natural language processing (NLP) tasks. However, where and to what extent these models…

计算与语言 · 计算机科学 2024-10-29 Zheng Zhao , Yftah Ziser , Shay B. Cohen

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

计算与语言 · 计算机科学 2007-05-23 Radu Florian , Grace Ngai

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts of data from public…

Multi-task learning is a learning paradigm which seeks to improve the generalization performance of a learning task with the help of some other related tasks. In this paper, we propose a regularization formulation for learning the…

机器学习 · 计算机科学 2012-03-19 Yu Zhang , Dit-Yan Yeung

There has been many studies on improving the efficiency of shared learning in Multi-Task Learning(MTL). Previous work focused on the "micro" sharing perspective for a small number of tasks, while in Recommender Systems(RS) and other AI…

机器学习 · 计算机科学 2021-10-27 Junning Liu , Zijie Xia , Yu Lei , Xinjian Li , Xu Wang

In this paper, we propose to study language modelling as a multi-task problem, bringing together three strands of research: multi-task learning, linguistics, and interpretability. Based on hypotheses derived from linguistic theory, we…

计算与语言 · 计算机科学 2021-01-28 Lucas Weber , Jaap Jumelet , Elia Bruni , Dieuwke Hupkes