中文
相关论文

相关论文: Multidimensional Transformation-Based Learning

200 篇论文

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

计算机视觉与模式识别 · 计算机科学 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Multi-Task Learning (MTL) aims at boosting the overall performance of each individual task by leveraging useful information contained in multiple related tasks. It has shown great success in natural language processing (NLP). Currently, a…

计算与语言 · 计算机科学 2020-08-10 Jianquan Li , Xiaokang Liu , Wenpeng Yin , Min Yang , Liqun Ma , Yaohong Jin

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

计算与语言 · 计算机科学 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training…

计算与语言 · 计算机科学 2016-09-26 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Chinese word segmentation and part-of-speech tagging are necessary tasks in terms of computational linguistics and application of natural language processing. Many re-searchers still debate the demand for Chinese word segmentation and…

计算与语言 · 计算机科学 2021-12-20 Duc-Vu Nguyen , Linh-Bao Vo , Ngoc-Linh Tran , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

机器学习 · 计算机科学 2022-01-10 Quan Feng , Songcan Chen

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

计算与语言 · 计算机科学 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

Understanding the structure of multiple related tasks allows for multi-task learning to improve the generalisation ability of one or all of them. However, it usually requires training each pairwise combination of tasks together in order to…

机器学习 · 计算机科学 2022-06-03 Shikun Liu , Stephen James , Andrew J. Davison , Edward Johns

As deep learning applications continue to become more diverse, an interesting question arises: Can general problem solving arise from jointly learning several such diverse tasks? To approach this question, deep multi-task learning is…

机器学习 · 计算机科学 2019-10-29 Elliot Meyerson , Risto Miikkulainen

We present a deep hierarchical recurrent neural network for sequence tagging. Given a sequence of words, our model employs deep gated recurrent units on both character and word levels to encode morphology and context information, and…

计算与语言 · 计算机科学 2016-08-10 Zhilin Yang , Ruslan Salakhutdinov , William Cohen

Multi-Task Learning (MTL) aims to enhance the model generalization by sharing representations between related tasks for better performance. Typical MTL methods are jointly trained with the complete multitude of ground-truths for all tasks…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Yufeng Wang , Yi-Hsuan Tsai , Wei-Chih Hung , Wenrui Ding , Shuo Liu , Ming-Hsuan Yang

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

机器学习 · 统计学 2023-09-19 Yaqi Duan , Kaizheng Wang

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

机器学习 · 计算机科学 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

This article conducts a large dimensional study of a simple yet quite versatile classification model, encompassing at once multi-task and semi-supervised learning, and taking into account uncertain labeling. Using tools from random matrix…

机器学习 · 统计学 2024-02-22 Victor Leger , Romain Couillet

Deep learning yields great results across many fields, from speech recognition, image classification, to translation. But for each problem, getting a deep model to work well involves research into the architecture and a long period of…

机器学习 · 计算机科学 2017-06-19 Lukasz Kaiser , Aidan N. Gomez , Noam Shazeer , Ashish Vaswani , Niki Parmar , Llion Jones , Jakob Uszkoreit

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

计算与语言 · 计算机科学 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

In Natural Language Processing (NLP), one traditionally considers a single task (e.g. part-of-speech tagging) for a single language (e.g. English) at a time. However, recent work has shown that it can be beneficial to take advantage of…

计算与语言 · 计算机科学 2018-09-10 Johannes Bjerva

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

计算与语言 · 计算机科学 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

One of the main arguments behind studying disentangled representations is the assumption that they can be easily reused in different tasks. At the same time finding a joint, adaptable representation of data is one of the key challenges in…

机器学习 · 计算机科学 2021-10-08 Łukasz Maziarka , Aleksandra Nowak , Maciej Wołczyk , Andrzej Bedychaj