English
Related papers

Related papers: Related Tasks can Share! A Multi-task Framework fo…

200 papers

Multi-task learning (MTL) is a paradigm that simultaneously learns multiple tasks by sharing information at different levels, enhancing the performance of each individual task. While previous research has primarily focused on feature-level…

Machine Learning · Computer Science 2024-04-02 Xiangming Xi , Feng Gao , Jun Xu , Fangtai Guo , Tianlei Jin

Multi-task learning leverages potential correlations among related tasks to extract common features and yield performance gains. However, most previous works only consider simple or weak interactions, thereby failing to model complex…

Computation and Language · Computer Science 2017-07-11 Honglun Zhang , Liqiang Xiao , Yongkun Wang , Yaohui Jin

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

We present two architectures for multi-task learning with neural sequence models. Our approach allows the relationships between different tasks to be learned dynamically, rather than using an ad-hoc pre-defined structure as in previous…

Computation and Language · Computer Science 2018-11-27 Pengfei Liu , Jie Fu , Yue Dong , Xipeng Qiu , Jackie Chi Kit Cheung

Neural processes have recently emerged as a class of powerful neural latent variable models that combine the strengths of neural networks and stochastic processes. As they can encode contextual data in the network's function space, they…

Machine Learning · Computer Science 2021-12-03 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao

Affective Analysis is not a single task, and the valence-arousal value, expression class, and action unit can be predicted at the same time. Previous researches did not pay enough attention to the entanglement and hierarchical relation of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ruian He , Zhen Xing , Weimin Tan , Bo Yan

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

Computation and Language · Computer Science 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Aspect-based sentiment analysis produces a list of aspect terms and their corresponding sentiments for a natural language sentence. This task is usually done in a pipeline manner, with aspect term extraction performed first, followed by…

Computation and Language · Computer Science 2019-06-18 Ruidan He , Wee Sun Lee , Hwee Tou Ng , Daniel Dahlmeier

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Multi-task learning has shown to significantly enhance the performance of multiple related learning tasks in a variety of situations. We present the fused logistic regression, a sparse multi-task learning approach for binary classification.…

Machine Learning · Statistics 2013-12-31 Venelin Mitov , Manfred Claassen

We present a multi-task learning framework to enable the training of one universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging, and utterance segmentation in a…

Computation and Language · Computer Science 2020-11-16 Morteza Rohanian , Julian Hough

In this paper, we empirically evaluate the utility of transfer and multi-task learning on a challenging semantic classification task: semantic interpretation of noun--noun compounds. Through a comprehensive series of experiments and…

Computation and Language · Computer Science 2018-09-19 Murhaf Fares , Stephan Oepen , Erik Velldal

In the paradigm of multi-task learning, mul- tiple related prediction tasks are learned jointly, sharing information across the tasks. We propose a framework for multi-task learn- ing that enables one to selectively share the information…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Hal Daume

We propose a topic-dependent attention model for sentiment classification and topic extraction. Our model assumes that a global topic embedding is shared across documents and employs an attention mechanism to derive local topic embedding…

Computation and Language · Computer Science 2019-08-20 Gabriele Pergola , Lin Gui , Yulan He

Neural network based methods have obtained great progress on a variety of natural language processing tasks. However, in most previous works, the models are learned based on single-task supervised objectives, which often suffer from…

Computation and Language · Computer Science 2016-05-18 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

Detecting what emotions are expressed in text is a well-studied problem in natural language processing. However, research on finer grained emotion analysis such as what causes an emotion is still in its infancy. We present solutions that…

Computation and Language · Computer Science 2021-06-21 Elsbeth Turcan , Shuai Wang , Rishita Anubhai , Kasturi Bhattacharjee , Yaser Al-Onaizan , Smaranda Muresan

In recent years, deep learning-based automated personality trait detection has received a lot of attention, especially now, due to the massive digital footprints of an individual. Moreover, many researchers have demonstrated that there is a…

Computation and Language · Computer Science 2021-01-08 Yang Li , Amirmohammad Kazameini , Yash Mehta , Erik Cambria

Natural language processing covers a wide variety of tasks predicting syntax, semantics, and information content, and usually each type of output is generated with specially designed architectures. In this paper, we provide the simple…

Computation and Language · Computer Science 2020-05-05 Zhengbao Jiang , Wei Xu , Jun Araki , Graham Neubig

Sentiment analysis is an important task in natural language processing. In recent works, pre-trained language models are often used to achieve state-of-the-art results, especially when training data is scarce. It is common to fine-tune on…

Computation and Language · Computer Science 2022-04-13 Ehsan Hosseini-Asl , Wenhao Liu , Caiming Xiong