English
Related papers

Related papers: ALL-IN-ONE: Multi-Task Learning BERT models for Ev…

200 papers

Multi-task learning (MTL) aims at learning related tasks in a unified model to achieve mutual improvement among tasks considering their shared knowledge. It is an important topic in recommendation due to the demand for multi-task prediction…

Information Retrieval · Computer Science 2023-02-10 Yuhao Wang , Ha Tsz Lam , Yi Wong , Ziru Liu , Xiangyu Zhao , Yichao Wang , Bo Chen , Huifeng Guo , Ruiming Tang

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

Artificial Intelligence · Computer Science 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

[Context and motivation] Incompleteness in natural-language requirements is a challenging problem. [Question/problem] A common technique for detecting incompleteness in requirements is checking the requirements against external sources.…

Software Engineering · Computer Science 2023-02-10 Dipeeka Luitel , Shabnam Hassani , Mehrdad Sabetzadeh

Cyberbullying on social media is inherently multilingual and multi-faceted, where abusive behaviors often overlap across multiple categories. Existing methods are commonly limited by monolingual assumptions or single-task formulations,…

Computation and Language · Computer Science 2026-03-16 Zixin Feng , Xinying Cui , Yifan Sun , Zheng Wei , Jiachen Yuan , Jiazhen Hu , Ning Xin , Md Maruf Hasan

Pre-training a language model and then fine-tuning it for downstream tasks has demonstrated state-of-the-art results for various NLP tasks. Pre-training is usually independent of the downstream task, and previous works have shown that this…

Computation and Language · Computer Science 2022-11-28 Tanish Lad , Himanshu Maheshwari , Shreyas Kottukkal , Radhika Mamidi

We investigate whether and where multi-task learning (MTL) can improve performance on NLP problems related to argumentation mining (AM), in particular argument component identification. Our results show that MTL performs particularly well…

Computation and Language · Computer Science 2018-05-07 Claudia Schulz , Steffen Eger , Johannes Daxenberger , Tobias Kahse , Iryna Gurevych

Group recommender systems aim to generate recommendations that align with the collective preferences of a group, introducing challenges that differ significantly from those in individual recommendation scenarios. This paper presents Joint…

Information Retrieval · Computer Science 2025-04-10 Ngoc Luyen Le , Marie-Hélène Abel

Product ranking is a crucial component for many e-commerce services. One of the major challenges in product search is the vocabulary mismatch between query and products, which may be a larger vocabulary gap problem compared to other…

Information Retrieval · Computer Science 2022-04-04 Xuyang Wu , Alessandro Magnani , Suthee Chaidaroon , Ajit Puthenputhussery , Ciya Liao , Yi Fang

Speech emotion recognition (SER) plays a critical role in building emotion-aware speech systems, but its performance degrades significantly under noisy conditions. Although speech enhancement (SE) can improve robustness, it often introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Jing-Tong Tzeng , Carlos Busso , Chi-Chun Lee

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Information Retrieval · Computer Science 2023-03-13 Ziru Liu , Jiejie Tian , Qingpeng Cai , Xiangyu Zhao , Jingtong Gao , Shuchang Liu , Dayou Chen , Tonghao He , Dong Zheng , Peng Jiang , Kun Gai

We analyze various methods for single-label and multi-label text classification across well-known datasets, categorizing them into bag-of-words, sequence-based, graph-based, and hierarchical approaches. Despite the surge in methods like…

Computation and Language · Computer Science 2025-01-22 Lukas Galke , Ansgar Scherp , Andor Diera , Fabian Karl , Bao Xin Lin , Bhakti Khera , Tim Meuser , Tushar Singhal

This paper explores the application of deep learning techniques, particularly focusing on BERT models, in sentiment analysis. It begins by introducing the fundamental concept of sentiment analysis and how deep learning methods are utilized…

Computation and Language · Computer Science 2024-03-14 Yichao Wu , Zhengyu Jin , Chenxi Shi , Penghao Liang , Tong Zhan

Deep learning approaches have achieved great success in the field of Natural Language Processing (NLP). However, directly training deep neural models often suffer from overfitting and data scarcity problems that are pervasive in NLP tasks.…

Artificial Intelligence · Computer Science 2024-04-30 Shijie Chen , Yu Zhang , Qiang Yang

Cyberbullying significantly contributes to mental health issues in communities by negatively impacting the psychology of victims. It is a prevalent problem on social media platforms, necessitating effective, real-time detection and…

Computation and Language · Computer Science 2024-12-31 Adamu Gaston Philipo , Doreen Sebastian Sarwatt , Jianguo Ding , Mahmoud Daneshmand , Huansheng Ning

Automatic readability assessment (ARA) is the task of evaluating the level of ease or difficulty of text documents for a target audience. For researchers, one of the many open problems in the field is to make such models trained for the…

Computation and Language · Computer Science 2021-08-02 Joseph Marvin Imperial

Heavily pre-trained transformer models such as BERT have recently shown to be remarkably powerful at language modelling by achieving impressive results on numerous downstream tasks. It has also been shown that they are able to implicitly…

Information Retrieval · Computer Science 2021-03-05 Gustavo Penha , Claudia Hauff

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

Methodology · Statistics 2023-04-27 Akira Okazaki , Shuichi Kawano

The introduction of pre-trained language models has revolutionized natural language research communities. However, researchers still know relatively little regarding their theoretical and empirical properties. In this regard, Peters et al.…

Computation and Language · Computer Science 2019-07-12 Ran Wang , Haibo Su , Chunye Wang , Kailin Ji , Jupeng Ding

Recent work has shown evidence that the knowledge acquired by multilingual BERT (mBERT) has two components: a language-specific and a language-neutral one. This paper analyses the relationship between them, in the context of fine-tuning on…

Computation and Language · Computer Science 2021-12-28 Marc Tanti , Lonneke van der Plas , Claudia Borg , Albert Gatt