English
Related papers

Related papers: BERT-Beta: A Proactive Probabilistic Approach to T…

200 papers

Text toxicity detection systems exhibit significant biases, producing disproportionate rates of false positives on samples mentioning demographic groups. But what about toxicity detection in speech? To investigate the extent to which…

The mental health assessment of middle school students has always been one of the focuses in the field of education. This paper introduces a new ensemble learning network based on BERT, employing the concept of enhancing model performance…

Computation and Language · Computer Science 2024-08-12 Kai Jiang , Honghao Yang , Yuexian Wang , Qianru Chen , Yiming Luo

Large Language Models (LLMs) are increasingly deployed to curate and rank human-created content, yet the nature and structure of their biases in these tasks remains poorly understood: which biases are robust across providers and platforms,…

Social and Information Networks · Computer Science 2026-04-20 Nicolò Pagan , Christopher Barrie , Chris Andrew Bail , Petter Törnberg

In this paper, we investigate the emotion recognition ability of the pre-training language model, namely BERT. By the nature of the framework of BERT, a two-sentence structure, we adapt BERT to continues dialogue emotion prediction tasks,…

Computation and Language · Computer Science 2019-08-20 Yen-Hao Huang , Ssu-Rui Lee , Mau-Yun Ma , Yi-Hsin Chen , Ya-Wen Yu , Yi-Shin Chen

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

Machine Learning · Computer Science 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

Social media platforms have a vital role in the modern world, serving as conduits for communication, the exchange of ideas, and the establishment of networks. However, the misuse of these platforms through toxic comments, which can range…

Computation and Language · Computer Science 2025-06-24 Mukaffi Bin Moin , Pronay Debnath , Usafa Akther Rifa , Rijeet Bin Anis

Employing language models to generate explanations for an incoming implicit hate post is an active area of research. The explanation is intended to make explicit the underlying stereotype and aid content moderators. The training often…

Computation and Language · Computer Science 2024-06-07 Neemesh Yadav , Sarah Masud , Vikram Goyal , Vikram Goyal , Md Shad Akhtar , Tanmoy Chakraborty

In this paper, we propose a novel approach for generating document embeddings using a combination of Sentence-BERT (SBERT) and RoBERTa, two state-of-the-art natural language processing models. Our approach treats sentences as tokens and…

Information Retrieval · Computer Science 2023-08-28 Shashidhar Reddy Javaji , Krutika Sarode

Human annotations are an important source of information in the development of natural language understanding approaches. As under the pressure of productivity annotators can assign different labels to a given text, the quality of produced…

Computation and Language · Computer Science 2020-10-29 Kristian Miok , Gregor Pirs , Marko Robnik-Sikonja

Text readability assessment has a wide range of applications for different target people, from language learners to people with disabilities. The fast pace of textual content production on the web makes it impossible to measure text…

Computation and Language · Computer Science 2022-09-07 Salar Mohtaj , Babak Naderi , Sebastian Möller , Faraz Maschhur , Chuyang Wu , Max Reinhard

With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling…

Computation and Language · Computer Science 2024-01-24 Jiahui Zhao , Ziyi Meng , Stepan Gordeev , Zijie Pan , Dongjin Song , Sandro Steinbach , Caiwen Ding

The field of NLP has seen unprecedented achievements in recent years. Most notably, with the advent of large-scale pre-trained Transformer-based language models, such as BERT, there has been a noticeable improvement in text representation.…

Computation and Language · Computer Science 2020-12-08 Lili Wang , Chongyang Gao , Jason Wei , Weicheng Ma , Ruibo Liu , Soroush Vosoughi

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

As social media has become a predominant mode of communication globally, the rise of abusive content threatens to undermine civil discourse. Recognizing the critical nature of this issue, a significant body of research has been dedicated to…

Computation and Language · Computer Science 2024-05-21 Xinyu Wang , Sai Koneru , Pranav Narayanan Venkit , Brett Frischmann , Sarah Rajtmajer

Our study addresses a significant gap in online hate speech detection research by focusing on homophobia, an area often neglected in sentiment analysis research. Utilising advanced sentiment analysis models, particularly BERT, and…

Computation and Language · Computer Science 2024-05-16 Josh McGiff , Nikola S. Nikolov

Large language models (LLMs) have exploded in popularity due to their ability to perform a wide array of natural language tasks. Text-based content moderation is one LLM use case that has received recent enthusiasm, however, there is little…

Human-Computer Interaction · Computer Science 2024-01-18 Deepak Kumar , Yousef AbuHashem , Zakir Durumeric

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur

Caution: This paper includes offensive words that could potentially cause unpleasantness. The fast-paced evolution of generative language models such as GPT-4 has demonstrated outstanding results in various NLP generation tasks. However,…

Computation and Language · Computer Science 2023-12-12 Heegyu Kim , Hyunsouk Cho

Recent developments in online communication and their usage in everyday life have caused an explosion in the amount of a new genre of text data, short text. Thus, the need to classify this type of text based on its content has a significant…

Computation and Language · Computer Science 2024-09-10 Bruno D. Ferreira-Saraiva , Zuil Pirola , João P. Matos-Carvalho , Manuel Marques-Pita

To maximize the accuracy and increase the overall acceptance of text classifiers, we propose a framework for the efficient, in-operation moderation of classifiers' output. Our framework focuses on use cases in which F1-scores of modern…

Machine Learning · Computer Science 2022-04-05 Jakob Smedegaard Andersen , Walid Maalej