English
Related papers

Related papers: Defining, Understanding, and Detecting Online Toxi…

200 papers

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…

Toxic language includes content that is offensive, abusive, or that promotes harm. Progress in preventing toxic output from large language models (LLMs) is hampered by inconsistent definitions of toxicity. We introduce TRuST, a large-scale…

Computation and Language · Computer Science 2026-01-07 Berk Atil , Namrata Sureddy , Rebecca J. Passonneau

With proliferation of user generated contents in social media platforms, establishing mechanisms to automatically identify toxic and abusive content becomes a prime concern for regulators, researchers, and society. Keeping the balance…

Computation and Language · Computer Science 2021-06-10 Djamila Romaissa Beddiar , Md Saroar Jahan , Mourad Oussalah

The detection of offensive, hateful and profane language has become a critical challenge since many users in social networks are exposed to cyberbullying activities on a daily basis. In this paper, we present an analysis of combining…

Computation and Language · Computer Science 2021-12-10 Sherzod Hakimov , Ralph Ewerth

The issue of hate speech extends beyond the confines of the online realm. It is a problem with real-life repercussions, prompting most nations to formulate legal frameworks that classify hate speech as a punishable offence. These legal…

Computation and Language · Computer Science 2024-12-10 Katerina Korre , John Pavlopoulos , Paolo Gajo , Alberto Barrón-Cedeño

Toxicity detection is crucial for maintaining the peace of the society. While existing methods perform well on normal toxic contents or those generated by specific perturbation methods, they are vulnerable to evolving perturbation patterns.…

Cryptography and Security · Computer Science 2025-03-05 Hankun Kang , Jianhao Chen , Yongqi Li , Xin Miao , Mayi Xu , Ming Zhong , Yuanyuan Zhu , Tieyun Qian

With the rise of artificial intelligence and machine learning in modern computing, one of the major concerns regarding such techniques is to provide privacy and security against adversaries. We present this survey paper to cover the most…

Cryptography and Security · Computer Science 2022-02-09 Wenjun Qiu

We examined four case studies in the context of hate speech on Twitter in Italian from 2019 to 2020, aiming at comparing the classification of the 3,600 tweets made by expert pedagogists with the automatic classification made by machine…

Social and Information Networks · Computer Science 2024-02-14 Erica Forzinetti , Marco L. Della Vedova , Stefano Pasta , Milena Santerini

The damaging effects of hate speech on social media are evident during the last few years, and several organizations, researchers and social media platforms tried to harness them in various ways. Despite these efforts, social media users…

Information Retrieval · Computer Science 2020-05-04 Polychronis Charitidis , Stavros Doropoulos , Stavros Vologiannidis , Ioannis Papastergiou , Sophia Karakeva

The widespread dissemination of toxic online posts is increasingly damaging to society. However, research on detecting toxic language in Chinese has lagged significantly. Existing datasets lack fine-grained annotation of toxic types and…

Computation and Language · Computer Science 2023-05-09 Junyu Lu , Bo Xu , Xiaokun Zhang , Changrong Min , Liang Yang , Hongfei Lin

The rise of emergence of social media platforms has fundamentally altered how people communicate, and among the results of these developments is an increase in online use of abusive content. Therefore, automatically detecting this content…

Computation and Language · Computer Science 2023-02-20 Khouloud Mnassri , Praboda Rajapaksha , Reza Farahbakhsh , Noel Crespi

Cyberbullying is of extreme prevalence today. Online-hate comments, toxicity, cyberbullying amongst children and other vulnerable groups are only growing over online classes, and increased access to social platforms, especially post…

Computation and Language · Computer Science 2021-07-20 Bhumika Bhatia , Anuj Verma , Anjum , Rahul Katarya

Toxic online speech has become a crucial problem nowadays due to an exponential increase in the use of internet by people from different cultures and educational backgrounds. Differentiating if a text message belongs to hate speech and…

Computation and Language · Computer Science 2021-08-24 Bencheng Wei , Jason Li , Ajay Gupta , Hafiza Umair , Atsu Vovor , Natalie Durzynski

While in real life everyone behaves themselves at least to some extent, it is much more difficult to expect people to behave themselves on the internet, because there are few checks or consequences for posting something toxic to others.…

Computation and Language · Computer Science 2021-12-14 Kehan Wang , Jiaxi Yang , Hongjun Wu

The widespread dissemination of hate speech, harassment, harmful and sexual content, and violence across websites and media platforms presents substantial challenges and provokes widespread concern among different sectors of society.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Nouar AlDahoul , Myles Joshua Toledo Tan , Harishwar Reddy Kasireddy , Yasir Zaki

With the in-depth integration of mobile Internet and widespread adoption of social platforms, user-generated content in the Chinese cyberspace has witnessed explosive growth. Among this content, the proliferation of toxic comments poses…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Ruixing Ren , Junhui Zhao , Xiaoke Sun , Qiuping Li

Pretraining datasets are foundational to the development of multimodal models, yet they often have inherent biases and toxic content from the web-scale corpora they are sourced from. In this paper, we investigate the prevalence of toxicity…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Karthik Reddy Kanjula , Surya Guthikonda , Nahid Alam , Shayekh Bin Islam

The growing prevalence and rapid evolution of offensive language in social media amplify the complexities of detection, particularly highlighting the challenges in identifying such content across diverse languages. This survey presents a…

Computation and Language · Computer Science 2026-04-02 Aiqi Jiang , Arkaitz Zubiaga

There is an ongoing debate about how to moderate toxic speech on social media and the impact of content moderation on online discourse. This paper proposes and validates a methodology for measuring the content-moderation-induced distortions…

Social and Information Networks · Computer Science 2026-03-04 Mahyar Habibi , Dirk Hovy , Carlo Schwarz

Text classification is an important topic in the field of natural language processing. It has been preliminarily applied in information retrieval, digital library, automatic abstracting, text filtering, word semantic discrimination and many…

Computation and Language · Computer Science 2023-12-20 Hao Li , Brandon Bennett