English
Related papers

Related papers: DeMod: A Holistic Tool with Explainable Detection …

200 papers

Growing evidence shows that proactive content moderation supported by AI can help improve online discourse. However, we know little about designing these systems, how design impacts efficacy and user experience, and how people perceive…

Human-Computer Interaction · Computer Science 2024-01-22 Mark Warner , Angelika Strohmayer , Matthew Higgs , Husnain Rafiq , Liying Yang , Lynne Coventry

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

Computation and Language · Computer Science 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

TikTok has seen exponential growth as a platform, fuelled by the success of its proprietary recommender algorithm which serves tailored content to every user - though not without controversy. Users complain of their content being unfairly…

Human-Computer Interaction · Computer Science 2024-07-22 Eddie L. Ungless , Nina Markl , Björn Ross

The "Decentralised Web" (DW) is an evolving concept, which encompasses technologies aimed at providing greater transparency and openness on the web. The DW relies on independent servers (aka instances) that mesh together in a peer-to-peer…

Interpretations of a single sentence can vary, particularly when its context is lost. This paper aims to simulate how readers perceive content with varying toxicity levels by generating diverse interpretations of out-of-context sentences.…

Computation and Language · Computer Science 2026-04-17 Maria Mihaela Trusca , Liesbeth Allein

There is an ongoing debate about how to moderate toxic speech on social media and the impact of content moderation on online discourse. This paper proposes and validates a methodology for measuring the content-moderation-induced distortions…

Social and Information Networks · Computer Science 2026-03-04 Mahyar Habibi , Dirk Hovy , Carlo Schwarz

Social media is an area where users often experience censorship through a variety of means such as the restriction of search terms or active and retroactive deletion of messages. In this paper we examine the feasibility of automatically…

Social and Information Networks · Computer Science 2014-02-28 Donn Morrison

Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very…

Computation and Language · Computer Science 2022-04-05 Sreyan Ghosh , Samden Lepcha , S Sakshi , Rajiv Ratn Shah , S. Umesh

Even with various regulations in place across countries and social media platforms (Government of India, 2021; European Parliament and Council of the European Union, 2022, digital abusive speech remains a significant issue. One potential…

Toxic interactions during code reviews can undermine teamwork and hinder productivity in software engineering (SE) teams. While prior studies explore toxicity detection and empirical investigation, they lack real-time detoxification tools…

Software Engineering · Computer Science 2026-04-17 MD Awsaf Alam Anindya , Showvik Biswas , Anindya Iqbal , Jaydeb Sarker , Amiangshu Bosu

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

The presence of toxic content has become a major problem for many online communities. Moderators try to limit this problem by implementing more and more refined comment filters, but toxic users are constantly finding new ways to circumvent…

Computation and Language · Computer Science 2018-12-06 Éloi Brassard-Gourdeau , Richard Khoury

The exponential growth of social media platforms such as Twitter and Facebook has revolutionized textual communication and textual content publication in human society. However, they have been increasingly exploited to propagate toxic…

Computation and Language · Computer Science 2023-02-14 Wenxuan Wang , Jen-tse Huang , Weibin Wu , Jianping Zhang , Yizhan Huang , Shuqing Li , Pinjia He , Michael Lyu

Online social platforms centered around content creators often allow comments on content, where creators moderate the comments they receive. As creators can face overwhelming numbers of comments, with some of them harassing or hateful,…

Human-Computer Interaction · Computer Science 2022-02-18 Shagun Jhaver , Quan Ze Chen , Detlef Knauss , Amy Zhang

Chatbots are used in many applications, e.g., automated agents, smart home assistants, interactive characters in online games, etc. Therefore, it is crucial to ensure they do not behave in undesired manners, providing offensive or toxic…

Computers and Society · Computer Science 2022-09-12 Wai Man Si , Michael Backes , Jeremy Blackburn , Emiliano De Cristofaro , Gianluca Stringhini , Savvas Zannettou , Yang Zhang

Incivility remains a major challenge for online discussion platforms, to such an extent that even conversations between well-intentioned users can often derail into uncivil behavior. Traditionally, platforms have relied on moderators to --…

Human-Computer Interaction · Computer Science 2022-12-06 Jonathan P. Chang , Charlotte Schluger , Cristian Danescu-Niculescu-Mizil

The exponential growth of social media platforms, such as Facebook and TikTok, has revolutionized communication and content publication in human society. Users on these platforms can publish multimedia content that delivers information via…

Software Engineering · Computer Science 2023-05-24 Wenxuan Wang , Jingyuan Huang , Chang Chen , Jiazhen Gu , Jianping Zhang , Weibin Wu , Pinjia He , Michael Lyu

Content moderation is the process of screening and monitoring user-generated content online. It plays a crucial role in stopping content resulting from unacceptable behaviors such as hate speech, harassment, violence against specific…

Computation and Language · Computer Science 2023-01-02 Álvaro Huertas-García , Alejandro Martín , Javier Huertas Tato , David Camacho

The widespread dissemination of hate speech, harassment, harmful and sexual content, and violence across websites and media platforms presents substantial challenges and provokes widespread concern among different sectors of society.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Nouar AlDahoul , Myles Joshua Toledo Tan , Harishwar Reddy Kasireddy , Yasir Zaki

Toxicity detection in multimodal text-image content faces growing challenges, especially with multimodal implicit toxicity, where each modality appears benign on its own but conveys hazard when combined. Multimodal implicit toxicity appears…

Multimedia · Computer Science 2025-05-21 Shiyao Cui , Qinglin Zhang , Xuan Ouyang , Renmiao Chen , Zhexin Zhang , Yida Lu , Hongning Wang , Han Qiu , Minlie Huang