中文
相关论文

相关论文: In-game Toxic Language Detection: Shared Task and …

200 篇论文

Toxic language remains an ongoing challenge on social media platforms, presenting significant issues for users and communities. This paper provides a cross-topic and cross-lingual analysis of toxicity in Reddit conversations. We collect 1.5…

计算与语言 · 计算机科学 2024-04-30 Wondimagegnhue Tsegaye Tufa , Ilia Markov , Piek Vossen

The detection of toxic language in the Arabic language has emerged as an active area of research in recent years, and reviewing the existing datasets employed for training the developed solutions has become a pressing need. This paper…

计算与语言 · 计算机科学 2024-01-31 Imene Bensalem , Paolo Rosso , Hanane Zitouni

User posts whose perceived toxicity depends on the conversational context are rare in current toxicity detection datasets. Hence, toxicity detectors trained on existing datasets will also tend to disregard context, making the detection of…

计算与语言 · 计算机科学 2021-11-22 Alexandros Xenos , John Pavlopoulos , Ion Androutsopoulos , Lucas Dixon , Jeffrey Sorensen , Leo Laugier

Moderating offensive, hateful, and toxic language has always been an important but challenging topic in the domain of safe use in NLP. The emerging large language models (LLMs), such as ChatGPT, can potentially further accentuate this…

计算机与社会 · 计算机科学 2023-11-28 Boyang Zhang , Xinyue Shen , Wai Man Si , Zeyang Sha , Zeyuan Chen , Ahmed Salem , Yun Shen , Michael Backes , Yang Zhang

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

计算与语言 · 计算机科学 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

Pornographic content occurring in human-machine interaction dialogues can cause severe side effects for users in open-domain dialogue systems. However, research on detecting pornographic language within human-machine interaction dialogues…

计算与语言 · 计算机科学 2024-03-21 Huachuan Qiu , Shuai Zhang , Hongliang He , Anqi Li , Zhenzhong Lan

Toxic language is difficult to define, as it is not monolithic and has many variations in perceptions of toxicity. This challenge of detecting toxic language is increased by the highly contextual and subjectivity of its interpretation,…

计算与语言 · 计算机科学 2023-05-19 Huriyyah Althunayan , Rahaf Bahlas , Manar Alharbi , Lena Alsuwailem , Abeer Aldayel , Rehab ALahmadi

Chatbots are used in many applications, e.g., automated agents, smart home assistants, interactive characters in online games, etc. Therefore, it is crucial to ensure they do not behave in undesired manners, providing offensive or toxic…

The detrimental effects of toxicity in competitive online video games are widely acknowledged, prompting publishers to monitor player chat conversations. This is challenging due to the context-dependent nature of toxicity, often spread…

计算与语言 · 计算机科学 2025-04-03 Adrien Schurger-Foy , Rafal Dariusz Kocielnik , Caglar Gulcehre , R. Michael Alvarez

Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally detecting and mitigating online toxicity. These efforts…

计算与语言 · 计算机科学 2023-11-09 Wenbo Zhang , Hangzhi Guo , Ian D Kivlichan , Vinodkumar Prabhakaran , Davis Yadav , Amulya Yadav

Recent advances in natural language processing and machine learning have led to the development of chatbot models, such as ChatGPT, that can engage in conversational dialogue with human users. However, the ability of these models to…

密码学与安全 · 计算机科学 2023-07-20 Bocheng Chen , Guangjing Wang , Hanqing Guo , Yuanda Wang , Qiben Yan

This paper presents a comprehensive comparative analysis of Natural Language Processing (NLP) methods for automated toxicity detection in online gaming chats. Traditional machine learning models with embeddings, large language models (LLMs)…

计算与语言 · 计算机科学 2025-10-22 Yehor Tereshchenko , Mika Hämäläinen

In this work we explore cyberbullying and other toxic behavior in team competition online games. Using a dataset of over 10 million player reports on 1.46 million toxic players along with corresponding crowdsourced decisions, we test…

计算机与社会 · 计算机科学 2015-04-10 Haewoon Kwak , Jeremy Blackburn , Seungyeop Han

Studies have shown that toxic behavior can cause contributors to leave, and hinder newcomers' (especially from underrepresented communities) participation in Open Source Software (OSS) projects. Thus, detection of toxic language plays a…

软件工程 · 计算机科学 2025-01-28 Ramtin Ehsani , Rezvaneh Rezapour , Preetha Chatterjee

The proliferation of abusive language in online communications has posed significant risks to the health and wellbeing of individuals and communities. The growing concern regarding online abuse and its consequences necessitates methods for…

计算与语言 · 计算机科学 2025-04-25 Samaneh Hosseini Moghaddam , Kelly Lyons , Cheryl Regehr , Vivek Goel , Kaitlyn Regehr

Traditional toxicity detection models have focused on the single utterance level without deeper understanding of context. We introduce CONDA, a new dataset for in-game toxic language detection enabling joint intent classification and slot…

计算与语言 · 计算机科学 2021-07-26 Henry Weld , Guanghao Huang , Jean Lee , Tongshu Zhang , Kunze Wang , Xinghong Guo , Siqu Long , Josiah Poon , Soyeon Caren Han

Language Models (LMs) often cannot be deployed because of their potential to harm users in hard-to-predict ways. Prior work identifies harmful behaviors before deployment by using human annotators to hand-write test cases. However, human…

As toxic language becomes nearly pervasive online, there has been increasing interest in leveraging the advancements in natural language processing (NLP), from very large transformer models to automatically detecting and removing toxic…

计算与语言 · 计算机科学 2020-07-02 Austin P. Wright , Omar Shaikh , Haekyu Park , Will Epperson , Muhammed Ahmed , Stephane Pinel , Diyi Yang , Duen Horng Chau

Large pre-trained language models are often trained on large volumes of internet data, some of which may contain toxic or abusive language. Consequently, language models encode toxic information, which makes the real-world usage of these…

计算与语言 · 计算机科学 2021-12-16 Andrew Wang , Mohit Sudhakar , Yangfeng Ji

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

机器学习 · 计算机科学 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng