English
Related papers

Related papers: How We Define Harm Impacts Data Annotations: Expla…

200 papers

In this paper, we discuss the development of an annotation schema to build datasets for evaluating the offline harm potential of social media texts. We define "harm potential" as the potential for an online public post to cause real-world…

Computation and Language · Computer Science 2024-03-19 Ritesh Kumar , Ojaswee Bhalla , Madhu Vanthi , Shehlat Maknoon Wani , Siddharth Singh

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

Computation and Language · Computer Science 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content,…

Crowdsourced annotation is vital to both collecting labelled data to train and test automated content moderation systems and to support human-in-the-loop review of system decisions. However, annotation tasks such as judging hate speech are…

Human-Computer Interaction · Computer Science 2023-09-06 Danula Hettiachchi , Indigo Holcombe-James , Stephanie Livingstone , Anjalee de Silva , Matthew Lease , Flora D. Salim , Mark Sanderson

Well-annotated data is a prerequisite for good Natural Language Processing models. Too often, though, annotation decisions are governed by optimizing time or annotator agreement. We make a case for nuanced efforts in an interdisciplinary…

Computation and Language · Computer Science 2022-10-31 Federico Bianchi , Stefanie Anja Hills , Patricia Rossini , Dirk Hovy , Rebekah Tromble , Nava Tintarev

Social media platforms provide users the freedom of expression and a medium to exchange information and express diverse opinions. Unfortunately, this has also resulted in the growth of abusive content with the purpose of discriminating…

Computation and Language · Computer Science 2021-07-01 Sohail Akhtar , Valerio Basile , Viviana Patti

Online abusive behavior is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies. Motivated by this rising issue, researchers have proposed, collected, and…

Social and Information Networks · Computer Science 2020-06-25 Md Rabiul Awal , Rui Cao , Roy Ka-Wei Lee , Sandra Mitrović

Since state-of-the-art approaches to offensive language detection rely on supervised learning, it is crucial to quickly adapt them to the continuously evolving scenario of social media. While several approaches have been proposed to tackle…

Computation and Language · Computer Science 2022-10-17 Elisa Leonardelli , Stefano Menini , Alessio Palmero Aprosio , Marco Guerini , Sara Tonelli

Classifiers tend to propagate biases present in the data on which they are trained. Hence, it is important to understand how the demographic identities of the annotators of comments affect the fairness of the resulting model. In this paper,…

Computation and Language · Computer Science 2021-06-07 Elizabeth Excell , Noura Al Moubayed

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

Computation and Language · Computer Science 2024-03-05 Mohammad Dehghani

Short video platforms, such as YouTube, Instagram, or TikTok, are used by billions of users globally. These platforms expose users to harmful content, ranging from clickbait or physical harms to misinformation or online hate. Yet, detecting…

Multimedia · Computer Science 2024-11-12 Claire Wonjeong Jo , Miki Wesołowska , Magdalena Wojcieszak

Current multimodal toxicity benchmarks typically use a single binary hatefulness label. This coarse approach conflates two fundamentally different characteristics of expression: tone and content. Drawing on communication science theory, we…

Computation and Language · Computer Science 2026-03-25 Nils A. Herrmann , Tobias Eder , Jingyi He , Georg Groh

Text data can pose a risk of harm. However, the risks are not fully understood, and how to handle, present, and discuss harmful text in a safe way remains an unresolved issue in the NLP community. We provide an analytical framework…

Computation and Language · Computer Science 2023-02-28 Hannah Rose Kirk , Abeba Birhane , Bertie Vidgen , Leon Derczynski

Toxicity is an increasingly common and severe issue in online spaces. Consequently, a rich line of machine learning research over the past decade has focused on computationally detecting and mitigating online toxicity. These efforts…

Computation and Language · Computer Science 2023-11-09 Wenbo Zhang , Hangzhi Guo , Ian D Kivlichan , Vinodkumar Prabhakaran , Davis Yadav , Amulya Yadav

The prevalence and impact of toxic discussions online have made content moderation crucial.Automated systems can play a vital role in identifying toxicity, and reducing the reliance on human moderation.Nevertheless, identifying toxic…

Artificial Intelligence · Computer Science 2023-11-02 Senjuti Dutta , Sid Mittal , Sherol Chen , Deepak Ramachandran , Ravi Rajakumar , Ian Kivlichan , Sunny Mak , Alena Butryna , Praveen Paritosh

Hate speech detection is a crucial task, especially on social media, where harmful content can spread quickly. Implementing machine learning models to automatically identify and address hate speech is essential for mitigating its impact and…

Computation and Language · Computer Science 2025-08-19 Somaiyeh Dehghan , Mehmet Umut Sen , Berrin Yanikoglu

Harmful speech has various forms and it has been plaguing the social media in different ways. If we need to crackdown different degrees of hate speech and abusive behavior amongst it, the classification needs to be based on complex…

Computation and Language · Computer Science 2018-06-13 Sanjana Sharma , Saksham Agrawal , Manish Shrivastava

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

Machine Learning · Computer Science 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr

Although automated harmful content detection systems are frequently used to monitor online platforms, moderators and end users frequently cannot understand the logic underlying their predictions. While recent studies have focused on…

Computation and Language · Computer Science 2026-03-20 Trishita Dhara , Siddhesh Sheth

The rise of online platforms exacerbated the spread of hate speech, demanding scalable and effective detection. However, the accuracy of hate speech detection systems heavily relies on human-labeled data, which is inherently susceptible to…

Computation and Language · Computer Science 2025-06-13 Tommaso Giorgi , Lorenzo Cima , Tiziano Fagni , Marco Avvenuti , Stefano Cresci
‹ Prev 1 2 3 10 Next ›