English
Related papers

Related papers: A Framework of Severity for Harmful Content Online

200 papers

Text data can pose a risk of harm. However, the risks are not fully understood, and how to handle, present, and discuss harmful text in a safe way remains an unresolved issue in the NLP community. We provide an analytical framework…

Computation and Language · Computer Science 2023-02-28 Hannah Rose Kirk , Abeba Birhane , Bertie Vidgen , Leon Derczynski

Online harms, such as hate speech, misinformation, harassment and self-harm promotion, continue to be widespread. While some work suggests that women are disproportionately affected by such harms, other studies find little evidence for…

Computers and Society · Computer Science 2024-02-02 Florence E. Enock , Francesca Stevens , Jonathan Bright , Miranda Cross , Pica Johansson , Judy Wajcman , Helen Z. Margetts

The proliferation of social media platforms and online communities has inadvertently catalyzed the spread of cyberbullying, hate speech, and other forms of online toxicity, making the effective governance of such harm a critical societal…

Artificial Intelligence · Computer Science 2026-05-28 Yiting Huang , Wenting Zhu , Zekun Wang , Qingpo Yang , Yakai Chen , Zihui Xu , Yueyue Zhang , Sanchuan Guo , Xi Zhang

Social media platforms aspire to create online experiences where users can participate safely and equitably. However, women around the world experience widespread online harassment, including insults, stalking, aggression, threats, and…

In order to combat the creation and spread of harmful content online, this paper defines and contextualizes the concept of inauthentic, societal-scale manipulation by malicious actors. We review the literature on societally harmful content…

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…

Recent multi-media data such as images and videos have been rapidly spread out on various online services such as social network services (SNS). With the explosive growth of online media services, the number of image content that may harm…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Eungyeom Ha , Heemook Kim , Sung Chul Hong , Dongbin Na

Since the advent of online social media platforms such as Twitter and Facebook, useful health-related studies have been conducted using the information posted by online participants. Personal health-related issues such as mental health,…

Computation and Language · Computer Science 2021-04-02 Muhammad Abubakar Alhassan , Isa Inuwa-Dutse , Bello Shehu Bello , Diane Pennington

Online harassment is a global problem. This article examines perceptions of harm and preferences for remedies associated with online harassment with nearly 4000 participants in 14 countries around the world. The countries in this work…

Human-Computer Interaction · Computer Science 2023-01-30 Sarita Schoenebeck , Amna Batool , Giang Do , Sylvia Darling , Gabriel Grill , Daricia Wilkinson , Mehtab Khan , Kentaro Toyama , Louise Ashwell

This paper aims to build an actionable framework for permissible online content moderation to combat misinformation. Often strong content moderation policies are invoked when misinformation causes harm. By adopting Mill's ethical framework,…

Social and Information Networks · Computer Science 2023-06-06 Marianna Ganapini

With the widespread online social networks, hate speeches are spreading faster and causing more damage than ever before. Existing hate speech detection methods have limitations in several aspects, such as handling data insufficiency,…

Computation and Language · Computer Science 2024-09-27 Guanyi Mou , Kyumin Lee

The rise of social media has significantly increased the prevalence of cyberbullying (CB), posing serious risks to both mental and physical well-being. Effective detection systems are essential for mitigating its impact. While several…

Machine Learning · Computer Science 2025-04-16 Tabia Tanzin Prama , Jannatul Ferdaws Amrin , Md. Mushfique Anwar , Iqbal H. Sarker

The rise of social media platforms has led to an increase in cyber-aggressive behavior, encompassing a broad spectrum of hostile behavior, including cyberbullying, online harassment, and the dissemination of offensive and hate speech. These…

Computation and Language · Computer Science 2024-12-31 Swapnil Mane , Suman Kundu , Rajesh Sharma

Viewing social apps as sociotechnical systems makes clear that they are not mere pieces of technology but mediate human interaction and may unintentionally enable harmful behaviors like online harassment. As more users interact through…

Computers and Society · Computer Science 2025-11-18 Sanjana Cheerla , Vaibhav Garg , Saikath Bhattacharya , Munindar P. Singh

Attention capitalism has generated design processes and product development decisions that prioritize platform growth over all other considerations. To the extent limits have been placed on these incentives, interventions have primarily…

Computers and Society · Computer Science 2023-06-14 Nathaniel Lubin , Thomas Krendl Gilbert

As cyber-attacks continue to increase in frequency and sophistication, organisations must be better prepared to face the reality of an incident. Any organisational plan that intends to be successful at managing security risks must clearly…

Cryptography and Security · Computer Science 2023-07-07 Nandita Pattnaik , Jason R. C. Nurse , Sarah Turner , Gareth Mott , Jamie MacColl , Pia Huesch , James Sullivan

In this work, we examine how fact-checkers prioritize which claims to fact-check and what tools may assist them in their efforts. Through a series of interviews with 23 professional fact-checkers from around the world, we validate that harm…

Human-Computer Interaction · Computer Science 2024-03-19 Connie Moon Sehat , Ryan Li , Peipei Nie , Tarunima Prabhakar , Amy X. Zhang

We propose a harm-centric conceptualization of privacy that asks: What harms from personal data use can privacy prevent? The motivation behind this research is limitations in existing privacy frameworks (e.g., Contextual Integrity) to…

Cryptography and Security · Computer Science 2025-07-01 Sri Harsha Gajavalli , Junichi Koizumi , Rakibul Hasan

The increasing scale and complexity of online platforms raises critical policy questions around harmful content, digital well-being, and user autonomy. Traditional content moderation systems rely on centralised, top-down rules, often…

Computers and Society · Computer Science 2026-05-05 Ewelina Gajewska , Michal Wawer , Katarzyna Budzynska , Jaroslaw A. Chudziak

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

Machine Learning · Computer Science 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee