English
Related papers

Related papers: A Framework of Severity for Harmful Content Online

200 papers

Breaking cybersecurity events are shared across a range of websites, including security blogs (FireEye, Kaspersky, etc.), in addition to social media platforms such as Facebook and Twitter. In this paper, we investigate methods to analyze…

Computation and Language · Computer Science 2019-05-06 Shi Zong , Alan Ritter , Graham Mueller , Evan Wright

Large vision-language models (LVLMs) are increasingly used for tasks where detecting multimodal harmful content is crucial, such as online content moderation. However, real-world harmful content is often camouflaged, relying on nuanced…

Multimedia · Computer Science 2025-12-04 Yanhui Li , Qi Zhou , Zhihong Xu , Huizhong Guo , Wenhai Wang , Dongxia Wang

Antisocial behavior (ASB) on social media-including hate speech, harassment, and trolling-poses growing challenges for platform safety and societal wellbeing. While prior work has primarily focused on detecting harmful content after it…

Computation and Language · Computer Science 2025-07-29 Anaïs Ollagnier

The online trend of the manosphere and feminist discourse on social networks requires a holistic measure of the level of sexism in an online community. This indicator is important for policymakers and moderators of online communities (e.g.,…

Social and Information Networks · Computer Science 2024-07-02 Vahid Ghafouri , Jose Such , Guillermo Suarez-Tangil

The recent rise in youth suicide highlights the urgent need to understand how online experiences contribute to this public health issue. Our mixed-methods approach responds to this challenge by developing a set of themes focused on risk…

Subtle and indirect hate speech remains an underexplored challenge in online safety research, particularly when harmful intent is embedded within misleading or manipulative narratives. Existing hate speech datasets primarily capture overt…

Computation and Language · Computer Science 2026-03-04 Sai Kartheek Reddy Kasu , Shankar Biradar , Sunil Saumya , Md. Shad Akhtar

Background: Cyber offences, such as hacking, malware creation and distribution, and online fraud, present a substantial threat to organizations attempting to safeguard their data and information. By understanding the evolving…

Cryptography and Security · Computer Science 2022-03-29 Claudia Peersman , Emma Williams , Matthew Edwards , Awais Rashid

Detecting problematic content, such as hate speech, is a multifaceted and ever-changing task, influenced by social dynamics, user populations, diversity of sources, and evolving language. There has been significant efforts, both in academia…

Computation and Language · Computer Science 2023-10-09 Ali Omrani , Alireza S. Ziabari , Preni Golazizian , Jeffrey Sorensen , Morteza Dehghani

Eating disorders are complex mental health conditions that affect millions of people around the world. Effective interventions on social media platforms are crucial, yet testing strategies in situ can be risky. We present a novel LLM-driven…

Computation and Language · Computer Science 2024-09-09 Louis Penafiel , Hsien-Te Kao , Isabel Erickson , David Chu , Robert McCormack , Kristina Lerman , Svitlana Volkova

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

Computation and Language · Computer Science 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

Computation and Language · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Technological advancements have resulted in an exponential increase in the use of online social networks (OSNs) worldwide. While online social networks provide a great communication medium, they also increase the user's exposure to…

Computers and Society · Computer Science 2024-01-09 Sylvia W Azumah , Nelly Elsayed , Zag ElSayed , Murat Ozer

Online communities serve as essential support channels for People Who Use Drugs (PWUD), providing access to peer support and harm reduction information. The moderation of these communities involves consequential decisions affecting member…

Human-Computer Interaction · Computer Science 2026-01-06 Kaixuan Wang , Loraine Clarke , Carl-Cyril J Dreue , Guancheng Zhou , Jason T. Jacques

As cybercrime becomes one of the most significant threats facing society today, it is of utmost importance to better understand the perpetrators behind such attacks. In this article, we seek to advance research and practitioner…

Computers and Society · Computer Science 2021-07-15 Maria Bada , Jason R. C. Nurse

Online toxic attacks, such as harassment, trolling, and hate speech have been linked to an increase in offline violence and negative psychological effects on victims. In this paper, we studied the impact of toxicity on users' online…

Social and Information Networks · Computer Science 2022-10-25 Ana Aleksandric , Sayak Saha Roy , Shirin Nilizadeh

Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet most detectors still treat toxicity as an intrinsic property of isolated text. This position paper…

Machine Learning · Computer Science 2026-05-13 Sergei Berezin , Reza Farahbakhsh , Noel Crespi

The prevalence of online hate and abuse is a pressing global concern. While tackling such societal harms is a priority for research across the social sciences, it is a difficult task, in part because of the magnitude of the problem. User…

Computers and Society · Computer Science 2025-10-08 Florence E. Enock , Helen Z. Margetts , Jonathan Bright

The exponential growth of social media platforms such as Twitter and Facebook has revolutionized textual communication and textual content publication in human society. However, they have been increasingly exploited to propagate toxic…

Computation and Language · Computer Science 2023-02-14 Wenxuan Wang , Jen-tse Huang , Weibin Wu , Jianping Zhang , Yizhan Huang , Shuqing Li , Pinjia He , Michael Lyu

As digital technology becomes increasingly embedded in daily life, its impact on social interactions has become a critical area of study, particularly concerning cyberbullying. This meta-analysis investigates the dual role of technology in…

Computers and Society · Computer Science 2024-05-01 Manasi Kulkarni , Siddhi Durve , Bochen Jia

The spread of toxic content on online platforms presents complex challenges that call for both theoretical insight and practical tools to test intervention strategies. In this novel research paper, we introduce a simulation-based framework…

Social and Information Networks · Computer Science 2025-12-24 Letizia Milli , Laura Pollacci , Riccardo Guidotti