English
Related papers

Related papers: Metamorphic Testing for Audio Content Moderation S…

200 papers

Harmful content detection models tend to have higher false positive rates for content from marginalized groups. In the context of marginal abuse modeling on Twitter, such disproportionate penalization poses the risk of reduced visibility,…

Computation and Language · Computer Science 2022-10-13 Kyra Yee , Alice Schoenauer Sebag , Olivia Redfield , Emily Sheng , Matthias Eck , Luca Belli

Hate Speech has become a major content moderation issue for online social media platforms. Given the volume and velocity of online content production, it is impossible to manually moderate hate speech related content on any platform. In…

Computation and Language · Computer Science 2021-01-28 Sudhanshu Mishra , Shivangi Prasad , Shubhanshu Mishra

Social media platforms have been establishing content moderation guidelines and employing various moderation policies to counter hate speech and misinformation. The goal of this paper is to study these community guidelines and moderation…

Computers and Society · Computer Science 2023-08-10 Mohit Singhal , Chen Ling , Pujan Paudel , Poojitha Thota , Nihal Kumarswamy , Gianluca Stringhini , Shirin Nilizadeh

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

Social media platforms have become central to modern communication, yet they also harbor offensive content that challenges platform safety and inclusivity. While prior research has primarily focused on textual indicators of offense, the…

Computation and Language · Computer Science 2025-06-03 Yuhang Zhou , Yimin Xiao , Wei Ai , Ge Gao

The polarization of opinions, information segregation, and cognitive biases on social media have attracted significant academic attention. In real-world networks, information often spans multiple interrelated topics, posing challenges for…

Artificial Intelligence · Computer Science 2025-10-15 Dingyi Zuo , Hongjie Zhang , Jie Ou , Chaosheng Feng , Shuwan Liu

Real-world speech communication is rarely affected by a single type of degradation. Instead, it suffers from a complex interplay of acoustic interference, codec compression, and, increasingly, secondary artifacts introduced by upstream…

Sound · Computer Science 2025-12-30 Junan Zhang , Mengyao Zhu , Xin Xu , Hui Bu , Zhenhua Ling , Zhizheng Wu

Social media platforms have become critical spaces for discussing mental health concerns, including eating disorders. While these platforms can provide valuable support networks, they may also amplify harmful content that glorifies…

Social and Information Networks · Computer Science 2024-12-23 Kristina Lerman , Minh Duc Chu , Charles Bickham , Luca Luceri , Emilio Ferrara

In the contemporary digital age, the proliferation of deepfakes presents a formidable challenge to the sanctity of information dissemination. Audio deepfakes, in particular, can be deceptively realistic, posing significant risks in…

Sound · Computer Science 2024-02-28 Karthik Sivarama Krishnan , Koushik Sivarama Krishnan

Automatic Music Transcription (AMT) -- the task of converting music audio into note representations -- has seen rapid progress, driven largely by deep learning systems. Due to the limited availability of richly annotated music datasets,…

Sound · Computer Science 2026-01-27 Lukáš Samuel Marták , Patricia Hu , Gerhard Widmer

Short video platforms, such as YouTube, Instagram, or TikTok, are used by billions of users globally. These platforms expose users to harmful content, ranging from clickbait or physical harms to misinformation or online hate. Yet, detecting…

Multimedia · Computer Science 2024-11-12 Claire Wonjeong Jo , Miki Wesołowska , Magdalena Wojcieszak

When audio and text conflict, speech-enabled language models follow text far more often than they do when arbitrating between two conflicting text sources, even under explicit instructions to trust the audio. We introduce ALME (Audio-LLM…

Computation and Language · Computer Science 2026-03-25 Jayadev Billa

Toxicity classification for voice heavily relies on the semantic content of speech. We propose a novel framework that utilizes cross-modal learning to integrate the semantic embedding of text into a multilabel speech toxicity classifier…

Computation and Language · Computer Science 2024-11-19 Joseph Liu , Mahesh Kumar Nandwana , Janne Pylkkönen , Hannes Heikinheimo , Morgan McGuire

The rapid advances in text-to-speech (TTS) technologies have made audio deepfakes increasingly realistic and accessible, raising significant security and trust concerns. While existing research has largely focused on detecting…

Sound · Computer Science 2026-02-03 Alabi Ahmed , Vandana Janeja , Sanjay Purushotham

This research work demonstrates that current AI systems fail catastrophically on auditory tasks that humans perform effortlessly. Drawing inspiration from Moravec's paradox (i.e., tasks simple for humans often prove difficult for machines,…

Artificial Intelligence · Computer Science 2025-08-01 David Noever , Forrest McKee

Large Language Models are widely used for content moderation but often present certain over-sensitivity, leading to misclassification of benign content and rejecting safe user commands. While previous research attributes this issue…

Computation and Language · Computer Science 2026-03-19 Yuxin Wang , Botao Yu , Ivory Yang , Saeed Hassanpour , Soroush Vosoughi

Large Language Models (LLMs) are increasingly being used to autonomously evaluate the quality of content in communication systems, e.g., to assess responses in telecom customer support chatbots. However, the impartiality of these AI…

Artificial Intelligence · Computer Science 2026-03-03 Jiaxin Gao , Chen Chen , Yanwen Jia , Xueluan Gong , Kwok-Yan Lam , Qian Wang

The detection of sensitive content in large datasets is crucial for ensuring that shared and analysed data is free from harmful material. However, current moderation tools, such as external APIs, suffer from limitations in customisation,…

Computation and Language · Computer Science 2025-06-25 Dimosthenis Antypas , Indira Sen , Carla Perez-Almendros , Jose Camacho-Collados , Francesco Barbieri

Despite the growing popularity of audio platforms, fact-checking spoken content remains significantly underdeveloped. Misinformation in speech often unfolds across multi-turn dialogues, shaped by speaker interactions, disfluencies,…

Social and Information Networks · Computer Science 2025-08-19 Chaewan Chun , Lysandre Terrisse , Delvin Ce Zhang , Dongwon Lee

Internet memes have become a dominant method of communication; at the same time, however, they are also increasingly being used to advocate extremism and foster derogatory beliefs. Nonetheless, we do not have a firm understanding as to…