English
Related papers

Related papers: Advancing Harmful Content Detection in Organizatio…

200 papers

Detecting online sexual predatory behaviours and abusive language on social media platforms has become a critical area of research due to the growing concerns about online safety, especially for vulnerable populations such as children and…

Computation and Language · Computer Science 2023-08-29 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

Machine Learning · Computer Science 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng

The prevalence of harmful content on social media platforms poses significant risks to users and society, necessitating more effective and scalable content moderation strategies. Current approaches rely on human moderators, supervised…

Computation and Language · Computer Science 2025-01-27 Akash Bonagiri , Lucen Li , Rajvardhan Oak , Zeerak Babar , Magdalena Wojcieszak , Anshuman Chhabra

Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks. However, their practical application in high-stake domains, such as fraud and abuse detection, remains an area that requires…

Computation and Language · Computer Science 2024-09-11 Joymallya Chakraborty , Wei Xia , Anirban Majumder , Dan Ma , Walid Chaabene , Naveed Janvekar

Large language models (LLMs) increasingly operate on long inputs, yet their behavior when harmful sentences are sparsely embedded within such inputs remains poorly understood. We present a sensitivity analysis that probes how LLMs extract…

Computation and Language · Computer Science 2026-05-27 Faeze Ghorbanpour , Alexander Fraser

Large Language Models (LLMs) have revolutionized content creation across digital platforms, offering unprecedented capabilities in natural language generation and understanding. These models enable beneficial applications such as content…

Computation and Language · Computer Science 2025-08-14 Chi Zhang , Changjia Zhu , Junjie Xiong , Xiaoran Xu , Lingyao Li , Yao Liu , Zhuo Lu

The prevalence of offensive content on the internet, encompassing hate speech and cyberbullying, is a pervasive issue worldwide. Consequently, it has garnered significant attention from the machine learning (ML) and natural language…

Computation and Language · Computer Science 2024-07-29 Alphaeus Dmonte , Tejas Arya , Tharindu Ranasinghe , Marcos Zampieri

This research introduces a novel approach to textual and multimodal Hate Speech Detection (HSD), using Large Language Models (LLMs) as dynamic knowledge bases to generate background context and incorporate it into the input of HSD…

Computation and Language · Computer Science 2025-10-20 Joshua Wolfe Brook , Ilia Markov

Hate speech detection across contemporary social media presents unique challenges due to linguistic diversity and the informal nature of online discourse. These challenges are further amplified in settings involving code-mixing,…

Computation and Language · Computer Science 2025-06-17 Daman Deep Singh , Ramanuj Bhattacharjee , Abhijnan Chakraborty

Hate speech encompasses verbal, written, or behavioral communication that targets derogatory or discriminatory language against individuals or groups based on sensitive characteristics. Automated hate speech detection plays a crucial role…

Computation and Language · Computer Science 2024-05-06 Tanmay Sen , Ansuman Das , Mrinmay Sen

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

Artificial Intelligence · Computer Science 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Data annotation, the practice of assigning descriptive labels to raw data, is pivotal in optimizing the performance of machine learning models. However, it is a resource-intensive process susceptible to biases introduced by annotators. The…

We introduce LAMPO, a novel paradigm that leverages Large Language Models (LLMs) for solving few-shot multi-class ordinal classification tasks. Unlike conventional methods, which concatenate all demonstration examples with the test instance…

Machine Learning · Computer Science 2024-08-08 Zhen Qin , Junru Wu , Jiaming Shen , Tianqi Liu , Xuanhui Wang

Hate speech has become pervasive in today's digital age. Although there has been considerable research to detect hate speech or generate counter speech to combat hateful views, these approaches still cannot completely eliminate the…

Computation and Language · Computer Science 2023-10-24 Vibhor Agarwal , Yu Chen , Nishanth Sastry

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

Large Language Models (LLMs) have become essential for offensive language detection, yet their ability to handle annotation disagreement remains underexplored. Disagreement samples, which arise from subjective interpretations, pose a unique…

Computation and Language · Computer Science 2025-05-20 Junyu Lu , Kai Ma , Kaichun Wang , Kelaiti Xiao , Roy Ka-Wei Lee , Bo Xu , Liang Yang , Hongfei Lin

Generative AI systems powered by Large Language Models (LLMs) usually use content moderation to prevent harmful content spread. To evaluate the robustness of content moderation, several metamorphic testing techniques have been proposed to…

Software Engineering · Computer Science 2025-03-24 Honghao Tan , Haibo Wang , Diany Pressato , Yisen Xu , Shin Hwei Tan

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

This paper explores the pressing issue of risk assessment in Large Language Models (LLMs) as they become increasingly prevalent in various applications. Focusing on how reward models, which are designed to fine-tune pretrained LLMs to align…

Computation and Language · Computer Science 2024-03-25 Bahareh Harandizadeh , Abel Salinas , Fred Morstatter

Online discussions, panels, talk page edits, etc., often contain harmful conversational content i.e., hate speech, death threats and offensive language, especially towards certain demographic groups. For example, individuals who identify as…

Computation and Language · Computer Science 2022-07-21 Jamell Dacon , Harry Shomer , Shaylynn Crum-Dacon , Jiliang Tang