中文
相关论文

相关论文: Enhancing LLM-based Hatred and Toxicity Detection …

200 篇论文

The evolution of digital communication systems and the designs of online platforms have inadvertently facilitated the subconscious propagation of toxic behavior. Giving rise to reactive responses to toxic behavior. Toxicity in online…

计算机与社会 · 计算机科学 2025-10-01 Smita Khapre , Melkamu Abay Mersha , Hassan Shakil , Jonali Baruah , Jugal Kalita

Hate speech, offensive language, aggression, racism, sexism, and other abusive language are common phenomena in social media. There is a need for Artificial Intelligence(AI)based intervention which can filter hate content at scale. Most…

计算与语言 · 计算机科学 2024-11-13 Prashant Kapil , Asif Ekbal

Effective toxic content detection relies heavily on high-quality and diverse data, which serve as the foundation for robust content moderation models. Synthetic data has become a common approach for training models across various NLP tasks.…

计算与语言 · 计算机科学 2025-02-25 Zheng Hui , Zhaoxiao Guo , Hang Zhao , Juanyong Duan , Lin Ai , Yinheng Li , Julia Hirschberg , Congrui Huang

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

机器学习 · 计算机科学 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng

The proliferation of social media platforms has led to an increase in the spread of hate speech, particularly targeting vulnerable communities. Unfortunately, existing methods for automatically identifying and blocking toxic language rely…

计算与语言 · 计算机科学 2025-02-24 Shiza Ali , Jeremy Blackburn , Gianluca Stringhini

Large Language Models (LLM) have made remarkable progress, but concerns about potential biases and harmful content persist. To address these apprehensions, we introduce a practical solution for ensuring LLM's safe and ethical use. Our novel…

密码学与安全 · 计算机科学 2025-04-24 Chaima Njeh , Haïfa Nakouri , Fehmi Jaafar

In the pursuit of developing Large Language Models (LLMs) that adhere to societal standards, it is imperative to detect the toxicity in the generated text. The majority of existing toxicity metrics rely on encoder models trained on specific…

计算与语言 · 计算机科学 2024-11-15 Hyukhun Koh , Dohyung Kim , Minwoo Lee , Kyomin Jung

Hateful memes have become a significant concern on the Internet, necessitating robust automated detection systems. While Large Multimodal Models (LMMs) have shown promise in hateful meme detection, they face notable challenges like…

计算与语言 · 计算机科学 2026-03-03 Jingbiao Mei , Jinghong Chen , Guangyu Yang , Weizhe Lin , Bill Byrne

The rapid growth in user generated content on social media has resulted in a significant rise in demand for automated content moderation. Various methods and frameworks have been proposed for the tasks of hate speech detection and toxic…

计算与语言 · 计算机科学 2024-09-27 Elizaveta Korotkova , Isaac Chung

In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and…

计算与语言 · 计算机科学 2025-05-01 Ahmad Nasir , Aadish Sharma , Kokil Jaidka , Saifuddin Ahmed

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

人工智能 · 计算机科学 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

The widespread dissemination of toxic content on social media poses a serious threat to both online environments and public discourse, highlighting the urgent need for detoxification methods that effectively remove toxicity while preserving…

机器学习 · 计算机科学 2025-07-08 Jing Yu , Yibo Zhao , Jiapeng Zhu , Wenming Shao , Bo Pang , Zhao Zhang , Xiang Li

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Minh-Hao Van , Xintao Wu

Hate, derogatory, and offensive speech remains a persistent challenge in online platforms and public discourse. While automated detection systems are widely used, most focus on censorship or removal, raising concerns for transparency and…

Large Language Models (LLMs) have raised increasing concerns about their misuse in generating hate speech. Among all the efforts to address this issue, hate speech detectors play a crucial role. However, the effectiveness of different…

密码学与安全 · 计算机科学 2025-01-29 Xinyue Shen , Yixin Wu , Yiting Qu , Michael Backes , Savvas Zannettou , Yang Zhang

Hate speech represents a pervasive and detrimental form of online discourse, often manifested through an array of slurs, from hateful tweets to defamatory posts. As such speech proliferates, it connects people globally and poses significant…

计算与语言 · 计算机科学 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community…

计算与语言 · 计算机科学 2023-10-31 Sarthak Roy , Ashish Harshavardhan , Animesh Mukherjee , Punyajoy Saha

In the digital world, memes present a unique challenge for content moderation due to their potential to spread harmful content. Although detection methods have improved, proactive solutions such as intervention are still limited, with…

计算与语言 · 计算机科学 2024-06-11 Prince Jha , Raghav Jain , Konika Mandal , Aman Chadha , Sriparna Saha , Pushpak Bhattacharyya

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection…

社会与信息网络 · 计算机科学 2023-11-15 Luca Luceri , Eric Boniardi , Emilio Ferrara

The proliferation of hate speech on social media platforms has necessitated the development of effective detection and moderation tools. This study evaluates the efficacy of various machine learning models in identifying hate speech and…

计算与语言 · 计算机科学 2026-02-25 Saurabh Mishra , Shivani Thakur , Radhika Mamidi