中文
相关论文

相关论文: Enhancing LLM-based Hatred and Toxicity Detection …

200 篇论文

Hate speech is harmful content that directly attacks or promotes hatred against members of groups or individuals based on actual or perceived aspects of identity, such as racism, religion, or sexual orientation. This can affect social life…

计算与语言 · 计算机科学 2024-03-19 Arijit Das , Somashree Nandy , Rupam Saha , Srijan Das , Diganta Saha

This paper proposes a novelty approach to mitigate the negative transfer problem. In the field of machine learning, the common strategy is to apply the Single-Task Learning approach in order to train a supervised model to solve a specific…

计算与语言 · 计算机科学 2023-07-10 Angel Felipe Magnossão de Paula , Paolo Rosso , Damiano Spina

Hateful content online is often expressed using fact-like, not necessarily correct information, especially in coordinated online harassment campaigns and extremist propaganda. Failing to jointly address hate speech (HS) and misinformation…

计算与语言 · 计算机科学 2026-03-27 Nicolás Benjamín Ocampo , Tommaso Caselli , Davide Ceolin

Due to the subtleness, implicity, and different possible interpretations perceived by different people, detecting undesirable content from text is a nuanced difficulty. It is a long-known risk that language models (LMs), once trained on…

计算与语言 · 计算机科学 2022-05-26 Yau-Shian Wang , Yingshan Chang

Automatic identification of hateful and abusive content is vital in combating the spread of harmful online content and its damaging effects. Most existing works evaluate models by examining the generalization error on train-test splits on…

计算与语言 · 计算机科学 2025-04-07 Lanqin Yuan , Marian-Andrei Rizoiu

Social media platforms have experienced a significant rise in toxic content, including abusive language and discriminatory remarks, presenting growing challenges for content moderation. Some users evade censorship by deliberately disguising…

计算与语言 · 计算机科学 2025-06-06 Xuchen Ma , Jianxiang Yu , Wenming Shao , Bo Pang , Xiang Li

Detecting hateful content is a challenging and important problem. Automated tools, like machine-learning models, can help, but they require continuous training to adapt to the ever-changing landscape of social media. In this work, we…

计算与语言 · 计算机科学 2025-11-06 Jay Patel , Hrudayangam Mehta , Jeremy Blackburn

Detoxification, the task of rewriting harmful language into non-toxic text, has become increasingly important amid the growing prevalence of toxic content online. However, high-quality parallel datasets for detoxification, especially for…

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

计算与语言 · 计算机科学 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

计算与语言 · 计算机科学 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely…

计算与语言 · 计算机科学 2026-01-21 Kaituo Zhang , Zhimeng Jiang , Na Zou

We present the Multi-Modal Discussion Transformer (mDT), a novel methodfor detecting hate speech in online social networks such as Reddit discussions. In contrast to traditional comment-only methods, our approach to labelling a comment as…

计算与语言 · 计算机科学 2024-02-23 Liam Hebert , Gaurav Sahu , Yuxuan Guo , Nanda Kishore Sreenivas , Lukasz Golab , Robin Cohen

Recently, people have suffered from LLM hallucination and have become increasingly aware of the reliability gap of LLMs in open and knowledge-intensive tasks. As a result, they have increasingly turned to search-augmented LLMs to mitigate…

计算与语言 · 计算机科学 2026-02-10 Yu Yan , Sheng Sun , Mingfeng Li , Zheming Yang , Chiwei Zhu , Fei Ma , Benfeng Xu , Min Liu , Qi Li

Detecting online sexual predatory behaviours and abusive language on social media platforms has become a critical area of research due to the growing concerns about online safety, especially for vulnerable populations such as children and…

计算与语言 · 计算机科学 2023-08-29 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

计算与语言 · 计算机科学 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Memes, as a widely used mode of online communication, often serve as vehicles for spreading harmful content. However, limitations in data accessibility and the high costs of dataset curation hinder the development of robust meme moderation…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Subhankar Swain , Naquee Rizwan , Vishwa Gangadhar S , Nayandeep Deb , Animesh Mukherjee

The spread of hate speech on social media space is currently a serious issue. The undemanding access to the enormous amount of information being generated on these platforms has led people to post and react with toxic content that…

计算与语言 · 计算机科学 2022-09-13 Abhishek Velankar , Hrushikesh Patil , Raviraj Joshi

Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks. However, their practical application in high-stake domains, such as fraud and abuse detection, remains an area that requires…

计算与语言 · 计算机科学 2024-09-11 Joymallya Chakraborty , Wei Xia , Anirban Majumder , Dan Ma , Walid Chaabene , Naveed Janvekar

Hate speech detection is a critical problem in social media platforms, being often accused for enabling the spread of hatred and igniting physical violence. Hate speech detection requires overwhelming resources including high-performance…

计算与语言 · 计算机科学 2020-05-14 Tomer Wullach , Amir Adler , Einat Minkov

In this paper, we explore the feasibility of leveraging large language models (LLMs) to automate or otherwise assist human raters with identifying harmful content including hate speech, harassment, violent extremism, and election…