中文
相关论文

相关论文: ToXCL: A Unified Framework for Toxic Speech Detect…

200 篇论文

Illicit online promotion is a persistent threat that evolves to evade detection. Existing moderation systems remain tethered to platform-specific supervision and static taxonomies, a reactive paradigm that struggles to generalize across…

密码学与安全 · 计算机科学 2026-03-31 Sangyi Wu , Junpu Guo , Xianghang Mi

Text detoxification aims to minimize the risk of language models producing toxic content. Existing detoxification methods of directly constraining the model output or further training the model on the non-toxic corpus fail to achieve a…

计算与语言 · 计算机科学 2024-10-14 Zecheng Tang , Keyan Zhou , Juntao Li , Yuyang Ding , Pinzheng Wang , Bowen Yan , Rejie Hua , Min Zhang

In this paper, we propose a multi-label classification framework to detect multiple speaking styles in a speech sample. Unlike previous studies that have primarily focused on identifying a single target style, our framework effectively…

音频与语音处理 · 电气工程与系统科学 2025-09-19 Miseul Kim , Seyun Um , Hyeonjin Cha , Hong-goo Kang

Identifying the targets of hate speech is a crucial step in grasping the nature of such speech and, ultimately, in improving the detection of offensive posts on online forums. Much harmful content on online platforms uses implicit language…

计算与语言 · 计算机科学 2024-07-01 Nazanin Jafari , James Allan , Sheikh Muhammad Sarwar

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

计算与语言 · 计算机科学 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely…

计算与语言 · 计算机科学 2026-01-21 Kaituo Zhang , Zhimeng Jiang , Na Zou

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation…

计算与语言 · 计算机科学 2026-04-23 Huy Nghiem , Advik Sachdeva , Hal Daumé

Grammatical Error Correction (GEC) faces a critical challenge concerning explainability, notably when GEC systems are designed for language learners. Existing research predominantly focuses on explaining grammatical errors extracted in…

计算与语言 · 计算机科学 2025-02-24 Jingheng Ye , Shang Qin , Yinghui Li , Hai-Tao Zheng , Shen Wang , Qingsong Wen

Hate, derogatory, and offensive speech remains a persistent challenge in online platforms and public discourse. While automated detection systems are widely used, most focus on censorship or removal, raising concerns for transparency and…

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

计算与语言 · 计算机科学 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

With the rise of online hate speech, automatic detection of Hate Speech, Offensive texts as a natural language processing task is getting popular. However, very little research has been done to detect unintended social bias from these toxic…

计算与语言 · 计算机科学 2022-10-24 Nihar Sahoo , Himanshu Gupta , Pushpak Bhattacharyya

Language is a deep-rooted means of perpetration of stereotypes and discrimination. Large Language Models (LLMs), now a pervasive technology in our everyday lives, can cause extensive harm when prone to generating toxic responses. The…

软件工程 · 计算机科学 2026-02-06 Simone Corbo , Luca Bancale , Valeria De Gennaro , Livia Lestingi , Vincenzo Scotti , Matteo Camilli

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

计算与语言 · 计算机科学 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Despite the recent successes of transformer-based models in terms of effectiveness on a variety of tasks, their decisions often remain opaque to humans. Explanations are particularly important for tasks like offensive language or toxicity…

计算与语言 · 计算机科学 2021-03-03 Tong Xiang , Sean MacAvaney , Eugene Yang , Nazli Goharian

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Extending pre-trained text Large Language Models (LLMs)'s speech understanding or generation abilities by introducing various effective speech tokens has attracted great attention in the speech community. However, building a unified speech…

声音 · 计算机科学 2025-11-18 Yuanyuan Wang , Dongchao Yang , Yiwen Shao , Hangting Chen , Jiankun Zhao , Zhiyong Wu , Helen Meng , Xixin Wu

Large language models (LLMs) can elicit social bias during generations, especially when inference with toxic prompts. Controlling the sensitive attributes in generation encounters challenges in data distribution, generalizability, and…

计算与语言 · 计算机科学 2024-05-30 Xueyao Sun , Kaize Shi , Haoran Tang , Guandong Xu , Qing Li

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

计算与语言 · 计算机科学 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Large Language Models remain vulnerable to adversarial prompts that elicit toxic content even after safety alignment. We present ToxSearch, a black-box evolutionary framework that tests model safety by evolving prompts in a synchronous…

神经与进化计算 · 计算机科学 2026-01-27 Onkar Shelar , Travis Desell