English
Related papers

Related papers: Towards Robust Toxic Content Classification

200 papers

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

Computation and Language · Computer Science 2025-09-26 Jonathan Rusert

Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT)…

Computation and Language · Computer Science 2022-06-24 Do-Myoung Lee , Yeachan Kim , Chang-gyun Seo

The growing importance of massive datasets used for deep learning makes robustness to label noise a critical property for classifiers to have. Sources of label noise include automatic labeling, non-expert labeling, and label corruption by…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Duncan Wilson , Kevin Gimpel

Although the semantic communications have exhibited satisfactory performance in a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise is a particular kind of…

Signal Processing · Electrical Eng. & Systems 2022-05-24 Qiyu Hu , Guangyi Zhang , Zhijin Qin , Yunlong Cai , Guanding Yu , Geoffrey Ye Li

The generation of toxic content by large language models (LLMs) remains a critical challenge for the safe deployment of language technology. We propose a novel framework for implicit knowledge editing and controlled text generation by…

Computation and Language · Computer Science 2025-06-02 Tassilo Klein , Moin Nabi

To improve policy robustness of deep reinforcement learning agents, a line of recent works focus on producing disturbances of the environment. Existing approaches of the literature to generate meaningful disturbances of the environment are…

Machine Learning · Computer Science 2022-10-04 Lucas Schott , Hatem Hajri , Sylvain Lamprier

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

Named entity recognition (NER) aims to identify mentions of named entities in an unstructured text and classify them into predefined named entity classes. While deep learning-based pre-trained language models help to achieve good predictive…

Computation and Language · Computer Science 2023-06-16 Ali Osman Berk Sapci , Oznur Tastan , Reyyan Yeniterzi

Neural networks are susceptible to artificially designed adversarial perturbations. Recent efforts have shown that imposing certain modifications on classification layer can improve the robustness of the neural networks. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Cong Xu , Xiang Li , Min Yang

Successful training of deep neural networks with noisy labels is an essential capability as most real-world datasets contain some amount of mislabeled data. Left unmitigated, label noise can sharply degrade typical supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Abel Brown , Benedikt Schifferer , Robert DiPietro

Existing backdoor defense methods are only effective for limited trigger types. To defend different trigger types at once, we start from the class-irrelevant nature of the poisoning process and propose a novel weakly supervised backdoor…

Computation and Language · Computer Science 2022-11-01 Lesheng Jin , Zihan Wang , Jingbo Shang

There is a growing body of literature showing that deep neural networks are vulnerable to adversarial input modification. Recently this work has been extended from image classification to malware classification over boolean features. In…

Machine Learning · Computer Science 2018-06-26 Alex Kouzemtchenko

Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying…

Computation and Language · Computer Science 2020-12-29 Sachin Saxena

Harmful text detection has become a crucial task in the development and deployment of large language models, especially as AI-generated content continues to expand across digital platforms. This study proposes a joint retrieval framework…

Computation and Language · Computer Science 2025-04-04 Zidong Yu , Shuo Wang , Nan Jiang , Weiqiang Huang , Xu Han , Junliang Du

The rapid growth of social media platforms has raised significant concerns regarding online content toxicity. When Large Language Models (LLMs) are used for toxicity detection, two key challenges emerge: 1) the absence of domain-specific…

Computation and Language · Computer Science 2025-06-03 Yibo Zhao , Jiapeng Zhu , Can Xu , Yao Liu , Xiang Li

Hate speech detection is a crucial area of research in natural language processing, essential for ensuring online community safety. However, detecting implicit hate speech, where harmful intent is conveyed in subtle or indirect ways,…

Computation and Language · Computer Science 2025-04-17 Yumin Kim , Hwanhee Lee

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

Computation and Language · Computer Science 2024-08-19 Anahita Samadi , Allison Sullivan

In recent years, deep learning has shown itself to be an incredibly valuable tool in cybersecurity as it helps network intrusion detection systems to classify attacks and detect new ones. Adversarial learning is the process of utilizing…

Cryptography and Security · Computer Science 2022-06-30 Jared Mathews , Prosenjit Chatterjee , Shankar Banik , Cory Nance

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

Cryptography and Security · Computer Science 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta

Text toxicity detection systems exhibit significant biases, producing disproportionate rates of false positives on samples mentioning demographic groups. But what about toxicity detection in speech? To investigate the extent to which…