English
Related papers

Related papers: White-Box Attacks on Hate-speech BERT Classifiers …

200 papers

The increasing deployment of Large Language Models (LLMs) in various applications necessitates a rigorous evaluation of their robustness against adversarial attacks. In this paper, we present a comprehensive study on the robustness of GPT…

Computation and Language · Computer Science 2024-12-24 Yiyi Tao , Yixian Shen , Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du

We propose the first character-level white-box adversarial attack method against transformer models. The intuition of our method comes from the observation that words are split into subtokens before being fed into the transformer models and…

Computation and Language · Computer Science 2022-11-01 Aiwei Liu , Honghai Yu , Xuming Hu , Shu'ang Li , Li Lin , Fukun Ma , Yawen Yang , Lijie Wen

The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language…

Computation and Language · Computer Science 2023-05-31 Pranath Reddy Kumbam , Sohaib Uddin Syed , Prashanth Thamminedi , Suhas Harish , Ian Perera , Bonnie J. Dorr

The vulnerabilities of deep neural networks against adversarial examples have become a significant concern for deploying these models in sensitive domains. Devising a definitive defense against such attacks is proven to be challenging, and…

Machine Learning · Computer Science 2022-10-04 Xuwang Yin , Soheil Kolouri , Gustavo K. Rohde

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

Computation and Language · Computer Science 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai

Sentence-level attacks craft adversarial sentences that are synonymous with correctly-classified sentences but are misclassified by the text classifiers. Under the black-box setting, classifiers are only accessible through their feedback to…

Computation and Language · Computer Science 2024-02-22 Raha Moraffah , Huan Liu

We present our HABERTOR model for detecting hatespeech in large scale user-generated content. Inspired by the recent success of the BERT model, we propose several modifications to BERT to enhance the performance on the downstream hatespeech…

Computation and Language · Computer Science 2020-10-20 Thanh Tran , Yifan Hu , Changwei Hu , Kevin Yen , Fei Tan , Kyumin Lee , Serim Park

The dissemination of online hate speech can have serious negative consequences for individuals, online communities, and entire societies. This and the large volume of hateful online content prompted both practitioners', i.e., in content…

Computation and Language · Computer Science 2025-04-14 Julian Bäumler , Louis Blöcher , Lars-Joel Frey , Xian Chen , Markus Bayer , Christian Reuter

Machine learning algorithms are often vulnerable to adversarial examples that have imperceptible alterations from the original counterparts but can fool the state-of-the-art models. It is helpful to evaluate or even improve the robustness…

Computation and Language · Computer Science 2020-04-10 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Automated offensive language detection is essential in combating the spread of hate speech, particularly in social media. This paper describes our work on Offensive Language Identification in low resource Indic language Marathi. The problem…

Computation and Language · Computer Science 2022-12-21 Tanmay Chavan , Shantanu Patankar , Aditya Kane , Omkar Gokhale , Raviraj Joshi

Common problems in playing online mobile and computer games were related to toxic behavior and abusive communication among players. Based on different reports and studies, the study also discusses the impact of online hate speech and…

Computation and Language · Computer Science 2024-03-28 Daniel Fesalbon , Arvin De La Cruz , Marvin Mallari , Nelson Rodelas

The enormous amount of data being generated on the web and social media has increased the demand for detecting online hate speech. Detecting hate speech will reduce their negative impact and influence on others. A lot of effort in the…

Computation and Language · Computer Science 2021-11-03 Hind Saleh , Areej Alhothali , Kawthar Moria

Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life…

Machine Learning · Computer Science 2020-02-10 Siddhant Bhambri , Sumanyu Muku , Avinash Tulasi , Arun Balaji Buduru

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

Computation and Language · Computer Science 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Hate Speech takes many forms to target communities with derogatory comments, and takes humanity a step back in societal progress. HateXplain is a recently published and first dataset to use annotated spans in the form of rationales, along…

Computation and Language · Computer Science 2022-08-10 Arvind Subramaniam , Aryan Mehra , Sayani Kundu

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to identify hate speech in a…

Computation and Language · Computer Science 2021-01-12 Sayar Ghosh Roy , Ujwal Narayan , Tathagata Raha , Zubair Abid , Vasudeva Varma

Academic researchers and social media entities grappling with the identification of hate speech face significant challenges, primarily due to the vast scale of data and the dynamic nature of hate speech. Given the ethical and practical…

Computation and Language · Computer Science 2024-05-08 Dengyi Liu , Minghao Wang , Andrew G. Catlin

We investigate the adversarial robustness of LLMs in transfer learning scenarios. Through comprehensive experiments on multiple datasets (MBIB Hate Speech, MBIB Political Bias, MBIB Gender Bias) and various model architectures (BERT,…

Computation and Language · Computer Science 2025-06-10 Bohdan Turbal , Anastasiia Mazur , Jiaxu Zhao , Mykola Pechenizkiy

The adversarial vulnerability of deep networks has spurred the interest of researchers worldwide. Unsurprisingly, like images, adversarial examples also translate to time-series data as they are an inherent weakness of the model itself…

Machine Learning · Computer Science 2020-09-01 Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

The shift of public debate to the digital sphere has been accompanied by a rise in online hate speech. While many promising approaches for hate speech classification have been proposed, studies often focus only on a single language, usually…

Computation and Language · Computer Science 2023-01-03 Ana Kotarcic , Dominik Hangartner , Fabrizio Gilardi , Selina Kurer , Karsten Donnay