English
Related papers

Related papers: Shielding Google's language toxicity model against…

200 papers

Attackers create adversarial text to deceive both human perception and the current AI systems to perform malicious purposes such as spam product reviews and fake political posts. We investigate the difference between the adversarial and the…

Computation and Language · Computer Science 2019-12-20 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

Online debates are often characterised by extreme polarisation and heated discussions among users. The presence of hate speech online is becoming increasingly problematic, making necessary the development of appropriate countermeasures. In…

Social and Information Networks · Computer Science 2021-05-31 Matteo Cinelli , Andraž Pelicon , Igor Mozetič , Walter Quattrociocchi , Petra Kralj Novak , Fabiana Zollo

Various techniques are used in the generation of adversarial examples, including methods such as TextBugger which introduce minor, hardly visible perturbations to words leading to changes in model behaviour. Another class of techniques…

Computation and Language · Computer Science 2025-05-14 Paweł Walkowiak , Marek Klonowski , Marcin Oleksy , Arkadiusz Janz

Model distillation has become essential for creating smaller, deployable language models that retain larger system capabilities. However, widespread deployment raises concerns about resilience to adversarial manipulation. This paper…

Machine Learning · Computer Science 2025-10-17 Harsh Chaudhari , Jamie Hayes , Matthew Jagielski , Ilia Shumailov , Milad Nasr , Alina Oprea

In today's media landscape, where news outlets play a pivotal role in shaping public opinion, it is imperative to address the issue of sentiment manipulation within news text. News writers often inject their own biases and emotional…

Computation and Language · Computer Science 2024-02-06 Alapan Kuila , Somnath Jena , Sudeshna Sarkar , Partha Pratim Chakrabarti

Adversarial samples are strategically modified samples, which are crafted with the purpose of fooling a classifier at hand. An attacker introduces specially crafted adversarial samples to a deployed classifier, which are being…

Machine Learning · Computer Science 2017-07-11 Suranjana Samanta , Sameep Mehta

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

Computation and Language · Computer Science 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

Machine Learning · Statistics 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

Hate speech is a form of online harassment that involves the use of abusive language, and it is commonly seen in social media posts. This sort of harassment mainly focuses on specific group characteristics such as religion, gender,…

Computation and Language · Computer Science 2022-06-10 Georgios K. Pitsilis

Many word-level adversarial attack approaches for textual data have been proposed in recent studies. However, due to the massive search space consisting of combinations of candidate words, the existing approaches face the problem of…

Computation and Language · Computer Science 2022-11-15 Xingyi Zhao , Lu Zhang , Depeng Xu , Shuhan Yuan

The evolution of digital communication systems and the designs of online platforms have inadvertently facilitated the subconscious propagation of toxic behavior. Giving rise to reactive responses to toxic behavior. Toxicity in online…

Computers and Society · Computer Science 2025-10-01 Smita Khapre , Melkamu Abay Mersha , Hassan Shakil , Jonali Baruah , Jugal Kalita

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

Computation and Language · Computer Science 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

There is an ongoing debate about how to moderate toxic speech on social media and the impact of content moderation on online discourse. This paper proposes and validates a methodology for measuring the content-moderation-induced distortions…

Social and Information Networks · Computer Science 2026-03-04 Mahyar Habibi , Dirk Hovy , Carlo Schwarz

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

Social and Information Networks · Computer Science 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

In the pursuit of bolstering user safety, social media platforms deploy active moderation strategies, including content removal and user suspension. These measures target users engaged in discussions marked by hate speech or toxicity, often…

Social and Information Networks · Computer Science 2024-01-26 Hina Qayyum , Muhammad Ikram , Benjamin Zi Hao Zhao , Ian D. Wood , Nicolas Kourtellis , Mohamed Ali Kaafar

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

Computation and Language · Computer Science 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

The rapid growth of social media in recent years has fed into some highly undesirable phenomena such as proliferation of abusive and offensive language on the Internet. Previous research suggests that such hateful content tends to come from…

Computation and Language · Computer Science 2019-02-19 Pushkar Mishra , Marco Del Tredici , Helen Yannakoudakis , Ekaterina Shutova

Advancements in Machine Learning & Neural Networks in recent years have led to widespread implementations of Natural Language Processing across a variety of fields with remarkable success, solving a wide range of complicated problems.…

Computation and Language · Computer Science 2025-11-17 Saadat Rafid Ahmed , Rubayet Shareen , Radoan Sharkar , Nazia Hossain , Mansur Mahi , Farig Yousuf Sadeque

Large language models have many beneficial applications, but can they also be used to attack content-filtering algorithms in social media platforms? We investigate the challenge of generating adversarial examples to test the robustness of…

Computation and Language · Computer Science 2025-09-04 Piotr Przybyła , Euan McGill , Horacio Saggion