中文
相关论文

相关论文: Shielding Google's language toxicity model against…

200 篇论文

Attackers create adversarial text to deceive both human perception and the current AI systems to perform malicious purposes such as spam product reviews and fake political posts. We investigate the difference between the adversarial and the…

计算与语言 · 计算机科学 2019-12-20 Hoang-Quoc Nguyen-Son , Tran Phuong Thao , Seira Hidano , Shinsaku Kiyomoto

Online debates are often characterised by extreme polarisation and heated discussions among users. The presence of hate speech online is becoming increasingly problematic, making necessary the development of appropriate countermeasures. In…

社会与信息网络 · 计算机科学 2021-05-31 Matteo Cinelli , Andraž Pelicon , Igor Mozetič , Walter Quattrociocchi , Petra Kralj Novak , Fabiana Zollo

Various techniques are used in the generation of adversarial examples, including methods such as TextBugger which introduce minor, hardly visible perturbations to words leading to changes in model behaviour. Another class of techniques…

计算与语言 · 计算机科学 2025-05-14 Paweł Walkowiak , Marek Klonowski , Marcin Oleksy , Arkadiusz Janz

Model distillation has become essential for creating smaller, deployable language models that retain larger system capabilities. However, widespread deployment raises concerns about resilience to adversarial manipulation. This paper…

机器学习 · 计算机科学 2025-10-17 Harsh Chaudhari , Jamie Hayes , Matthew Jagielski , Ilia Shumailov , Milad Nasr , Alina Oprea

In today's media landscape, where news outlets play a pivotal role in shaping public opinion, it is imperative to address the issue of sentiment manipulation within news text. News writers often inject their own biases and emotional…

计算与语言 · 计算机科学 2024-02-06 Alapan Kuila , Somnath Jena , Sudeshna Sarkar , Partha Pratim Chakrabarti

Adversarial samples are strategically modified samples, which are crafted with the purpose of fooling a classifier at hand. An attacker introduces specially crafted adversarial samples to a deployed classifier, which are being…

机器学习 · 计算机科学 2017-07-11 Suranjana Samanta , Sameep Mehta

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

计算与语言 · 计算机科学 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

计算与语言 · 计算机科学 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Adversarial training provides a means of regularizing supervised learning algorithms while virtual adversarial training is able to extend supervised learning algorithms to the semi-supervised setting. However, both methods require making…

机器学习 · 统计学 2021-11-17 Takeru Miyato , Andrew M. Dai , Ian Goodfellow

Hate speech is a form of online harassment that involves the use of abusive language, and it is commonly seen in social media posts. This sort of harassment mainly focuses on specific group characteristics such as religion, gender,…

计算与语言 · 计算机科学 2022-06-10 Georgios K. Pitsilis

Many word-level adversarial attack approaches for textual data have been proposed in recent studies. However, due to the massive search space consisting of combinations of candidate words, the existing approaches face the problem of…

计算与语言 · 计算机科学 2022-11-15 Xingyi Zhao , Lu Zhang , Depeng Xu , Shuhan Yuan

The evolution of digital communication systems and the designs of online platforms have inadvertently facilitated the subconscious propagation of toxic behavior. Giving rise to reactive responses to toxic behavior. Toxicity in online…

计算机与社会 · 计算机科学 2025-10-01 Smita Khapre , Melkamu Abay Mersha , Hassan Shakil , Jonali Baruah , Jugal Kalita

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

计算与语言 · 计算机科学 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

There is an ongoing debate about how to moderate toxic speech on social media and the impact of content moderation on online discourse. This paper proposes and validates a methodology for measuring the content-moderation-induced distortions…

社会与信息网络 · 计算机科学 2026-03-04 Mahyar Habibi , Dirk Hovy , Carlo Schwarz

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

社会与信息网络 · 计算机科学 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

In the pursuit of bolstering user safety, social media platforms deploy active moderation strategies, including content removal and user suspension. These measures target users engaged in discussions marked by hate speech or toxicity, often…

社会与信息网络 · 计算机科学 2024-01-26 Hina Qayyum , Muhammad Ikram , Benjamin Zi Hao Zhao , Ian D. Wood , Nicolas Kourtellis , Mohamed Ali Kaafar

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

计算与语言 · 计算机科学 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

The rapid growth of social media in recent years has fed into some highly undesirable phenomena such as proliferation of abusive and offensive language on the Internet. Previous research suggests that such hateful content tends to come from…

计算与语言 · 计算机科学 2019-02-19 Pushkar Mishra , Marco Del Tredici , Helen Yannakoudakis , Ekaterina Shutova

Advancements in Machine Learning & Neural Networks in recent years have led to widespread implementations of Natural Language Processing across a variety of fields with remarkable success, solving a wide range of complicated problems.…

计算与语言 · 计算机科学 2025-11-17 Saadat Rafid Ahmed , Rubayet Shareen , Radoan Sharkar , Nazia Hossain , Mansur Mahi , Farig Yousuf Sadeque

Large language models have many beneficial applications, but can they also be used to attack content-filtering algorithms in social media platforms? We investigate the challenge of generating adversarial examples to test the robustness of…

计算与语言 · 计算机科学 2025-09-04 Piotr Przybyła , Euan McGill , Horacio Saggion