中文
相关论文

相关论文: Attacking Misinformation Detection Using Adversari…

200 篇论文

Backdoor attacks manipulate model predictions by inserting innocuous triggers into training and test data. We focus on more realistic and more challenging clean-label attacks where the adversarial training examples are correctly labeled.…

机器学习 · 计算机科学 2023-10-31 Wencong You , Zayd Hammoudeh , Daniel Lowd

This study addresses the critical challenge of detecting DeepFake tweets by leveraging advanced natural language processing (NLP) techniques to distinguish between genuine and AI-generated texts. Given the increasing prevalence of…

计算与语言 · 计算机科学 2024-06-25 Adam Frej , Adrian Kaminski , Piotr Marciniak , Szymon Szmajdzinski , Soveatin Kuntur , Anna Wroblewska

The prevalence of propaganda in our digital society poses a challenge to societal harmony and the dissemination of truth. Detecting propaganda through NLP in text is challenging due to subtle manipulation techniques and contextual…

计算与语言 · 计算机科学 2023-11-28 Kilian Sprenkamp , Daniel Gordon Jones , Liudmila Zavolokina

The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language…

计算与语言 · 计算机科学 2023-05-31 Pranath Reddy Kumbam , Sohaib Uddin Syed , Prashanth Thamminedi , Suhas Harish , Ian Perera , Bonnie J. Dorr

Advances in large language models have raised concerns about their potential use in generating compelling election disinformation at scale. This study presents a two-part investigation into the capabilities of LLMs to automate stages of an…

Adversarial examples expose the vulnerabilities of natural language processing (NLP) models, and can be used to evaluate and improve their robustness. Existing techniques of generating such examples are typically driven by local heuristic…

计算与语言 · 计算机科学 2021-03-16 Dianqi Li , Yizhe Zhang , Hao Peng , Liqun Chen , Chris Brockett , Ming-Ting Sun , Bill Dolan

Large Language Models (LLMs) are increasingly used in applications where the model selects from competing third-party content, such as in LLM-powered search engines or chatbot plugins. In this paper, we introduce Preference Manipulation…

密码学与安全 · 计算机科学 2024-07-03 Fredrik Nestaas , Edoardo Debenedetti , Florian Tramèr

Machine learning models, especially deep neural networks (DNNs), have been shown to be vulnerable against adversarial examples which are carefully crafted samples with a small magnitude of the perturbation. Such adversarial perturbations…

计算机视觉与模式识别 · 计算机科学 2020-03-23 Anand Bhattad , Min Jin Chong , Kaizhao Liang , Bo Li , D. A. Forsyth

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

计算与语言 · 计算机科学 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

计算与语言 · 计算机科学 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

Social media platforms are deploying machine learning based offensive language classification systems to combat hateful, racist, and other forms of offensive speech at scale. However, despite their real-world deployment, we do not yet…

计算与语言 · 计算机科学 2022-03-23 Jonathan Rusert , Zubair Shafiq , Padmini Srinivasan

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical…

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

密码学与安全 · 计算机科学 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Adversarial examples are vital to expose the vulnerability of machine learning models. Despite the success of the most popular substitution-based methods which substitutes some characters or words in the original examples, only substitution…

计算与语言 · 计算机科学 2020-12-21 Zhihong Shao , Zitao Liu , Jiyong Zhang , Zhongqin Wu , Minlie Huang

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

机器学习 · 统计学 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Language agents increasingly act as web-enabled systems that search, browse, and synthesize information from diverse sources. However, these sources can include unreliable or adversarial content, and the robustness of agents to adversarial…

人工智能 · 计算机科学 2026-03-03 Shrey Shah , Levent Ozgur

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

人工智能 · 计算机科学 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

A novel hack involving Large Language Models (LLMs) has emerged, exploiting adversarial suffixes to deceive models into generating perilous responses. Such jailbreaks can trick LLMs into providing intricate instructions to a malicious user…

计算与语言 · 计算机科学 2023-11-08 Gabriel Alon , Michael Kamfonas

Large-scale language models achieved state-of-the-art performance over a number of language tasks. However, they fail on adversarial language examples, which are sentences optimized to fool the language models but with similar semantic…

计算与语言 · 计算机科学 2023-10-31 Noah Thomas McDermott , Junfeng Yang , Chengzhi Mao

Large Language Models (LLMs) are being enhanced with the ability to use tools and to process multiple modalities. These new capabilities bring new benefits and also new security risks. In this work, we show that an attacker can use visual…