中文
相关论文

相关论文: Guided Perturbation Sensitivity (GPS): Detecting A…

200 篇论文

Nowadays, powerful large language models (LLMs) such as ChatGPT have demonstrated revolutionary power in a variety of tasks. Consequently, the detection of machine-generated texts (MGTs) is becoming increasingly crucial as LLMs become more…

密码学与安全 · 计算机科学 2024-01-17 Xinlei He , Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

We propose a test-time defense mechanism against adversarial attacks: imperceptible image perturbations that significantly alter the predictions of a model. Unlike existing methods that rely on feature filtering or smoothing, which can lead…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Dong Lao , Yuxiang Zhang , Haniyeh Ehsani Oskouie , Yangchao Wu , Alex Wong , Stefano Soatto

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

计算与语言 · 计算机科学 2024-08-19 Anahita Samadi , Allison Sullivan

Linguistic representation learning in deep neural language models (LMs) has been studied for decades, for both practical and theoretical reasons. However, finding representations in LMs remains an unsolved problem, in part due to a dilemma…

计算与语言 · 计算机科学 2026-03-26 Joshua Rozner , Cory Shain

Neural ranking models have achieved remarkable progress and are now widely deployed in real-world applications such as Retrieval-Augmented Generation (RAG). However, like other neural architectures, they remain vulnerable to adversarial…

密码学与安全 · 计算机科学 2025-12-30 Jiawei Liu , Zhuo Chen , Rui Zhu , Miaokun Chen , Yuyang Gong , Wei Lu , Xiaofeng Wang

We evaluate machine comprehension models' robustness to noise and adversarial attacks by performing novel perturbations at the character, word, and sentence level. We experiment with different amounts of perturbations to examine model…

计算与语言 · 计算机科学 2020-05-04 Winston Wu , Dustin Arendt , Svitlana Volkova

It is imperative to ensure the stability of every prediction made by a language model; that is, a language's prediction should remain consistent despite minor input variations, like word substitutions. In this paper, we investigate the…

计算与语言 · 计算机科学 2024-06-06 Qian Lou , Xin Liang , Jiaqi Xue , Yancheng Zhang , Rui Xie , Mengxin Zheng

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

计算与语言 · 计算机科学 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Machine learning and deep learning in particular has advanced tremendously on perceptual tasks in recent years. However, it remains vulnerable against adversarial perturbations of the input that have been crafted specifically to fool the…

机器学习 · 统计学 2017-02-22 Jan Hendrik Metzen , Tim Genewein , Volker Fischer , Bastian Bischoff

Recent work has proposed several efficient approaches for generating gradient-based adversarial perturbations on embeddings and proved that the model's performance and robustness can be improved when they are trained with these contaminated…

计算与语言 · 计算机科学 2021-09-15 Yao Qiu , Jinchao Zhang , Jie Zhou

Following great success in the image processing field, the idea of adversarial training has been applied to tasks in the natural language processing (NLP) field. One promising approach directly applies adversarial training developed in the…

机器学习 · 计算机科学 2018-05-09 Motoki Sato , Jun Suzuki , Hiroyuki Shindo , Yuji Matsumoto

It is well known that carefully crafted imperceptible perturbations can cause state-of-the-art deep learning classification models to misclassify. Understanding and analyzing these adversarial perturbations play a crucial role in the design…

图像与视频处理 · 电气工程与系统科学 2023-08-08 P Charantej Reddy , Aditya Siripuram , Sumohana S. Channappayya

Front-line police officers often categorize all police call reported cases of Telecom Fraud into 14 subcategories to facilitate targeted prevention measures, such as precise public education. However, the associated data is characterized by…

人工智能 · 计算机科学 2024-11-12 Liu Zhuoxian , Shi Tuo , Hu Xiaofeng

Adversarial examples pose a significant challenge to deep neural networks (DNNs) across both image and text domains, with the intent to degrade model performance through meticulously altered inputs. Adversarial texts, however, are distinct…

机器学习 · 计算机科学 2025-01-24 Shakila Mahjabin Tonni , Pedro Faustini , Mark Dras

Recently, few certified defense methods have been developed to provably guarantee the robustness of a text classifier to adversarial synonym substitutions. However, all existing certified defense methods assume that the defenders are…

计算与语言 · 计算机科学 2021-07-27 Jiehang Zeng , Xiaoqing Zheng , Jianhan Xu , Linyang Li , Liping Yuan , Xuanjing Huang

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

机器学习 · 计算机科学 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

密码学与安全 · 计算机科学 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta

There has been a recent surge in research on adversarial perturbations that defeat Deep Neural Networks (DNNs) in machine vision; most of these perturbation-based attacks target object classifiers. Inspired by the observation that humans…

计算机视觉与模式识别 · 计算机科学 2020-07-27 Shasha Li , Shitong Zhu , Sudipta Paul , Amit Roy-Chowdhury , Chengyu Song , Srikanth Krishnamurthy , Ananthram Swami , Kevin S Chan

Global Navigation Satellite System (GNSS) signals are fundamental in applications across navigation, transportation, and industrial networks. However, their extremely low received power makes them highly vulnerable to radio-frequency…

信号处理 · 电气工程与系统科学 2025-12-09 Zawar Hussain , Arslan Majal , Aamir Hussain Chughtai , Talha Nadeem

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

计算与语言 · 计算机科学 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He