English
Related papers

Related papers: The Attack Generator: A Systematic Approach Toward…

200 papers

Adversarial attacks against natural language processing systems, which perform seemingly innocuous modifications to inputs, can induce arbitrary mistakes to the target models. Though raised great concerns, such adversarial attacks can be…

Computation and Language · Computer Science 2020-10-07 Boxin Wang , Hengzhi Pei , Boyuan Pan , Qian Chen , Shuohang Wang , Bo Li

The design of better automated dialogue evaluation metrics offers the potential of accelerate evaluation research on conversational AI. However, existing trainable dialogue evaluation models are generally restricted to classifiers trained…

Computation and Language · Computer Science 2021-04-19 Xiang Gao , Yizhe Zhang , Michel Galley , Bill Dolan

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

Cryptography and Security · Computer Science 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

We introduce generative adversarial models in which the discriminator is replaced by a calibrated (non-differentiable) classifier repeatedly enhanced by domain relevant features. The role of the classifier is to prove that the actual and…

Machine Learning · Computer Science 2019-10-08 Shahar Harel , Meir Maor , Amir Ronen

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

Computation and Language · Computer Science 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

Adversarial attack is a technique for deceiving Machine Learning (ML) models, which provides a way to evaluate the adversarial robustness. In practice, attack algorithms are artificially selected and tuned by human experts to break a ML…

Cryptography and Security · Computer Science 2020-12-11 Xiaofeng Mao , Yuefeng Chen , Shuhui Wang , Hang Su , Yuan He , Hui Xue

There has been an ongoing cycle where stronger defenses against adversarial attacks are subsequently broken by a more advanced defense-aware attack. We present a new approach towards ending this cycle where we "deflect'' adversarial attacks…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

The convolutional neural network (CNN) architecture is increasingly being applied to new domains, such as malware detection, where it is able to learn malicious behavior from raw bytes extracted from executables. These architectures reach…

Machine Learning · Computer Science 2019-04-16 Octavian Suciu , Scott E. Coull , Jeffrey Johns

Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Markus Wenzel

The detection of computer-generated text is an area of rapidly increasing significance as nascent generative models allow for efficient creation of compelling human-like text, which may be abused for the purposes of spam, disinformation,…

Computation and Language · Computer Science 2022-10-05 Evan Crothers , Nathalie Japkowicz , Herna Viktor , Paula Branco

The holy grail of networking is to create \textit{cognitive networks} that organize, manage, and drive themselves. Such a vision now seems attainable thanks in large part to the progress in the field of machine learning (ML), which has now…

Networking and Internet Architecture · Computer Science 2019-06-04 Muhammad Usama , Junaid Qadir , Ala Al-Fuqaha , Mounir Hamdi

Despite the efficiency and scalability of machine learning systems, recent studies have demonstrated that many classification methods, especially deep neural networks (DNNs), are vulnerable to adversarial examples; i.e., examples that are…

Cryptography and Security · Computer Science 2021-11-22 Yao Li , Minhao Cheng , Cho-Jui Hsieh , Thomas C. M. Lee

Deep generative models are rapidly becoming a common tool for researchers and developers. However, as exhaustively shown for the family of discriminative models, the test-time inference of deep neural networks cannot be fully controlled and…

Machine Learning · Computer Science 2019-05-15 Dario Pasquini , Marco Mingione , Massimo Bernaschi

Adversarial classification is the task of performing robust classification in the presence of a strategic attacker. Originating from information hiding and multimedia forensics, adversarial classification recently received a lot of…

Cryptography and Security · Computer Science 2018-03-12 Pascal Schöttle , Alexander Schlögl , Cecilia Pasquini , Rainer Böhme

Classifiers fail to classify correctly input images that have been purposefully and imperceptibly perturbed to cause misclassification. This susceptability has been shown to be consistent across classifiers, regardless of their type,…

Machine Learning · Computer Science 2018-12-11 Blerta Lindqvist , Shridatt Sugrim , Rauf Izmailov

As generative AI, particularly large language models (LLMs), become increasingly integrated into production applications, new attack surfaces and vulnerabilities emerge and put a focus on adversarial threats in natural language and…

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen