English
Related papers

Related papers: RobustMask: Certified Robustness against Adversari…

200 papers

In many online platforms, customers' decisions are substantially influenced by product rankings as most customers only examine a few top-ranked products. Concurrently, such platforms also use the same data corresponding to customers'…

Machine Learning · Computer Science 2020-09-14 Negin Golrezaei , Vahideh Manshadi , Jon Schneider , Shreyas Sekar

Deep neural networks for natural language processing are fragile in the face of adversarial examples -- small input perturbations, like synonym substitution or word duplication, which cause a neural network to change its prediction. We…

Machine Learning · Computer Science 2021-09-08 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu

The growing adoption of Retrieval-Augmented Generation (RAG) has led to a rise in adversarial attacks. Existing defenses, relying on semantic analysis or voting, face a trade-off between high computational cost and limited robustness under…

Cryptography and Security · Computer Science 2026-05-20 Chengcai Gao , Zhihong Sun , Xiaochuan Shi , Qiufeng Wang , Chao Liang

Language models (LMs) are indispensable tools for natural language processing tasks, but their vulnerability to adversarial attacks remains a concern. While current research has explored adversarial training techniques, their improvements…

Computation and Language · Computer Science 2024-03-28 Brian Formento , Wenjie Feng , Chuan Sheng Foo , Luu Anh Tuan , See-Kiong Ng

Face recognition (FR) has recently made substantial progress and achieved high accuracy on standard benchmarks. However, it has raised security concerns in enormous FR applications because deep CNNs are unusually vulnerable to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xiao Yang , Dingcheng Yang , Yinpeng Dong , Hang Su , Wenjian Yu , Jun Zhu

This work studies the threats of adversarial attack on multivariate probabilistic forecasting models and viable defense mechanisms. Our studies discover a new attack pattern that negatively impact the forecasting of a target time series via…

Machine Learning · Computer Science 2023-04-17 Linbo Liu , Youngsuk Park , Trong Nghia Hoang , Hilaf Hasson , Jun Huan

There has been considerable and growing interest in applying machine learning for cyber defenses. One promising approach has been to apply natural language processing techniques to analyze logs data for suspicious behavior. A natural…

Machine Learning · Computer Science 2020-07-30 Kai Steverson , Jonathan Mullin , Metin Ahiskali

Recently, it has been widely known that deep neural networks are highly vulnerable and easily broken by adversarial attacks. To mitigate the adversarial vulnerability, many defense algorithms have been proposed. Recently, to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Hong Joo Lee , Yong Man Ro

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

As Large Language Models make a breakthrough in natural language processing tasks (NLP), multimodal technique becomes extremely popular. However, it has been shown that multimodal NLP are vulnerable to adversarial attacks, where the outputs…

Computation and Language · Computer Science 2026-03-16 Hao Wang , Jinzhe Jiang , Xin Zhang , Chen Li

With deep neural networks providing state-of-the-art machine learning models for numerous machine learning tasks, quantifying the robustness of these models has become an important area of research. However, most of the research literature…

Machine Learning · Computer Science 2019-01-08 Tsui-Wei Weng , Pin-Yu Chen , Lam M. Nguyen , Mark S. Squillante , Ivan Oseledets , Luca Daniel

We extend BeamAttack, an adversarial attack algorithm designed to evaluate the robustness of text classification systems through word-level modifications guided by beam search. Our extensions include support for word deletions and the…

Computation and Language · Computer Science 2025-07-04 Arnisa Fazla , Lucas Krauter , David Guzman Piedrahita , Andrianos Michail

Deep neural networks (DNNs) are vulnerable to adversarial noises, which motivates the benchmark of model robustness. Existing benchmarks mainly focus on evaluating defenses, but there are no comprehensive studies of how architecture design…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Shiyu Tang , Ruihao Gong , Yan Wang , Aishan Liu , Jiakai Wang , Xinyun Chen , Fengwei Yu , Xianglong Liu , Dawn Song , Alan Yuille , Philip H. S. Torr , Dacheng Tao

Despite the impressive adaptability of large language models (LLMs), challenges remain in ensuring their security, transparency, and interpretability. Given their susceptibility to adversarial attacks, LLMs need to be defended with an…

Artificial Intelligence · Computer Science 2024-10-11 Tomas Bueno Momcilovic , Beat Buesser , Giulio Zizzo , Mark Purcell , Dian Balta

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

The fine-tuning of pre-trained language models has a great success in many NLP fields. Yet, it is strikingly vulnerable to adversarial examples, e.g., word substitution attacks using only synonyms can easily fool a BERT-based sentiment…

Computation and Language · Computer Science 2021-12-23 Xinhsuai Dong , Luu Anh Tuan , Min Lin , Shuicheng Yan , Hanwang Zhang

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry