English
Related papers

Related papers: Availability Attacks Create Shortcuts

200 papers

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

Computation and Language · Computer Science 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

Cryptography and Security · Computer Science 2023-06-30 Nils Lukas , Florian Kerschbaum

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

Machine Learning · Computer Science 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Advanced Persistent Threats (APTs) are sophisticated, targeted cyberattacks designed to gain unauthorized access to systems and remain undetected for extended periods. To evade detection, APT cyberattacks deceive defense layers with…

Cryptography and Security · Computer Science 2024-06-28 Sidahmed Benabderrahmane , Ngoc Hoang , Petko Valtchev , James Cheney , Talal Rahwan

Most state-of-the-art machine learning (ML) classification systems are vulnerable to adversarial perturbations. As a consequence, adversarial robustness poses a significant challenge for the deployment of ML-based systems in safety- and…

Machine Learning · Computer Science 2019-06-18 Felix Assion , Peter Schlicht , Florens Greßner , Wiebke Günther , Fabian Hüger , Nico Schmidt , Umair Rasheed

Leading language model (LM) providers like OpenAI and Anthropic allow customers to fine-tune frontier LMs for specific use cases. To prevent abuse, these providers apply filters to block fine-tuning on overtly harmful data. In this setting,…

Cryptography and Security · Computer Science 2025-07-15 Joshua Kazdan , Abhay Puri , Rylan Schaeffer , Lisa Yu , Chris Cundy , Jason Stanley , Sanmi Koyejo , Krishnamurthy Dvijotham

Artificial neural networks tend to learn only what they need for a task. A manipulation of the training data can counter this phenomenon. In this paper, we study the effect of different alterations of the training data, which limit the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Clemens Seibold , Wojciech Samek , Anna Hilsmann , Peter Eisert

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

In this work we present a formal theoretical framework for assessing and analyzing two classes of malevolent action towards generic Artificial Intelligence (AI) systems. Our results apply to general multi-class classifiers that map from an…

Machine Learning · Computer Science 2021-01-01 Ivan Y. Tyukin , Desmond J. Higham , Alexander N. Gorban

In established network architectures, shortcut connections are often used to take the outputs of earlier layers as additional inputs to later layers. Despite the extraordinary effectiveness of shortcuts, there remain open questions on the…

Machine Learning · Computer Science 2021-11-15 Fenglei Fan , Dayang Wang , Hengtao Guo , Qikui Zhu , Pingkun Yan , Ge Wang , Hengyong Yu

Deep neural networks obtain state-of-the-art performance on a series of tasks. However, they are easily fooled by adding a small adversarial perturbation to input. The perturbation is often human imperceptible on image data. We observe a…

Machine Learning · Computer Science 2019-06-11 Puyudi Yang , Jianbo Chen , Cho-Jui Hsieh , Jane-Ling Wang , Michael I. Jordan

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

These days, deep learning models have achieved great success in multiple fields, from autonomous driving to medical diagnosis. These models have expanded the abilities of artificial intelligence by offering great solutions to complex…

Cryptography and Security · Computer Science 2023-11-27 Gopichandh Golla

Modern neural networks are able to perform at least as well as humans in numerous tasks involving object classification and image generation. However, small perturbations which are imperceptible to humans may significantly degrade the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xinru Hua , Huanzhong Xu , Jose Blanchet , Viet Nguyen

Owing much to the revolution of information technology, the recent progress of deep learning benefits incredibly from the vastly enhanced access to data available in various digital formats. However, in certain scenarios, people may not…

Machine Learning · Computer Science 2022-02-09 Weiqi Peng , Jinghui Chen

The deep neural network is vulnerable to adversarial examples. Adding imperceptible adversarial perturbations to images is enough to make them fail. Most existing research focuses on attacking image classifiers or anchor-based object…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Quanyu Liao , Xin Wang , Bin Kong , Siwei Lyu , Youbing Yin , Qi Song , Xi Wu

In security-sensitive applications, the success of machine learning depends on a thorough vetting of their resistance to adversarial data. In one pertinent, well-motivated attack scenario, an adversary may attempt to evade a deployed system…

Cryptography and Security · Computer Science 2017-08-22 Battista Biggio , Igino Corona , Davide Maiorca , Blaine Nelson , Nedim Srndic , Pavel Laskov , Giorgio Giacinto , Fabio Roli

One of the most concerning threats for modern AI systems is data poisoning, where the attacker injects maliciously crafted training data to corrupt the system's behavior at test time. Availability poisoning is a particularly worrisome…

Machine Learning · Computer Science 2021-03-24 Antonio Emanuele Cinà , Sebastiano Vascon , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Safeguarding data from unauthorized exploitation is vital for privacy and security, especially in recent rampant research in security breach such as adversarial/membership attacks. To this end, \textit{unlearnable examples} (UEs) have been…

Machine Learning · Computer Science 2023-10-04 Wan Jiang , Yunfeng Diao , He Wang , Jianxin Sun , Meng Wang , Richang Hong