English
Related papers

Related papers: Moshi Moshi? A Model Selection Hijacking Adversari…

200 papers

As Internet of Things (IoT) has emerged as the next logical stage of the Internet, it has become imperative to understand the vulnerabilities of the IoT systems when supporting diverse applications. Because machine learning has been applied…

Signal Processing · Electrical Eng. & Systems 2020-07-13 Zhengping Luo , Shangqing Zhao , Zhuo Lu , Yalin E. Sagduyu , Jie Xu

Safety alignment is critical for the responsible deployment of large language models (LLMs). As Mixture-of-Experts (MoE) architectures are increasingly adopted to scale model capacity, understanding their safety robustness becomes…

Machine Learning · Computer Science 2026-05-06 Zhiyuan Xu , Joseph Gardiner , Sana Belguith , Lichao Wu

The growing prospect of deep reinforcement learning (DRL) being used in cyber-physical systems has raised concerns around safety and robustness of autonomous agents. Recent work on generating adversarial attacks have shown that it is…

Machine Learning · Computer Science 2018-07-18 Aaron J. Havens , Zhanhong Jiang , Soumik Sarkar

Machine learning classifiers are known to be vulnerable to inputs maliciously constructed by adversaries to force misclassification. Such adversarial examples have been extensively studied in the context of computer vision applications. In…

Machine Learning · Computer Science 2017-02-09 Sandy Huang , Nicolas Papernot , Ian Goodfellow , Yan Duan , Pieter Abbeel

Machine-learning models can be fooled by adversarial examples, i.e., carefully-crafted input perturbations that force models to output wrong predictions. While uncertainty quantification has been recently proposed to detect adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Emanuele Ledda , Daniele Angioni , Giorgio Piras , Giorgio Fumera , Battista Biggio , Fabio Roli

The robustness of modern machine learning (ML) models has become an increasing concern within the community. The ability to subvert a model into making errant predictions using seemingly inconsequential changes to input is startling, as is…

Machine Learning · Computer Science 2023-06-19 Edward Raff , Michel Benaroch , Andrew L. Farris

Adversarial attacks have become a major threat for machine learning applications. There is a growing interest in studying these attacks in the audio domain, e.g, speech and speaker recognition; and find defenses against them. In this work,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Jesús Villalba , Sonal Joshi , Piotr Żelasko , Najim Dehak

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

The growth of low-end hardware has led to a proliferation of machine learning-based services in edge applications. These applications gather contextual information about users and provide some services, such as personalized offers, through…

Machine Learning · Computer Science 2024-02-06 Akanksha Atrey , Ritwik Sinha , Saayan Mitra , Prashant Shenoy

Malicious software (malware) is a major cyber threat that has to be tackled with Machine Learning (ML) techniques because millions of new malware examples are injected into cyberspace on a daily basis. However, ML is vulnerable to attacks…

Cryptography and Security · Computer Science 2021-11-30 Deqiang Li , Qianmu Li , Yanfang Ye , Shouhuai Xu

Regulation, legal liabilities, and societal concerns challenge the adoption of AI in safety and security-critical applications. One of the key concerns is that adversaries can cause harm by manipulating model predictions without being…

Machine Learning · Computer Science 2023-01-31 Jona Klemenc , Holger Trittenbach

Recent approaches in machine learning often solve a task using a composition of multiple models or agentic architectures. When targeting a composed system with adversarial attacks, it might not be computationally or informationally feasible…

Machine Learning · Computer Science 2024-11-01 Julian Collado , Kevin Stangl

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

Cryptography and Security · Computer Science 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni

Recent advancements in Large Language Models (LLMs) have significantly enhanced their code generation capabilities. However, their robustness against adversarial misuse, particularly through multi-turn malicious coding prompts, remains…

Computation and Language · Computer Science 2025-07-29 Muntasir Wahed , Xiaona Zhou , Kiet A. Nguyen , Tianjiao Yu , Nirav Diwan , Gang Wang , Dilek Hakkani-Tür , Ismini Lourentzou

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one…

Machine Learning · Computer Science 2021-06-15 Matthew Ciolino , Josh Kalin , David Noever

Model Inversion (MI), in which an adversary abuses access to a trained Machine Learning (ML) model attempting to infer sensitive information about its original training data, has attracted increasing research attention. During MI, the…

Machine Learning · Computer Science 2021-11-09 Qian Wang , Daniel Kurz

As machine learning (ML) becomes more and more powerful and easily accessible, attackers increasingly leverage ML to perform automated large-scale inference attacks in various domains. In such an ML-equipped inference attack, an attacker…

Cryptography and Security · Computer Science 2019-09-20 Jinyuan Jia , Neil Zhenqiang Gong

Model inversion (MI) attacks allow to reconstruct average per-class representations of a machine learning (ML) model's training data. It has been shown that in scenarios where each class corresponds to a different individual, such as face…

Sound · Computer Science 2023-01-10 Karla Pizzi , Franziska Boenisch , Ugur Sahin , Konstantin Böttinger

Crafting adversarial examples is crucial for evaluating and enhancing the robustness of Deep Neural Networks (DNNs), presenting a challenge equivalent to maximizing a non-differentiable 0-1 loss function. However, existing single objective…

Machine Learning · Computer Science 2025-11-18 Ping Guo , Cheng Gong , Xi Lin , Fei Liu , Zhichao Lu , Qingfu Zhang , Zhenkun Wang

Adversarial attack is a technique for deceiving Machine Learning (ML) models, which provides a way to evaluate the adversarial robustness. In practice, attack algorithms are artificially selected and tuned by human experts to break a ML…

Cryptography and Security · Computer Science 2020-12-11 Xiaofeng Mao , Yuefeng Chen , Shuhui Wang , Hang Su , Yuan He , Hui Xue