English
Related papers

Related papers: Selecting Models based on the Risk of Damage Cause…

200 papers

Nowadays, numerous applications incorporate machine learning (ML) algorithms due to their prominent achievements. However, many studies in the field of computer vision have shown that ML can be fooled by intentionally crafted instances,…

Cryptography and Security · Computer Science 2023-03-14 Islam Debicha , Benjamin Cochez , Tayeb Kenaza , Thibault Debatty , Jean-Michel Dricot , Wim Mees

Whilst adversarial attack detection has received considerable attention, it remains a fundamentally challenging problem from two perspectives. First, while threat models can be well-defined, attacker strategies may still vary widely within…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Nathan Drenkow , Neil Fendley , Philippe Burlina

Deep neural networks (DNNs) are found to be vulnerable to adversarial noise. They are typically misled by adversarial samples to make wrong predictions. To alleviate this negative effect, in this paper, we investigate the dependence between…

Machine Learning · Computer Science 2022-07-26 Dawei Zhou , Nannan Wang , Xinbo Gao , Bo Han , Xiaoyu Wang , Yibing Zhan , Tongliang Liu

Deep learning models (with neural networks) have been widely used in challenging tasks such as computer-aided disease diagnosis based on medical images. Recent studies have shown deep diagnostic models may not be robust in the inference…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Mengting Xu , Tao Zhang , Zhongnian Li , Mingxia Liu , Daoqiang Zhang

Deep neural networks have been shown to be vulnerable to adversarial examples deliberately constructed to misclassify victim models. As most adversarial examples have restricted their perturbations to $L_{p}$-norm, existing defense methods…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Hanieh Naderi , Leili Goli , Shohreh Kasaei

Although general-purpose AI systems offer transformational opportunities in science and industry, they simultaneously raise critical concerns about safety, misuse, and potential loss of control. Despite these risks, methods for assessing…

Computers and Society · Computer Science 2025-12-12 Malcolm Murray , Steve Barrett , Henry Papadatos , Otter Quarks , Matt Smith , Alejandro Tlaie Boria , Chloé Touzet , Siméon Campos

In recent years, many efforts have demonstrated that modern machine learning algorithms are vulnerable to adversarial attacks, where small, but carefully crafted, perturbations on the input can make them fail. While these attack methods are…

Cryptography and Security · Computer Science 2019-06-25 Yuan Gong , Boyang Li , Christian Poellabauer , Yiyu Shi

Artificial intelligence systems are prevalent in everyday life, with use cases in retail, manufacturing, health, and many other fields. With the rise in AI adoption, associated risks have been identified, including privacy risks to the…

Machine Learning · Computer Science 2024-07-19 Shlomit Shachor , Natalia Razinkov , Abigail Goldsteen

Production machine learning systems are consistently under attack by adversarial actors. Various deep learning models must be capable of accurately detecting fake or adversarial input while maintaining speed. In this work, we propose one…

Machine Learning · Computer Science 2021-06-15 Matthew Ciolino , Josh Kalin , David Noever

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied…

Cryptography and Security · Computer Science 2024-03-27 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Alexandre Alahi

Deep learning models are known to be vulnerable to adversarial examples. A practical adversarial attack should require as little as possible knowledge of attacked models. Current substitute attacks need pre-trained models to generate…

Cryptography and Security · Computer Science 2020-04-01 Mingyi Zhou , Jing Wu , Yipeng Liu , Xiaolin Huang , Shuaicheng Liu , Xiang Zhang , Ce Zhu

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

Cryptography and Security · Computer Science 2020-12-10 Liwei Song , Prateek Mittal

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

Machine Learning (ML) models are known to be vulnerable to adversarial inputs and researchers have demonstrated that even production systems, such as self-driving cars and ML-as-a-service offerings, are susceptible. These systems represent…

Machine Learning · Computer Science 2021-01-11 Marissa Dotter , Sherry Xie , Keith Manville , Josh Harguess , Colin Busho , Mikel Rodriguez

Adversarial attacks on explainability models have drastic consequences when explanations are used to understand the reasoning of neural networks in safety critical systems. Path methods are one such class of attribution methods susceptible…

Machine Learning · Computer Science 2025-02-28 Lachlan Simpson , Federico Costanza , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

Information Retrieval · Computer Science 2020-08-06 Nisarg Raval , Manisha Verma

Machine learning models are increasingly used in the industry to make decisions such as credit insurance approval. Some people may be tempted to manipulate specific variables, such as the age or the salary, in order to get better chances of…

Machine Learning · Statistics 2018-09-10 Xavier Renard , Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

Adversarial attacks have become a major threat for machine learning applications. There is a growing interest in studying these attacks in the audio domain, e.g, speech and speaker recognition; and find defenses against them. In this work,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Jesús Villalba , Sonal Joshi , Piotr Żelasko , Najim Dehak

Artificial intelligence risks are multidimensional in nature, as the same risk scenarios may have legal, operational, and financial risk dimensions. With the emergence of new AI regulations, the state of the art of artificial intelligence…

Computers and Society · Computer Science 2025-09-24 Luis Enriquez Alvarez

Adversarial attack perturbs an image with an imperceptible noise, leading to incorrect model prediction. Recently, a few works showed inherent bias associated with such attack (robustness bias), where certain subgroups in a dataset (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Gaurav Kumar Nayak , Ruchit Rawal , Rohit Lal , Himanshu Patil , Anirban Chakraborty