English
Related papers

Related papers: Can We Rely on AI?

200 papers

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

Optimization and Control · Mathematics 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly plausible. This paper…

Cryptography and Security · Computer Science 2023-06-16 Myles Foley , Mia Wang , Zoe M , Chris Hicks , Vasilios Mavroudis

Recent discussions and research in AI safety have increasingly emphasized the deep connection between AI safety and existential risk from advanced AI systems, suggesting that work on AI safety necessarily entails serious consideration of…

Computers and Society · Computer Science 2025-02-17 Balint Gyevnar , Atoosa Kasirzadeh

We investigate the problem of identifying adversarial attacks on image-based neural networks. We present intriguing experimental results showing significant discrepancies between the explanations generated for the predictions of a model on…

Machine Learning · Computer Science 2020-03-13 Sean Saito , Jin Wang

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

Computation and Language · Computer Science 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

Deep learning models have been used widely for various purposes in recent years in object recognition, self-driving cars, face recognition, speech recognition, sentiment analysis, and many others. However, in recent years it has been shown…

Computation and Language · Computer Science 2020-06-16 Aminul Huq , Mst. Tasnim Pervin

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Richa Singh , Akshay Agarwal , Maneet Singh , Shruti Nagpal , Mayank Vatsa

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

Artificial Intelligence (AI) algorithms are increasingly providing decision making and operational support across multiple domains. AI includes a wide library of algorithms for different problems. One important notion for the adoption of AI…

Artificial Intelligence · Computer Science 2021-11-16 Feras A. Batarseh , Laura Freeman

We develop and study new adversarial perturbations that enable an attacker to gain control over decisions in generic Artificial Intelligence (AI) systems including deep learning neural networks. In contrast to adversarial data modification,…

Cryptography and Security · Computer Science 2023-12-07 Ivan Y. Tyukin , Desmond J. Higham , Alexander Bastounis , Eliyas Woldegeorgis , Alexander N. Gorban

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

Computation and Language · Computer Science 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li

Deep neural networks (DNNs) have become popular for medical image analysis tasks like cancer diagnosis and lesion detection. However, a recent study demonstrates that medical deep learning systems can be compromised by carefully-engineered…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Xingjun Ma , Yuhao Niu , Lin Gu , Yisen Wang , Yitian Zhao , James Bailey , Feng Lu

Artificial Intelligence began as a field probing some of the most fundamental questions of science - the nature of intelligence and the design of intelligent artifacts. But it has grown into a discipline that is deeply entwined with…

Computers and Society · Computer Science 2013-07-29 Piyush Ahuja

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Adversarial attacks in machine learning have been extensively reviewed in areas like computer vision and NLP, but research on tabular data remains scattered. This paper provides the first systematic literature review focused on adversarial…

Machine Learning · Computer Science 2025-06-19 Salijona Dyrmishi , Mohamed Djilani , Thibault Simonetto , Salah Ghamizi , Maxime Cordy

Nowadays, considering the speed of the processes and the amount of data used in cyber defense, it cannot be expected to have an effective defense by using only human power without the help of automation systems. However, for the effective…

Artificial Intelligence · Computer Science 2019-05-30 Ensar Şeker

Machine learning based system are increasingly being used for sensitive tasks such as security surveillance, guiding autonomous vehicle, taking investment decisions, detecting and blocking network intrusion and malware etc. However, recent…

Artificial Intelligence · Computer Science 2017-07-12 Atul Kumar , Sameep Mehta