English
Related papers

Related papers: Interpretable Deep Learning under Fire

200 papers

DNN is presenting human-level performance for many complex intelligent tasks in real-world applications. However, it also introduces ever-increasing security concerns. For example, the emerging adversarial attacks indicate that even very…

Machine Learning · Computer Science 2018-03-21 Qi Liu , Tao Liu , Zihao Liu , Yanzhi Wang , Yier Jin , Wujie Wen

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

Deep neural networks (DNNs) are now commonly used in many domains. However, they are vulnerable to adversarial attacks: carefully crafted perturbations on data inputs that can fool a model into making incorrect predictions. Despite…

Machine Learning · Computer Science 2020-09-09 Nilaksh Das , Haekyu Park , Zijie J. Wang , Fred Hohman , Robert Firstman , Emily Rogers , Duen Horng Chau

The growing deployment of deep learning models in real-world environments has intensified the need for efficient inference under strict latency and resource constraints. To meet these demands, dynamic deep learning systems (DDLSs) have…

Machine Learning · Computer Science 2025-06-24 Ravishka Rathnasuriya , Wei Yang

Sometimes it is not enough for a DNN to produce an outcome. For example, in applications such as healthcare, users need to understand the rationale of the decisions. Therefore, it is imperative to develop algorithms to learn models with…

Machine Learning · Computer Science 2019-01-29 Yinpeng Dong , Fan Bao , Hang Su , Jun Zhu

Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications. Recently, however, DNNs are shown to be vulnerable to adversarial example attacks with slight perturbations on the inputs.…

Machine Learning · Computer Science 2018-12-10 Bo Luo , Min Li , Yu Li , Qiang Xu

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Deep Neural Networks (DNNs) have achieved state of the art results and even outperformed human accuracy in many challenging tasks, leading to DNNs adoption in a variety of fields including natural language processing, pattern recognition,…

Machine Learning · Computer Science 2025-02-26 Mabel Ogonna , Abigail Adeniran , Adewale Adeyemo

Providing explanations for deep neural networks (DNNs) is essential for their use in domains wherein the interpretability of decisions is a critical prerequisite. Despite the plethora of work on interpreting DNNs, most existing solutions…

Machine Learning · Computer Science 2021-01-26 Xinyang Zhang , Ren Pang , Shouling Ji , Fenglong Ma , Ting Wang

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Deep Learning has empowered us to train neural networks for complex data with high performance. However, with the growing research, several vulnerabilities in neural networks have been exposed. A particular branch of research, Adversarial…

Machine Learning · Computer Science 2023-08-08 Shashank Kotyan

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

Computation and Language · Computer Science 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Studies have shown that machine learning systems are vulnerable to adversarial examples in theory and practice. Where previous attacks have focused mainly on visual models that exploit the difference between human and machine perception,…

Cryptography and Security · Computer Science 2025-07-23 Eldor Abdukhamidov , Tamer Abuhmed , Joanna C. S. Santos , Mohammed Abuhamad

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

The dangers of adversarial attacks on Uncrewed Aerial Vehicle (UAV) agents operating in public are increasing. Adopting AI-based techniques and, more specifically, Deep Learning (DL) approaches to control and guide these UAVs can be…

Machine Learning · Computer Science 2023-06-21 Thomas Hickling , Nabil Aouf , Phillippa Spencer

Deep neural networks (DNNs) are vulnerable to maliciously generated adversarial examples. These examples are intentionally designed by making imperceptible perturbations and often mislead a DNN into making an incorrect prediction. This…

Machine Learning · Computer Science 2018-10-10 Mengchen Liu , Shixia Liu , Hang Su , Kelei Cao , Jun Zhu

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev