English
Related papers

Related papers: Exploiting Explanations for Model Inversion Attack…

200 papers

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

The black-box nature of artificial intelligence (AI) models has been the source of many concerns in their use for critical applications. Explainable Artificial Intelligence (XAI) is a rapidly growing research field that aims to create…

Cryptography and Security · Computer Science 2023-06-13 Gaith Rjoub , Jamal Bentahar , Omar Abdel Wahab , Rabeb Mizouni , Alyssa Song , Robin Cohen , Hadi Otrok , Azzam Mourad

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Junlin Hou , Sicen Liu , Yequan Bie , Hongmei Wang , Andong Tan , Luyang Luo , Hao Chen

Explainable Artificial Intelligence (XAI) is a set of techniques that allows the understanding of both technical and non-technical aspects of Artificial Intelligence (AI) systems. XAI is crucial to help satisfying the increasingly important…

Artificial Intelligence · Computer Science 2021-11-09 Riccardo Crupi , Alessandro Castelnovo , Daniele Regoli , Beatriz San Miguel Gonzalez

As a booming research area in the past decade, deep learning technologies have been driven by big data collected and processed on an unprecedented scale. However, privacy concerns arise due to the potential leakage of sensitive information…

Cryptography and Security · Computer Science 2024-02-05 Guangsheng Zhang , Bo Liu , Huan Tian , Tianqing Zhu , Ming Ding , Wanlei Zhou

Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Alina Elena Baia , Valentina Poggioni , Andrea Cavallaro

In recent years, there has been a notable increase in the deployment of machine learning (ML) models as services (MLaaS) across diverse production software applications. In parallel, explainable AI (XAI) continues to evolve, addressing the…

Machine Learning · Computer Science 2024-10-23 Fatima Ezzeddine , Omran Ayoub , Silvia Giordano

Artificial Intelligence (AI) is often an integral part of modern decision support systems. The best-performing predictive models used in AI-based decision support systems lack transparency. Explainable Artificial Intelligence (XAI) aims to…

Machine Learning · Computer Science 2025-02-25 Tuwe Löfström , Helena Löfström , Ulf Johansson , Cecilia Sönströd , Rudy Matela

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

A variety of explanation methods have been proposed in recent years to help users gain insights into the results returned by neural networks, which are otherwise complex and opaque black-boxes. However, explanations give rise to potential…

Machine Learning · Computer Science 2022-06-29 Pengrui Quan , Supriyo Chakraborty , Jeya Vikranth Jeyakumar , Mani Srivastava

Counterfactual explanations (CFs) are increasingly integrated into Machine Learning as a Service (MLaaS) systems to improve transparency; however, ML models deployed via APIs are already vulnerable to privacy attacks such as membership…

Machine Learning · Computer Science 2026-02-04 Fatima Ezzeddine , Osama Zammar , Silvia Giordano , Omran Ayoub

This paper presents a novel approach to Explainable AI (XAI) that combines contrastive explanations with differential privacy for clustering algorithms. Focusing on k-median and k-means problems, we calculate contrastive explanations as the…

Machine Learning · Computer Science 2025-06-03 Dung Nguyen , Ariel Vetzler , Sarit Kraus , Anil Vullikanti

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

Cryptography and Security · Computer Science 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability critically important. Machine Learning (ML), specifically deep learning, is increasingly integrated…

Machine Learning · Computer Science 2026-04-09 Annemarie Jutte , Uraz Odyurt

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

Explainable Artificial Intelligence (XAI) aims to improve the transparency of machine learning (ML) pipelines. We systematize the increasingly growing (but fragmented) microcosm of studies that develop and utilize XAI methods for defensive…

Cryptography and Security · Computer Science 2023-03-06 Azqa Nadeem , Daniël Vos , Clinton Cao , Luca Pajola , Simon Dieck , Robert Baumgartner , Sicco Verwer