English
Related papers

Related papers: Exploiting Explanations for Model Inversion Attack…

200 papers

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

Cryptography and Security · Computer Science 2025-11-14 Josep Domingo-Ferrer

Artificial intelligence (AI) is being applied in almost every field. At the same time, the currently dominant deep learning methods are fundamentally black-box systems that lack explanations for their inferences, significantly limiting…

Artificial Intelligence · Computer Science 2025-10-06 Martina Mattioli , Eike Petersen , Aasa Feragen , Marcello Pelillo , Siavash A. Bigdeli

Big Data has become central to modern applications in finance, insurance, and cybersecurity, enabling machine learning systems to perform large-scale risk assessments and fraud detection. However, the increasing dependence on automated…

Machine Learning · Computer Science 2025-12-19 Ayush Jain , Rahul Kulkarni , Siyi Lin

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

Model inversion (MI) attacks are aimed at reconstructing training data from model parameters. Such attacks have triggered increasing concerns about privacy, especially given a growing number of online model repositories. However, existing…

Machine Learning · Computer Science 2021-08-20 Si Chen , Mostafa Kahla , Ruoxi Jia , Guo-Jun Qi

Established approaches to assuring safety-critical systems and software are difficult to apply to systems employing ML where there is no clear, pre-defined specification against which to assess validity. This problem is exacerbated by the…

Machine Learning · Computer Science 2022-05-06 Yan Jia , John McDermid , Tom Lawton , Ibrahim Habli

We are witnessing the emergence of an AI economy and society where AI technologies are increasingly impacting health care, business, transportation and many aspects of everyday life. Many successes have been reported where AI systems even…

Machine Learning · Computer Science 2022-12-27 D. Petkovic

The use of Artificial Intelligence (AI) models in real-world and high-risk applications has intensified the discussion about their trustworthiness and ethical usage, from both a technical and a legislative perspective. The field of…

Machine Learning · Computer Science 2025-12-17 Ilaria Vascotto , Alex Rodriguez , Alessandro Bonaita , Luca Bortolussi

EXplainable Artificial Intelligence (XAI) is a vibrant research topic in the artificial intelligence community, with growing interest across methods and domains. Much has been written about the subject, yet XAI still lacks shared…

Artificial Intelligence · Computer Science 2023-06-16 Matteo Rizzo , Alberto Veneri , Andrea Albarelli , Claudio Lucchese , Marco Nobile , Cristina Conati

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

This paper details the privacy and security landscape in today's cloud ecosystem and identifies that there is a gap in addressing the risks introduced by machine learning models. As machine learning algorithms continue to evolve and find…

Cryptography and Security · Computer Science 2024-02-05 Alka Luqman , Riya Mahesh , Anupam Chattopadhyay

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

Machine learning (ML) on graph-structured data has recently received deepened interest in the context of intrusion detection in the cybersecurity domain. Due to the increasing amounts of data generated by monitoring tools as well as more…

Cryptography and Security · Computer Science 2023-08-25 Anna Himmelhuber , Dominik Dold , Stephan Grimm , Sonja Zillner , Thomas Runkler

In recent years, machine learning models, especially deep neural networks, have been widely used for classification tasks in the security domain. However, these models have been shown to be vulnerable to adversarial manipulation: small…

Cryptography and Security · Computer Science 2024-03-12 Dong Qin , George Amariucai , Daji Qiao , Yong Guan

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

Machine Learning · Computer Science 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

Artificial intelligence is creating one of the biggest revolution across technology driven application fields. For the finance sector, it offers many opportunities for significant market innovation and yet broad adoption of AI systems…

Risk Management · Quantitative Finance 2022-12-07 Marc Wildi , Branka Hadji Misheva

Privacy-preserving analytics is designed to protect valuable assets. A common service provision involves the input data from the client and the model on the analyst's side. The importance of the privacy preservation is fuelled by legal…

Cryptography and Security · Computer Science 2024-04-16 Martin Kodys , Zhongmin Dai , Vrizlynn L. L. Thing

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

Artificial Intelligence · Computer Science 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay