Explainable AI (XAI) has evolved in response to expectations and regulations, such as the EU AI Act, which introduces regulatory requirements on AI-powered systems. However, a persistent gap remains between existing XAI methods and society's legal requirements, leaving practitioners without clear guidance on how to approach compliance in the EU market. To bridge this gap, we study model-agnostic XAI methods and relate their interpretability features to the requirements of the AI Act. We then propose a qualitative-to-quantitative scoring framework: qualitative expert assessments of XAI properties are aggregated into a regulation-specific compliance score. This helps practitioners identify when XAI solutions may support legal explanation requirements while highlighting technical issues that require further research and regulatory clarification.
@article{arxiv.2604.09628,
title = {Assessing Model-Agnostic XAI Methods against EU AI Act Explainability Requirements},
author = {Francesco Sovrano and Giulia Vilone and Michael Lognoul},
journal= {arXiv preprint arXiv:2604.09628},
year = {2026}
}
Comments
19 pages; Accepted for publication at the 4th World Conference on eXplainable Artificial Intelligence (2026)