中文
相关论文

相关论文: Opening the Black-Box: A Systematic Review on Expl…

200 篇论文

Understanding why machine learning models behave the way they do empowers both system designers and end-users in many ways: in model selection, feature engineering, in order to trust and act upon the predictions, and in more intuitive user…

机器学习 · 统计学 2016-06-20 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

Artificial neural networks have proven to be extremely useful models that have allowed for multiple recent breakthroughs in the field of Artificial Intelligence and many others. However, they are typically regarded as black boxes, given how…

人工智能 · 计算机科学 2023-03-07 Manuel de Sousa Ribeiro , João Leite

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

机器学习 · 计算机科学 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

(Artificial) neural networks have become increasingly popular in mechanics to accelerate computations with model order reduction techniques and as universal models for a wide variety of materials. However, the major disadvantage of neural…

机器学习 · 计算机科学 2021-07-13 Arnd Koeppe , Franz Bamer , Michael Selzer , Britta Nestler , Bernd Markert

Artificial Intelligence (AI) systems are increasingly deployed in legal contexts, where their opacity raises significant challenges for fairness, accountability, and trust. The so-called ``black box problem'' undermines the legitimacy of…

人工智能 · 计算机科学 2025-10-14 Andrada Iulia Prajescu , Roberto Confalonieri

The simulation of complex systems increasingly relies on sophisticated but fundamentally opaque computational black-box simulators. Surrogate models play a central role in reducing the computational cost of complex systems simulations…

Cybersecurity vendors consistently apply AI (Artificial Intelligence) to their solutions and many cybersecurity domains can benefit from AI technology. However, black-box AI techniques present some difficulties in comprehension and adoption…

密码学与安全 · 计算机科学 2023-03-03 Carlos Mendes , Tatiane Nogueira Rios

Despite significant advancements in XAI, scholars note a persistent lack of solid conceptual foundations and integration with broader scientific discourse on explanation. In response, emerging research draws on explanatory strategies from…

机器学习 · 计算机科学 2026-05-22 Marcin Rabiza

In recent years, significant advances in computer vision have also propelled progress in remote sensing. Concurrently, the use of drones has expanded, with many organizations incorporating them into their operations. Most drones are…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Panagiotis Koletsis , Vasilis Efthymiou , Maria Vakalopoulou , Nikos Komodakis , Anastasios Doulamis , Georgios Th. Papadopoulos

Recent developments in Artificial Intelligence (AI) and their applications in critical industries such as healthcare, fin-tech and cybersecurity have led to a surge in research in explainability in AI. Innovative research methods are being…

人工智能 · 计算机科学 2025-08-26 Aoun E Muhammad , Kin-Choong Yow , Nebojsa Bacanin-Dzakula , Muhammad Attique Khan

Public attention towards explainability of artificial intelligence (AI) systems has been rising in recent years to offer methodologies for human oversight. This has translated into the proliferation of research outputs, such as from…

计算机与社会 · 计算机科学 2023-04-25 Luca Nannini , Agathe Balayn , Adam Leon Smith

Machine learning (ML) has rapidly advanced in recent years, revolutionizing fields such as finance, medicine, and cybersecurity. In malware detection, ML-based approaches have demonstrated high accuracy; however, their lack of transparency…

密码学与安全 · 计算机科学 2025-04-09 Harikha Manthena , Shaghayegh Shajarian , Jeffrey Kimmell , Mahmoud Abdelsalam , Sajad Khorsandroo , Maanak Gupta

Artificial intelligence develops techniques and systems whose performance must be evaluated on a regular basis in order to certify and foster progress in the discipline. We will describe and critically assess the different ways AI systems…

人工智能 · 计算机科学 2016-08-23 Jose Hernandez-Orallo

Mechanistic interpretability aims to understand the computational mechanisms underlying neural networks' capabilities in order to accomplish concrete scientific and engineering goals. Progress in this field thus promises to provide greater…

Explainable information retrieval is an emerging research area aiming to make transparent and trustworthy information retrieval systems. Given the increasing use of complex machine learning models in search systems, explainability is…

信息检索 · 计算机科学 2022-11-07 Avishek Anand , Lijun Lyu , Maximilian Idahl , Yumeng Wang , Jonas Wallat , Zijian Zhang

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

计算机视觉与模式识别 · 计算机科学 2021-12-06 Ruth Fong , Andrea Vedaldi

The advancements in deep learning-based methods for visual perception tasks have seen astounding growth in the last decade, with widespread adoption in a plethora of application areas from autonomous driving to clinical decision support…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Kumar Abhishek , Deeksha Kamath

As a field of AI, Machine Reasoning (MR) uses largely symbolic means to formalize and emulate abstract reasoning. Studies in early MR have notably started inquiries into Explainable AI (XAI) -- arguably one of the biggest concerns today for…

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

人工智能 · 计算机科学 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

The widespread adoption of complex machine learning models in high-stakes domains has brought the "black-box" problem to the forefront of responsible AI research. This paper aims at addressing this issue by improving the Explainable…

机器学习 · 计算机科学 2025-12-02 Isara Liyanage , Uthayasanker Thayasivam