中文
相关论文

相关论文: Perturbation on Feature Coalition: Towards Interpr…

200 篇论文

While deep learning models have demonstrated remarkable success in numerous domains, their black-box nature remains a significant limitation, especially in critical fields such as medical image analysis and inference. Existing…

机器学习 · 计算机科学 2025-05-13 David Zucker

One major drawback of deep convolutional neural networks (CNNs) for use in safety critical applications is their black-box nature. This makes it hard to verify or monitor complex, symbolic requirements on already trained computer vision…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Gesina Schwalbe , Christian Wirth , Ute Schmid

Explainable AI (XAI) is an increasingly important area of machine learning research, which aims to make black-box models transparent and interpretable. In this paper, we propose a novel approach to XAI that uses the so-called counterfactual…

The paper proposes a new testing approach for Deep Neural Networks (DNN) using gradient-free optimization to find perturbation chains that successfully falsify the tested DNN, going beyond existing grid-based or combinatorial testing.…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Clemens Otte , Yinchong Yang , Danny Benlin Oswan

Not only automation of manufacturing processes but also automation of automation procedures itself become increasingly relevant to automation research. In this context, automated capability assessment, mainly leveraged by deep learning…

人工智能 · 计算机科学 2022-01-31 Raoul Schönhof , Artem Werner , Jannes Elstner , Boldizsar Zopcsak , Ramez Awad , Marco Huber

Post-hoc explanation methods attempt to make the inner workings of deep neural networks more interpretable. However, since a ground truth is in general lacking, local post-hoc interpretability methods, which assign importance scores to…

机器学习 · 计算机科学 2023-11-27 Lennart Brocki , Neo Christopher Chung

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

计算机视觉与模式识别 · 计算机科学 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

Convolutional neural networks (CNN) are known for their excellent feature extraction capabilities to enable the learning of models from data, yet are used as black boxes. An interpretation of the convolutional filtres and associated…

机器学习 · 计算机科学 2022-07-27 Shagufta Henna , Juan Miguel Lopez Alcaraz

Despite significant advancements in XAI, scholars note a persistent lack of solid conceptual foundations and integration with broader scientific discourse on explanation. In response, emerging research draws on explanatory strategies from…

机器学习 · 计算机科学 2026-05-22 Marcin Rabiza

Deep learning models are one of the security strategies, trained on extensive datasets, and play a critical role in detecting and responding to these threats by recognizing complex patterns in malicious code. However, the opaque nature of…

密码学与安全 · 计算机科学 2025-08-15 Richa Dasila , Vatsala Upadhyay , Samo Bobek , Abhishek Vaish

Convolutional neural networks are witnessing wide adoption in computer vision systems with numerous applications across a range of visual recognition tasks. Much of this progress is fueled through advances in convolutional neural network…

计算机视觉与模式识别 · 计算机科学 2018-06-06 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

The paper presents a novel deep learning approach, which extracts latent information from trained Deep Neural Networks (DNNs) and derives concise representations that are analyzed in an effective, unified way for prediction purposes. It is…

机器学习 · 计算机科学 2020-09-22 D. Kollias , N. Bouas , Y. Vlaxos , V. Brillakis , M. Seferis , I. Kollia , L. Sukissian , J. Wingate , S. Kollias

The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based…

机器学习 · 计算机科学 2021-11-18 Hangcheng Dong , Bingguo Liu , Fengdong Chen , Dong Ye , Guodong Liu

Deep Neural Networks (DNNs) are susceptible to elaborately designed perturbations, whether such perturbations are dependent or independent of images. The latter one, called Universal Adversarial Perturbation (UAP), is very attractive for…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Zhixing Ye , Xinwen Cheng , Xiaolin Huang

Graph neural networks (GNNs) are highly effective on a variety of graph-related tasks; however, they lack interpretability and transparency. Current explainability approaches are typically local and treat GNNs as black-boxes. They do not…

机器学习 · 计算机科学 2023-03-10 Han Xuanyuan , Pietro Barbiero , Dobrik Georgiev , Lucie Charlotte Magister , Pietro Lió

Deep neural networks have achieved remarkable success in various challenging tasks. However, the black-box nature of such networks is not acceptable to critical applications, such as healthcare. In particular, the existence of adversarial…

机器学习 · 计算机科学 2019-09-12 Shaeke Salman , Seyedeh Neelufar Payrovnaziri , Xiuwen Liu , Pablo Rengifo-Moreno , Zhe He

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

机器学习 · 统计学 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Being able to interpret, or explain, the predictions made by a machine learning model is of fundamental importance. This is especially true when there is interest in deploying data-driven models to make high-stakes decisions, e.g. in…

机器学习 · 计算机科学 2019-10-01 An-phi Nguyen , María Rodríguez Martínez

For sake of reliability, it is necessary for models in real-world applications to be both powerful and globally interpretable. Simple classifiers, e.g., Logistic Regression (LR), are globally interpretable, but not powerful enough to model…

机器学习 · 计算机科学 2021-01-20 Zhaocheng Liu , Qiang Liu , Haoli Zhang , Yuntian Chen

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

机器学习 · 计算机科学 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft