English
Related papers

Related papers: Creating an Explainable Intrusion Detection System…

200 papers

Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Arun Das , Paul Rad

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

As electronic systems become increasingly complex and prevalent in modern vehicles, securing onboard networks is crucial, particularly as many of these systems are safety-critical. Researchers have demonstrated that modern vehicles are…

Cryptography and Security · Computer Science 2024-12-31 Chunheng Zhao , Stefano Longari , Michele Carminati , Pierluigi Pisu

Intrusion Detection Systems (IDSs) are integral to safeguarding networks by detecting and responding to threats from malicious traffic or compromised devices. However, standalone IDS deployments often fall short when addressing the…

Cryptography and Security · Computer Science 2025-04-24 Tom Davies , Max Hashem Eiza , Nathan Shone , Rob Lyon

In the past few years, artificial intelligence (AI) techniques have been implemented in almost all verticals of human life. However, the results generated from the AI models often lag explainability. AI models often appear as a blackbox…

The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Cristiano Patrício , João C. Neves , Luís F. Teixeira

Self Organizing Map is trained using unsupervised learning to produce a two-dimensional discretized representation of input space of the training cases. Growing Hierarchical SOM is an architecture which grows both in a hierarchical way…

Neural and Evolutionary Computing · Computer Science 2018-04-11 Takumi Ichimura , Takashi Yamaguchi

The growing adoption of artificial intelligence in healthcare has raised concerns about the transparency and trustworthiness of AI-driven medical diagnosis systems. Many existing models operate as black boxes, limiting clinicians' ability…

Human-Computer Interaction · Computer Science 2026-04-21 Altynbek Seitenov , Ainur Nurzhanova , Azhar Bekbussinova , Yerassyl Bolatkan

EXplainable AI (XAI) methods have been proposed to interpret how a deep neural network predicts inputs through model saliency explanations that highlight the parts of the inputs deemed important to arrive a decision at a specific target.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Yi-Shan Lin , Wen-Chuan Lee , Z. Berkay Celik

This paper takes an information visualization perspective to visual representations in the general SOM paradigm. This involves viewing SOM-based visualizations through the eyes of Bertin's and Tufte's theories on data graphics. The regular…

Machine Learning · Computer Science 2013-06-26 Peter Sarlin , Samuel Rönnqvist

The need of predictive maintenance comes with an increasing number of incidents reported by monitoring systems and equipment/software users. In the front line, on-call engineers (OCEs) have to quickly assess the degree of severity of an…

Artificial Intelligence · Computer Science 2021-08-09 Youcef Remil , Anes Bendimerad , Marc Plantevit , Céline Robardet , Mehdi Kaytoue

The black box nature of deep neural networks poses a significant challenge for the deployment of transparent and trustworthy artificial intelligence (AI) systems. With the growing presence of AI in society, it becomes increasingly important…

Machine Learning · Computer Science 2025-11-25 Bianka Kowalska , Halina Kwaśnicka

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

Since it is impossible to predict and identify all the vulnerabilities of a network, and penetration into a system by malicious intruders cannot always be prevented, intrusion detection systems (IDSs) are essential entities for ensuring the…

Cryptography and Security · Computer Science 2021-09-07 Jaydip Sen

The black-box nature of the deep networks makes the explanation for "why" they make certain predictions extremely challenging. Saliency maps are one of the most widely-used local explanation tools to alleviate this problem. One of the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Saeed Khorram , Tyler Lawson , Fuxin Li

This paper addresses trust issues created from the ubiquity of black box algorithms and surrogate explainers in Explainable Intrusion Detection Systems (X-IDS). While Explainable Artificial Intelligence (XAI) aims to enhance transparency,…

Cryptography and Security · Computer Science 2024-01-19 Jesse Ables , Nathaniel Childers , William Anderson , Sudip Mittal , Shahram Rahimi , Ioana Banicescu , Maria Seale

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti

This paper introduces an incremental semantic mapping approach, with on-line unsupervised learning, based on Self-Organizing Maps (SOM) for robotic agents. The method includes a mapping module, which incrementally creates a topological map…

Robotics · Computer Science 2019-07-12 Ygor C. N. Sousa , Hansenclever F. Bassani

Although the widespread use of AI systems in today's world is growing, many current AI systems are found vulnerable due to hidden bias and missing information, especially in the most commonly used forecasting system. In this work, we…

Machine Learning · Computer Science 2024-07-30 Zhixuan Chu , Hui Ding , Guang Zeng , Shiyu Wang , Yiming Li