English
Related papers

Related papers: Human Attention-Guided Explainable Artificial Inte…

200 papers

In the ever-evolving field of Artificial Intelligence, a critical challenge has been to decipher the decision-making processes within the so-called "black boxes" in deep learning. Over recent years, a plethora of methods have emerged,…

Artificial Intelligence · Computer Science 2024-02-15 Karam Dawoud , Wojciech Samek , Peter Eisert , Sebastian Lapuschkin , Sebastian Bosse

Deep Neural Networks have become the dominant solution for Autonomous Driving perception, but their opacity conflicts with emerging Trustworthy AI guidelines and complicates safety assurance, debugging, and human oversight. While…

Robotics · Computer Science 2026-05-25 Till Beemelmanns , Shayan Sharifi , Manas Mehrotra , Ayushman Choudhuri , Lutz Eckstein

We present a method of explainable artificial intelligence (XAI), "What I Know (WIK)", to provide additional information to verify the reliability of a deep learning model by showing an example of an instance in a training dataset that is…

Artificial Intelligence · Computer Science 2023-02-06 Shin-nosuke Ishikawa , Masato Todo , Masato Taki , Yasunobu Uchiyama , Kazunari Matsunaga , Peihsuan Lin , Taiki Ogihara , Masao Yasui

The integration of Artificial Intelligence (AI) into high-stakes domains such as healthcare, finance, and autonomous systems is often constrained by concerns over transparency, interpretability, and trust. While Human-Centered AI (HCAI)…

Human-Computer Interaction · Computer Science 2025-04-29 Chameera De Silva , Thilina Halloluwa , Dhaval Vyas

Explainable AI (XAI) has become increasingly important with the rise of large transformer models, yet many explanation methods designed for CNNs transfer poorly to Vision Transformers (ViTs). Existing ViT explanations often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

Explainable AI (XAI) is a promising means of supporting human-AI collaborations for high-stakes visual detection tasks, such as damage detection tasks from satellite imageries, as fully-automated approaches are unlikely to be perfectly safe…

Human-Computer Interaction · Computer Science 2021-11-05 Donghoon Shin , Sachin Grover , Kenneth Holstein , Adam Perer

Explainable AI (XAI) for Speech Emotion Recognition (SER) is critical for building transparent, trustworthy models. Current saliency-based methods, adapted from vision, highlight spectrogram regions but fail to show whether these regions…

Machine Learning · Computer Science 2025-11-18 Seham Nasr , Zhao Ren , David Johnson

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan

Understanding the reasons behind the predictions made by deep neural networks is critical for gaining human trust in many important applications, which is reflected in the increasing demand for explainability in AI (XAI) in recent years.…

Human-Computer Interaction · Computer Science 2021-08-31 Xiaotian Lu , Arseny Tolmachev , Tatsuya Yamamoto , Koh Takeuchi , Seiji Okajima , Tomoyoshi Takebayashi , Koji Maruhashi , Hisashi Kashima

In the realm of human activity recognition (HAR), the integration of explainable Artificial Intelligence (XAI) emerges as a critical necessity to elucidate the decision-making processes of complex models, fostering transparency and trust.…

Artificial Intelligence · Computer Science 2024-08-22 Yiran Huang , Yexu Zhou , Haibin Zhao , Till Riedel , Michael Beigl

The attention mechanism lies at the core of the transformer architecture, providing an interpretable model-internal signal that has motivated a growing interest in attention-based model explanations. Although attention weights do not…

Machine Learning · Computer Science 2025-08-13 Marte Eggen , Jacob Lysnæs-Larsen , Inga Strümke

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

Artificial Intelligence (AI) has become essential for analyzing complex data and solving highly-challenging tasks. It is being applied across numerous disciplines beyond computer science, including Food Engineering, where there is a growing…

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

Explainable Artificial Intelligence (XAI) is essential for the transparency and clinical adoption of Clinical Decision Support Systems (CDSS). However, the real-world effectiveness of existing XAI methods remains limited and is…

Machine Learning · Computer Science 2026-01-26 Alessandro Gambetti , Qiwei Han , Hong Shen , Claudia Soares

This paper quantifies the quality of heatmap-based eXplainable AI (XAI) methods w.r.t image classification problem. Here, a heatmap is considered desirable if it improves the probability of predicting the correct classes. Different XAI…

Machine Learning · Computer Science 2023-01-24 Erico Tjoa , Hong Jing Khok , Tushar Chouhan , Guan Cuntai

This study is located in the Human-Centered Artificial Intelligence (HCAI) and focuses on the results of a user-centered assessment of commonly used eXplainable Artificial Intelligence (XAI) algorithms, specifically investigating how humans…

Explainable AI (XAI) promises to provide insight into machine learning models' decision processes, where one goal is to identify failures such as shortcut learning. This promise relies on the field's assumption that input features marked as…

Machine Learning · Computer Science 2026-02-19 Benedict Clark , Marta Oliveira , Rick Wilming , Stefan Haufe

Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on…

Artificial Intelligence · Computer Science 2024-01-17 Haoyi Xiong , Xuhong Li , Xiaofei Zhang , Jiamin Chen , Xinhao Sun , Yuchen Li , Zeyi Sun , Mengnan Du

The use of wearables in medicine and wellness, enabled by AI-based models, offers tremendous potential for real-time monitoring and interpretable event detection. Explainable AI (XAI) is required to assess what models have learned and build…

Signal Processing · Electrical Eng. & Systems 2026-03-16 Maurice Kuschel , Solveig Vieluf , Claus Reinsberger , Tobias Loddenkemper , Tanuj Hasija