English
Related papers

Related papers: Towards Trustworthy and Explainable AI for Percept…

200 papers

The rapid evolution of automated vehicles (AVs) has the potential to provide safer, more efficient, and comfortable travel options. However, these systems face challenges regarding reliability in complex driving scenarios. Recent…

Artificial Intelligence · Computer Science 2024-02-27 Shihong Ling , Yue Wan , Xiaowei Jia , Na Du

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

Despite AI's significant growth, its "black box" nature creates challenges in generating adequate trust. Thus, it is seldom utilized as a standalone unit in IoT high-risk applications, such as critical industrial infrastructures, medical…

Artificial Intelligence · Computer Science 2022-05-04 Maede Zolanvari , Zebo Yang , Khaled Khan , Raj Jain , Nader Meskin

Interpretability of Deep Learning (DL) is a barrier to trustworthy AI. Despite great efforts made by the Explainable AI (XAI) community, explanations lack robustness -- indistinguishable input perturbations may lead to different XAI…

Machine Learning · Computer Science 2023-08-01 Wei Huang , Xingyu Zhao , Gaojie Jin , Xiaowei Huang

Artificial intelligence (AI) has rapidly developed through advancements in computational power and the growth of massive datasets. However, this progress has also heightened challenges in interpreting the "black-box" nature of AI models. To…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Shilin Sun , Wenbin An , Feng Tian , Fang Nan , Qidong Liu , Jun Liu , Nazaraf Shah , Ping Chen

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

As autonomous technologies increasingly shape maritime operations, understanding why an AI system makes a decision becomes as crucial as what it decides. In complex and dynamic maritime environments, trust in AI depends not only on…

Artificial Intelligence · Computer Science 2025-09-19 Doreen Jirak , Pieter Maes , Armeen Saroukanoff , Dirk van Rooy

Recent research has developed a number of eXplainable AI (XAI) techniques, such as gradient-based approaches, input perturbation-base methods, and black-box explanation methods. While these XAI techniques can extract meaningful insights…

Machine Learning · Computer Science 2025-03-10 Xu Zheng , Farhad Shirani , Zhuomin Chen , Chaohao Lin , Wei Cheng , Wenbo Guo , Dongsheng Luo

Current research on Explainable AI (XAI) heavily targets on expert users (data scientists or AI developers). However, increasing importance has been argued for making AI more understandable to nonexperts, who are expected to leverage AI…

Human-Computer Interaction · Computer Science 2021-10-20 Chao Wang , Pengcheng An

Computer Vision, and hence Artificial Intelligence-based extraction of information from images, has increasingly received attention over the last years, for instance in medical diagnostics. While the algorithms' complexity is a reason for…

Human-Computer Interaction · Computer Science 2020-07-14 Christian Meske , Enrico Bunde

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

The need for interpretable and accountable intelligent systems grows along with the prevalence of artificial intelligence applications used in everyday life. Explainable intelligent systems are designed to self-explain the reasoning behind…

Human-Computer Interaction · Computer Science 2020-08-06 Sina Mohseni , Niloofar Zarei , Eric D. Ragan

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Explainable Artificial Intelligence (XAI) has recently gained a swell of interest, as many Artificial Intelligence (AI) practitioners and developers are compelled to rationalize how such AI-based systems work. Decades back, most XAI systems…

Artificial Intelligence · Computer Science 2024-03-05 Muhammad Suffian , Muhammad Yaseen Khan , Alessandro Bogliolo

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

Artificial Intelligence · Computer Science 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay

Recently, transformers have become incredibly popular in computer vision and vision-language tasks. This notable rise in their usage can be primarily attributed to the capabilities offered by attention mechanisms and the outstanding ability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Mayank Vatsa , Anubhooti Jain , Richa Singh

Although neural networks have seen tremendous success as predictive models in a variety of domains, they can be overly confident in their predictions on out-of-distribution (OOD) data. To be viable for safety-critical applications, like…

Robotics · Computer Science 2022-11-17 Masha Itkina , Mykel J. Kochenderfer

The rapid development of Artificial Intelligence (AI) technology has enabled the deployment of various systems based on it. However, many current AI systems are found vulnerable to imperceptible attacks, biased against underrepresented…

Artificial Intelligence · Computer Science 2022-05-27 Bo Li , Peng Qi , Bo Liu , Shuai Di , Jingen Liu , Jiquan Pei , Jinfeng Yi , Bowen Zhou

Explainable Artificial Intelligence (XAI) plays a crucial role in fostering transparency and trust in AI systems, where traditional XAI approaches typically offer one level of abstraction for explanations, often in the form of heatmaps…