English
Related papers

Related papers: Black-box Attacks on Image Activity Prediction and…

200 papers

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most…

Artificial Intelligence · Computer Science 2024-06-18 Ahmed M Salih

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

Machine Learning · Computer Science 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

Despite the fact that Artificial Intelligence (AI) has boosted the achievement of remarkable results across numerous data analysis tasks, however, this is typically accompanied by a significant shortcoming in the exhibited transparency and…

Recently, artificial intelligence and machine learning in general have demonstrated remarkable performances in many tasks, from image processing to natural language processing, especially with the advent of deep learning. Along with…

Machine Learning · Computer Science 2020-10-23 Erico Tjoa , Cuntai Guan

The extensive utilization of biometric authentication systems have emanated attackers / imposters to forge user identity based on morphed images. In this attack, a synthetic image is produced and merged with genuine. Next, the resultant…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Rudresh Dwivedi , Ritesh Kumar , Deepak Chopra , Pranay Kothari , Manjot Singh

With the rapid growth of machine learning, deep neural networks (DNNs) are now being used in numerous domains. Unfortunately, DNNs are "black-boxes", and cannot be interpreted by humans, which is a substantial concern in safety-critical…

Machine Learning · Computer Science 2023-02-10 Shahaf Bassan , Guy Katz

Artificial intelligence systems are widely used by people with sensory disabilities, like loss of vision or hearing, to help perceive or navigate the world around them. This includes tasks like describing an image or object they cannot…

Human-Computer Interaction · Computer Science 2026-03-04 Shadab H. Choudhury

As complex AI systems further prove to be an integral part of our lives, a persistent and critical problem is the underlying black-box nature of such products and systems. In pursuit of productivity enhancements, one must not forget the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Rech Leong Tian Poh , Sye Loong Keoh , Liying Li

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

Despite its significant benefits in enhancing the transparency and trustworthiness of artificial intelligence (AI) systems, explainable AI (XAI) has yet to reach its full potential in real-world applications. One key challenge is that XAI…

Machine Learning · Computer Science 2024-09-16 Kiana Vu , Phung Lai , Truc Nguyen

Natural language explanations in visual question answering (VQA-NLE) aim to make black-box models more transparent by elucidating their decision-making processes. However, we find that existing VQA-NLE systems can produce inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Yahsin Yeh , Yilun Wu , Bokai Ruan , Honghan Shuai

Explainable AI (XAI) is a promising means of supporting human-AI collaborations for high-stakes visual detection tasks, such as damage detection tasks from satellite imageries, as fully-automated approaches are unlikely to be perfectly safe…

Human-Computer Interaction · Computer Science 2021-11-05 Donghoon Shin , Sachin Grover , Kenneth Holstein , Adam Perer

Explainable artificial intelligence (XAI) has helped elucidate the internal mechanisms of machine learning algorithms, bolstering their reliability by demonstrating the basis of their predictions. Several XAI models consider causal…

Machine Learning · Computer Science 2024-04-30 Daisuke Takahashi , Shohei Shimizu , Takuma Tanaka

An explainable AI (XAI) model aims to provide transparency (in the form of justification, explanation, etc) for its predictions or actions made by it. Recently, there has been a lot of focus on building XAI models, especially to provide…

Human-Computer Interaction · Computer Science 2022-01-11 Arjun Akula , Song-Chun Zhu

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Machine learning (ML) models, demonstrably powerful, suffer from a lack of interpretability. The absence of transparency, often referred to as the black box nature of ML models, undermines trust and urges the need for efforts to enhance…

Machine Learning · Computer Science 2024-06-25 Fatima Ezzeddine

This work examines the vulnerability of multimodal (image + text) models to adversarial threats similar to those discussed in previous literature on unimodal (image- or text-only) models. We introduce realistic assumptions of partial model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ivan Evtimov , Russel Howes , Brian Dolhansky , Hamed Firooz , Cristian Canton Ferrer

With an increase in deep learning-based methods, the call for explainability of such methods grows, especially in high-stakes decision making areas such as medical image analysis. This survey presents an overview of eXplainable Artificial…

Image and Video Processing · Electrical Eng. & Systems 2022-05-06 Bas H. M. van der Velden , Hugo J. Kuijf , Kenneth G. A. Gilhuijs , Max A. Viergever

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…