English
Related papers

Related papers: Enhancing Vision Transformer Explainability Using …

200 papers

The embedding spaces of image models have been shown to encode a range of social biases such as racism and sexism. Here, we investigate specific factors that contribute to the emergence of these biases in Vision Transformers (ViT).…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jannik Brinkmann , Paul Swoboda , Christian Bartelt

Nowadays, Vision Transformer (ViT) is widely utilized in various computer vision tasks, owing to its unique self-attention mechanism. However, the model architecture of ViT is complex and often challenging to comprehend, leading to a steep…

Artificial Intelligence · Computer Science 2024-01-24 Hong Zhou , Rui Zhang , Peifeng Lai , Chaoran Guo , Yong Wang , Zhida Sun , Junjie Li

With the rising necessity of explainable artificial intelligence (XAI), we see an increase in task-dependent XAI methods on varying abstraction levels. XAI techniques on a global level explain model behavior and on a local level explain…

Human-Computer Interaction · Computer Science 2023-07-18 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

End-to-end robot policies achieve high performance through neural networks trained via reinforcement learning (RL). Yet, their black box nature and abstract reasoning pose challenges for human-robot interaction (HRI), because humans may…

This paper presents a new Vision Transformer (ViT) architecture Multi-Scale Vision Longformer, which significantly enhances the ViT of \cite{dosovitskiy2020image} for encoding high-resolution images using two techniques. The first is the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Pengchuan Zhang , Xiyang Dai , Jianwei Yang , Bin Xiao , Lu Yuan , Lei Zhang , Jianfeng Gao

Explainability is one of the key elements for building trust in AI systems. Among numerous attempts to make AI explainable, quantifying the effect of explanations remains a challenge in conducting human-AI collaborative tasks. Aside from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Kamran Alipour , Arijit Ray , Xiao Lin , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

Vision Transformers (ViTs) have achieved state-of-the-art performance for various vision tasks. One reason behind the success lies in their ability to provide plausible innate explanations for the behavior of neural architectures. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lijie Hu , Yixin Liu , Ninghao Liu , Mengdi Huai , Lichao Sun , Di Wang

Current approaches for designing self-explainable models (SEMs) require complicated training procedures and specific architectures which makes them impractical. With the advance of general purpose foundation models based on Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Kristoffer Wickstrøm , Teresa Dorszewski , Siyan Chen , Michael Kampffmeyer , Elisabeth Wetzer , Robert Jenssen

Explainable Artificial Intelligence (AI) in the form of an interpretable and semiautomatic approach to stage grading ocular pathologies such as Diabetic retinopathy, Hypertensive retinopathy, and other retinopathies on the backdrop of major…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Ayushi Raj Bhatt , Rajkumar Vaghashiya , Meghna Kulkarni , Dr Prakash Kamaraj

With the emergence of Artificial Intelligence (AI)-based decision-making, explanations help increase new technology adoption through enhanced trust and reliability. However, our experimental study challenges the notion that every user…

Human-Computer Interaction · Computer Science 2024-05-01 Sabid Bin Habib Pias , Alicia Freel , Timothy Trammel , Taslima Akter , Donald Williamson , Apu Kapadia

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

With artificial intelligence (AI) embedded in many everyday software systems, effectively and reliably developing and maintaining AI systems becomes an essential skill for software developers. However, the complexity inherent to AI poses…

Human-Computer Interaction · Computer Science 2025-04-22 Thomas Weber

Vision transformer (ViT) and its variants have swept through visual learning leaderboards and offer state-of-the-art accuracy in tasks such as image classification, object detection, and semantic segmentation by attending to different parts…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Eric Youn , Sai Mitheran J , Sanjana Prabhu , Siyuan Chen

Explainable Artificial Intelligence (XAI) is an emerging research field bringing transparency to highly complex and opaque machine learning (ML) models. Despite the development of a multitude of methods to explain the decisions of black-box…

Machine Learning · Computer Science 2022-03-16 Leander Weber , Sebastian Lapuschkin , Alexander Binder , Wojciech Samek

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

Artificial Intelligence in Medicine has made significant progress with emerging applications in medical imaging, patient care, and other areas. While these applications have proven successful in retrospective studies, very few of them were…

Artificial Intelligence · Computer Science 2023-08-11 Nicoletta Prentzas , Antonis Kakas , Constantinos S. Pattichis

As AI technology is increasingly applied to high-impact, high-risk domains, there have been a number of new methods aimed at making AI models more human interpretable. Despite the recent growth of interpretability work, there is a lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Sunnie S. Y. Kim , Nicole Meister , Vikram V. Ramaswamy , Ruth Fong , Olga Russakovsky

Explainable Artificial Intelligence (XAI) addresses the growing need for transparency and interpretability in AI systems, enabling trust and accountability in decision-making processes. This book offers a comprehensive guide to XAI,…

We use artificial intelligence (AI) and supervisory adaptive control systems to plan and optimize the mission of precise spacecraft formation. Machine learning and robust control enhance the efficiency of spacecraft precision formation of…

Instrumentation and Methods for Astrophysics · Physics 2025-09-18 Reza Pirayeshshirazinezhad

Vision Transformers (ViTs), when pre-trained on large-scale data, provide general-purpose representations for diverse downstream tasks. However, artifacts in ViTs are widely observed across different supervision paradigms and downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Cheng Shi , Yizhou Yu , Sibei Yang