English
Related papers

Related papers: A Multimodal Automated Interpretability Agent

200 papers

Interpretation of deep learning models is a very challenging problem because of their large number of parameters, complex connections between nodes, and unintelligible feature representations. Despite this, many view interpretability as a…

Machine Learning · Computer Science 2021-03-05 Michael Tsang , James Enouen , Yan Liu

Many fine-grained classification tasks, like rare animal identification, have limited training data and consequently classifiers trained on these datasets often fail to generalize to variations in the domain like changes in weather or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Lisa Dunlap , Alyssa Umino , Han Zhang , Jiezhi Yang , Joseph E. Gonzalez , Trevor Darrell

Explainable Artificial Intelligence (XAI) is critical for ensuring trust and accountability, yet its development remains predominantly visual. For blind and low-vision (BLV) users, the lack of accessible explanations creates a fundamental…

Human-Computer Interaction · Computer Science 2026-05-05 Abu Noman Md Sakib , Protik Dey , Zijie Zhang , Taslima Akter

The misuse of generative AI in online disinformation campaigns highlights the urgent need for transparent and explainable detection systems. In this work, we investigate how detectors for AI-generated images can be more effective in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Silvia Poletti , Justin Ilyes , Marcel Hasenbalg , David Fischinger , Martin Boyer

Artificial Intelligence (AI) increasingly shows its potential to outperform predicate logic algorithms and human control alike. In automatically deriving a system model, AI algorithms learn relations in data that are not detectable for…

Artificial Intelligence · Computer Science 2022-10-12 Simon Daniel Duque Anton , Daniel Schneider , Hans Dieter Schotten

Contemporary machine learning paradigm excels in statistical data analysis, solving problems that classical AI couldn't. However, it faces key limitations, such as a lack of integration with planning, incomprehensible internal structure,…

Artificial Intelligence · Computer Science 2025-01-29 Zeki Doruk Erden , Boi Faltings

The need for explainable AI (XAI) is well established but relatively little has been published outside of the supervised learning paradigm. This paper focuses on a principled approach to applying explainability and interpretability to the…

Machine Learning · Computer Science 2022-07-26 John Sipple , Abdou Youssef

We examine how users perceive the limitations of an AI system when it encounters a task that it cannot perform perfectly and whether providing explanations alongside its answers aids users in constructing an appropriate mental model of the…

Computation and Language · Computer Science 2025-06-24 Judith Sieker , Simeon Junker , Ronja Utescher , Nazia Attari , Heiko Wersing , Hendrik Buschmeier , Sina Zarrieß

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Process models are frequently used in software engineering to describe business requirements, guide software testing and control system improvement. However, traditional process modeling methods often require the participation of numerous…

Artificial Intelligence · Computer Science 2024-08-08 Leilei Lin , Yumeng Jin , Yingming Zhou , Wenlong Chen , Chen Qian

Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Lukas Klein , João B. S. Carvalho , Mennatallah El-Assady , Paolo Penna , Joachim M. Buhmann , Paul F. Jaeger

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

With recent advances in multi-modal foundation models, the previously text-only large language models (LLM) have evolved to incorporate visual input, opening up unprecedented opportunities for various applications in visualization. Our work…

Human-Computer Interaction · Computer Science 2023-12-08 Shusen Liu , Haichao Miao , Zhimin Li , Matthew Olson , Valerio Pascucci , Peer-Timo Bremer

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 N Dinesh Reddy , Dylan Snyder , Lona Kiragu , Mirajul Mohin , Shahrear Bin Amin , Sudeep Pillai

Explainability is a longstanding challenge in deep learning, especially in high-stakes domains like healthcare. Common explainability methods highlight image regions that drive an AI model's decision. Humans, however, heavily rely on…

Artificial Intelligence · Computer Science 2023-11-21 Shobhit Agarwal , Yevgeniy R. Semenov , William Lotter

Artificial Intelligence (AI) has a tremendous impact on the unexpected growth of technology in almost every aspect. AI-powered systems are monitoring and deciding about sensitive economic and societal issues. The future is towards…

Machine Learning · Computer Science 2022-06-14 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Automaton models are often seen as interpretable models. Interpretability itself is not well defined: it remains unclear what interpretability means without first explicitly specifying objectives or desired attributes. In this paper, we…

Machine Learning · Statistics 2016-11-28 Christian Albert Hammerschmidt , Sicco Verwer , Qin Lin , Radu State

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

A main issue preventing the use of Convolutional Neural Networks (CNN) in end user applications is the low level of transparency in the decision process. Previous work on CNN interpretability has mostly focused either on localizing the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Diego Marcos , Sylvain Lobry , Devis Tuia

Machine learning (ML) interpretability techniques can reveal undesirable patterns in data that models exploit to make predictions--potentially causing harms once deployed. However, how to take action to address these patterns is not always…