English
Related papers

Related papers: Interpretable Image Recognition with Hierarchical …

200 papers

This is a preliminary version of visual interpretation integrating multiple sensors in SUCCESSOR, an intelligent, model-based vision system. We pursue a thorough integration of hierarchical Bayesian inference with comprehensive physical…

Artificial Intelligence · Computer Science 2013-04-11 Thomas O. Binford , Tod S. Levitt , Wallace B. Mann

Developing AI systems with a human-like understanding of everyday concepts is a key step towards developing safe, reliable systems whose behavior makes sense to humans. When probing concept understanding, asking questions about plausible…

Artificial Intelligence · Computer Science 2026-05-22 Sunayana Rane , Brenden M. Lake , Thomas L. Griffiths

The evaluation of explainable artificial intelligence is challenging, because automated and human-centred metrics of explanation quality may diverge. To clarify their relationship, we investigated whether human and artificial image…

Human-Computer Interaction · Computer Science 2024-08-20 Romy Müller , Marius Thoß , Julian Ullrich , Steffen Seitz , Carsten Knoll

Interpretability is a key requirement for the use of machine learning models in high-stakes applications, including medical diagnosis. Explaining black-box models mostly relies on post-hoc methods that do not faithfully reflect the model's…

Artificial Intelligence · Computer Science 2024-06-25 Kerol Djoumessi , Bubacarr Bah , Laura Kühlewein , Philipp Berens , Lisa Koch

When a human undertakes a test, their responses likely follow a pattern: if they answered an easy question $(2 \times 3)$ incorrectly, they would likely answer a more difficult one $(2 \times 3 \times 4)$ incorrectly; and if they answered a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zeyi Huang , Utkarsh Ojha , Yuyang Ji , Donghyun Lee , Yong Jae Lee

In spite of several claims stating that some models are more interpretable than others -- e.g., "linear models are more interpretable than deep neural networks" -- we still lack a principled notion of interpretability to formally compare…

Artificial Intelligence · Computer Science 2020-11-16 Pablo Barceló , Mikaël Monet , Jorge Pérez , Bernardo Subercaseaux

Language is an effective medium for bi-directional communication in human-robot teams. To infer the meaning of many instructions, robots need to construct a model of their surroundings that describe the spatial, semantic, and metric…

Robotics · Computer Science 2019-09-24 Ethan Fahnestock , Siddharth Patki , Thomas M. Howard

Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert…

Machine Learning · Computer Science 2022-10-18 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

There is a growing concern about typically opaque decision-making with high-performance machine learning algorithms. Providing an explanation of the reasoning process in domain-specific terms can be crucial for adoption in risk-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Aditya Chattopadhyay , Stewart Slocum , Benjamin D. Haeffele , Rene Vidal , Donald Geman

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Understanding why machine learning models behave the way they do empowers both system designers and end-users in many ways: in model selection, feature engineering, in order to trust and act upon the predictions, and in more intuitive user…

Machine Learning · Statistics 2016-06-20 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

This paper explores a hierarchical prompting mechanism for the hierarchical image classification (HIC) task. Different from prior HIC methods, our hierarchical prompting is the first to explicitly inject ancestor-class information as a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Wenhao Wang , Yifan Sun , Wei Li , Yi Yang

An aesthetics evaluation model is at the heart of predicting users' aesthetic experience and developing user interfaces with higher quality. However, previous methods on aesthetic evaluation largely ignore the interpretability of the model…

Human-Computer Interaction · Computer Science 2022-02-10 Xiaoran Wu

Deploying deep neural networks for risk-sensitive tasks necessitates an uncertainty estimation mechanism. This paper introduces hierarchical selective classification, extending selective classification to a hierarchical setting. Our…

Machine Learning · Computer Science 2025-01-07 Shani Goren , Ido Galil , Ran El-Yaniv

Understanding a visualization is a multi-level process. A reader must extract and extrapolate from numeric facts, understand how those facts apply to both the context of the data and other potential contexts, and draw or evaluate…

Human-Computer Interaction · Computer Science 2020-09-04 Alyxander Burns , Cindy Xiong , Steven Franconeri , Alberto Cairo , Narges Mahyar

Interpreting the decisions of complex computer vision models is crucial to establish trust and accountability, especially in safety-critical domains. An established approach to interpretability is generating visual attribution maps that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 David Schinagl , Christian Fruhwirth-Reisinger , Alexander Prutsch , Samuel Schulter , Horst Possegger

Deep Neural Networks use thousands of mostly incomprehensible features to identify a single class, a decision no human can follow. We propose an interpretable sparse and low dimensional final decision layer in a deep neural network with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Thomas Norrenbrock , Marco Rudolph , Bodo Rosenhahn

With the growing pervasiveness of artificial intelligence, the ability to explain the inferences made by machine learning models has become increasingly important. Numerous techniques for model explainability have been proposed, with…

Human-Computer Interaction · Computer Science 2026-04-08 Nicola Rossberg , Bennett Kleinberg , Barry O'Sullivan , Luca Longo , Andrea Visentin

Human perception is routinely assessing the similarity between images, both for decision making and creative thinking. But the underlying cognitive process is not really well understood yet, hence difficult to be mimicked by computer vision…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Olivier Risser-Maroix , Amine Marzouki , Hala Djeghim , Camille Kurtz , Nicolas Lomenie

Interpreting the learned features of vision models has posed a longstanding challenge in the field of machine learning. To address this issue, we propose a novel method that leverages the capabilities of language models to interpret the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Saeid Asgari Taghanaki , Aliasghar Khani , Ali Saheb Pasand , Amir Khasahmadi , Aditya Sanghi , Karl D. D. Willis , Ali Mahdavi-Amiri