English
Related papers

Related papers: A Framework for Learning Ante-hoc Explainable Mode…

200 papers

To improve the trustworthiness of an AI model, finding consistent, understandable representations of its inference process is essential. This understanding is particularly important in high-stakes operations such as weather forecasting,…

Artificial Intelligence · Computer Science 2025-04-02 Soyeon Kim , Junho Choi , Subeen Lee , Jaesik Choi

The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the…

Machine Learning · Computer Science 2020-02-14 Gabriel Terejanu , Jawad Chowdhury , Rezaur Rashid , Asif Chowdhury

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

Machine Learning · Computer Science 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu

Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial…

Artificial Intelligence · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

Deep neural networks and other intricate Artificial Intelligence (AI) models have reached high levels of accuracy on many biomedical natural language processing tasks. However, their applicability in real-world use cases may be limited due…

Artificial Intelligence · Computer Science 2020-10-22 Milad Moradi , Matthias Samwald

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet three desiderata:…

Machine Learning · Computer Science 2021-05-11 Andrei Margeloiu , Matthew Ashman , Umang Bhatt , Yanzhi Chen , Mateja Jamnik , Adrian Weller

We introduce SelfExplain, a novel self-explaining model that explains a text classifier's predictions using phrase-based concepts. SelfExplain augments existing neural classifiers by adding (1) a globally interpretable layer that identifies…

Computation and Language · Computer Science 2021-09-09 Dheeraj Rajagopal , Vidhisha Balachandran , Eduard Hovy , Yulia Tsvetkov

The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this…

Machine Learning · Computer Science 2013-03-18 Rakesh Chalasani , Jose C. Principe

We present Learning to Explain (LTX), a model-agnostic framework designed for providing post-hoc explanations for vision models. The LTX framework introduces an "explainer" model that generates explanation maps, highlighting the crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Oren Barkan , Yuval Asher , Amit Eshel , Yehonatan Elisha , Noam Koenigstein

Questions convey information about the questioner, namely what one does not know. In this paper, we propose a novel approach to allow a learning agent to ask what it considers as tricky to predict, in the course of producing a final output.…

Artificial Intelligence · Computer Science 2018-11-14 Sungmin Kang , David Keetae Park , Jaehyuk Chang , Jaegul Choo

Human explanations of high-level decisions are often expressed in terms of key concepts the decisions are based on. In this paper, we study such concept-based explainability for Deep Neural Networks (DNNs). First, we define the notion of…

Machine Learning · Computer Science 2022-02-09 Chih-Kuan Yeh , Been Kim , Sercan O. Arik , Chun-Liang Li , Tomas Pfister , Pradeep Ravikumar

Most recent work on interpretability of complex machine learning models has focused on estimating $\textit{a posteriori}$ explanations for previously trained models around specific predictions. $\textit{Self-explaining}$ models where…

Machine Learning · Computer Science 2018-12-05 David Alvarez-Melis , Tommi S. Jaakkola

We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural…

Machine Learning · Computer Science 2024-07-18 Zachariah Carmichael , Timothy Redgrave , Daniel Gonzalez Cedre , Walter J. Scheirer

The unification of low-level perception and high-level reasoning is a long-standing problem in artificial intelligence, which has the potential to not only bring the areas of logic and learning closer together but also demonstrate how…

Artificial Intelligence · Computer Science 2019-11-27 Anton Fuxjaeger , Vaishak Belle

Supervised fine-tuning enhances the problem-solving abilities of language models across various mathematical reasoning tasks. To maximize such benefits, existing research focuses on broadening the training set with various data augmentation…

Computation and Language · Computer Science 2024-10-08 Zhihan Zhang , Tao Ge , Zhenwen Liang , Wenhao Yu , Dian Yu , Mengzhao Jia , Dong Yu , Meng Jiang

Deploying reliable deep learning techniques in interdisciplinary applications needs learned models to output accurate and (even more importantly) explainable predictions. Existing approaches typically explicate network outputs in a post-hoc…

Machine Learning · Computer Science 2023-05-26 Chenyu Xue , Fan Wang , Yuanzhuo Zhu , Hui Li , Deyu Meng , Dinggang Shen , Chunfeng Lian

Question answering has seen significant advances in recent times, especially with the introduction of increasingly bigger transformer-based models pre-trained on massive amounts of data. While achieving impressive results on many…

Computation and Language · Computer Science 2019-09-16 Sathyanarayanan N. Aakur , Sudeep Sarkar

Confidence-aware learning is proven as an effective solution to prevent networks becoming overconfident. We present a confidence-aware camouflaged object detection framework using dynamic supervision to produce both accurate camouflage map…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiawei Liu , Jing Zhang , Nick Barnes

Past work on story generation has demonstrated the usefulness of conditioning on a generation plan to generate coherent stories. However, these approaches have used heuristics or off-the-shelf models to first tag training stories with the…

Computation and Language · Computer Science 2020-10-08 Harsh Jhamtani , Taylor Berg-Kirkpatrick

Deep learning algorithms have recently gained significant attention due to their impressive performance. However, their high complexity and un-interpretable mode of operation hinders their confident deployment in real-world safety-critical…

Machine Learning · Computer Science 2024-06-28 Konstantinos P. Panousis , Dino Ienco , Diego Marcos