English
Related papers

Related papers: Abstracting Deep Neural Networks into Concept Grap…

200 papers

Deep learning methods, in particular convolutional neural networks, have emerged as a powerful tool in medical image computing tasks. While these complex models provide excellent performance, their black-box nature may hinder real-world…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yuzhe Lu , Adam Perer

The opaque reasoning of Graph Neural Networks induces a lack of human trust. Existing graph network explainers attempt to address this issue by providing post-hoc explanations, however, they fail to make the model itself more interpretable.…

Large-scale foundation models demonstrate strong performance across language, vision, and reasoning tasks. However, how they internally structure and stabilize concepts remains elusive. Inspired by causal inference, we introduce the…

Machine Learning · Computer Science 2025-11-25 Bowei Tian , Yexiao He , Wanghao Ye , Ziyao Wang , Meng Liu , Ang Li

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

In many practical applications, deep neural networks have been typically deployed to operate as a black box predictor. Despite the high amount of work on interpretability and high demand on the reliability of these systems, they typically…

Artificial Intelligence · Computer Science 2020-12-07 Martin Stano , Wanda Benesova , Lukas Samuel Martak

Deep learning methods are highly accurate, yet their opaque decision process prevents them from earning full human trust. Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts.…

Deep learning (DL) models have been popular due to their ability to learn directly from the raw data in an end-to-end paradigm, alleviating the concern of a separate error-prone feature extraction phase. Recent DL-based neuroimaging studies…

Machine Learning · Computer Science 2023-07-20 Md. Mahfuzur Rahman , Vince D. Calhoun , Sergey M. Plis

Deep Learning has made a great progress for these years. However, it is still difficult to master the implement of various models because different researchers may release their code based on different frameworks or interfaces. In this…

Software Engineering · Computer Science 2017-07-28 Ting Pan

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

Learning the underlying patterns in data goes beyond instance-based generalization to external knowledge represented in structured graphs or networks. Deep learning that primarily constitutes neural computing stream in AI has shown…

Artificial Intelligence · Computer Science 2023-09-04 Ugur Kursuncu , Manas Gaur , Amit Sheth

One of the current key challenges in Explainable AI is in correctly interpreting activations of hidden neurons. It seems evident that accurate interpretations thereof would provide insights into the question what a deep learning system has…

Machine Learning · Computer Science 2023-01-24 Abhilekha Dalal , Md Kamruzzaman Sarker , Adrita Barua , Pascal Hitzler

Exponential growth in Electronic Healthcare Records (EHR) has resulted in new opportunities and urgent needs for discovery of meaningful data-driven representations and patterns of diseases in Computational Phenotyping research. Deep…

Machine Learning · Statistics 2015-12-14 Zhengping Che , Sanjay Purushotham , Robinder Khemani , Yan Liu

Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience. GNNs are promising to model complicated network data, but they are prone to overfitting and suffer from poor interpretability,…

Machine Learning · Computer Science 2021-07-13 Hejie Cui , Wei Dai , Yanqiao Zhu , Xiaoxiao Li , Lifang He , Carl Yang

The interpretation of deep neural networks (DNNs) has become a key topic as more and more people apply them to solve various problems and making critical decisions. Concept-based explanations have recently become a popular approach for…

Human-Computer Interaction · Computer Science 2021-08-10 Zhenge Zhao , Panpan Xu , Carlos Scheidegger , Liu Ren

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

Despite their impact on the society, deep neural networks are often regarded as black-box models due to their intricate structures and the absence of explanations for their decisions. This opacity poses a significant challenge to AI systems…

Machine Learning · Computer Science 2024-07-18 Biagio La Rosa

Psychovisual models suggest human vision decouples low-level feature extraction from higher cognition by first forming intermediate abstractions. In contrast, deep learning-based vision models routinely extract and aggregate features using…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Wendi Ma , Aryaman Sharma , Wei Dai , Shekhar S. Chandra

Continual learning aims to update models under distribution shift without forgetting, yet many high-stakes deployments, such as healthcare, also require interpretability. In practice, models that adapt well (e.g., deep networks) are often…

Machine Learning · Computer Science 2026-04-21 Dongkyu Cho , Xiyue Li , Samrachana Adhikari , Rumi Chunara

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

The pursuit of interpretable artificial intelligence has led to significant advancements in the development of methods that aim to explain the decision-making processes of complex models, such as deep learning systems. Among these methods,…

Machine Learning · Computer Science 2024-10-29 Yihao Zhang