English
Related papers

Related papers: Concept-Based Mechanistic Interpretability Using S…

200 papers

The growing adoption of Graph Neural Networks (GNNs) in high-stakes domains like healthcare and finance demands reliable explanations of their decision-making processes. While inherently interpretable GNN architectures like Graph…

Machine Learning · Computer Science 2025-05-27 Rishabh Bhattacharya , Hari Shankar , Vaishnavi Shivkumar , Ponnurangam Kumaraguru

Graph Neural Networks (GNNs) have become a powerful tool for modeling and analyzing data with graph structures. The wide adoption in numerous applications underscores the value of these models. However, the complexity of these methods often…

Artificial Intelligence · Computer Science 2025-12-10 Tien Cuong Bui

Understanding complex machine learning models such as deep neural networks with explanations is crucial in various applications. Many explanations stem from the model perspective, and may not necessarily effectively communicate why the…

Machine Learning · Computer Science 2022-02-28 Chih-Kuan Yeh , Been Kim , Pradeep Ravikumar

Graph Neural Networks (GNNs) have emerged as a prominent framework for graph mining, leading to significant advances across various domains. Stemmed from the node-wise representations of GNNs, existing explanation studies have embraced the…

Machine Learning · Computer Science 2024-07-03 Yuwen Wang , Shunyu Liu , Tongya Zheng , Kaixuan Chen , Mingli Song

The thesis explores the role machine learning methods play in creating intuitive computational models of neural processing. Combined with interpretability techniques, machine learning could replace human modeler and shift the focus of human…

Neurons and Cognition · Quantitative Biology 2020-10-20 Ilya Kuzovkin

Despite their large-scale coverage, cross-domain knowledge graphs invariably suffer from inherent incompleteness and sparsity. Link prediction can alleviate this by inferring a target entity, given a source entity and a query relation.…

Computation and Language · Computer Science 2020-09-28 Rajarshi Bhowmik , Gerard de Melo

Mechanistic interpretability aims to reverse engineer the computation performed by a neural network in terms of its internal components. Although there is a growing body of research on mechanistic interpretation of neural networks, the…

Machine Learning · Computer Science 2025-06-24 Nils Palumbo , Ravi Mangal , Zifan Wang , Saranya Vijayakumar , Corina S. Pasareanu , Somesh Jha

The objective of knowledge graph embedding is to encode both entities and relations of knowledge graphs into continuous low-dimensional vector spaces. Previously, most works focused on symbolic representation of knowledge graph with…

Computation and Language · Computer Science 2016-12-14 Jiacheng Xu , Kan Chen , Xipeng Qiu , Xuanjing Huang

Allowing users to interact through language borders is an interesting challenge for information technology. For the purpose of a computer assisted language learning system, we have chosen icons for representing meaning on the input…

Computation and Language · Computer Science 2007-05-23 Pascal Vaillant

With the popularity of deep neural networks (DNNs), model interpretability is becoming a critical concern. Many approaches have been developed to tackle the problem through post-hoc analysis, such as explaining how predictions are made or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haixing Dai , Lu Zhang , Lin Zhao , Zihao Wu , Zhengliang Liu , David Liu , Xiaowei Yu , Yanjun Lyu , Changying Li , Ninghao Liu , Tianming Liu , Dajiang Zhu

Convolutional neural networks (CNN) are known to learn an image representation that captures concepts relevant to the task, but do so in an implicit way that hampers model interpretability. However, one could argue that such a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Diego Marcos , Ruth Fong , Sylvain Lobry , Remi Flamary , Nicolas Courty , Devis Tuia

Developing interpretable models for neurodevelopmental disorders (NDDs) diagnosis presents significant challenges in effectively encoding, decoding, and integrating multimodal neuroimaging data. While many existing machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yueyang Li , Lei Chen , Wenhao Dong , Shengyu Gong , Zijian Kang , Boyang Wei , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

The success of neural networks builds to a large extent on their ability to create internal knowledge representations from real-world high-dimensional data, such as images, sound, or text. Approaches to extract and present these…

Artificial Intelligence · Computer Science 2023-01-03 Lars Holmberg , Paul Davidsson , Per Linde

A fundamental question in natural language processing is - what kind of language structure and semantics is the language model capturing? Graph formats such as knowledge graphs are easy to evaluate as they explicitly express language…

Computation and Language · Computer Science 2023-05-10 Kaushik Roy , Tarun Garg , Vedant Palit , Yuxin Zi , Vignesh Narayanan , Amit Sheth

Deep neural networks have been well-known for their superb handling of various machine learning and artificial intelligence tasks. However, due to their over-parameterized black-box nature, it is often difficult to understand the prediction…

Machine Learning · Computer Science 2022-07-18 Xuhong Li , Haoyi Xiong , Xingjian Li , Xuanyu Wu , Xiao Zhang , Ji Liu , Jiang Bian , Dejing Dou

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

Concept Bottleneck Models (CBMs) provide interpretable prediction by introducing an intermediate Concept Bottleneck Layer (CBL), which encodes human-understandable concepts to explain models' decision. Recent works proposed to utilize Large…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Divyansh Srivastava , Ge Yan , Tsui-Wei Weng

Integration between biology and information science benefits both fields. Many related models have been proposed, such as computational visual cognition models, computational motor control models, integrations of both and so on. In general,…

Computer Vision and Pattern Recognition · Computer Science 2016-03-28 Peijie Yin , Hong Qiao , Wei Wu , Lu Qi , YinLin Li , Shanlin Zhong , Bo Zhang

Understanding what deep network models capture in their learned representations is a fundamental challenge in computer vision. We present a new methodology to understanding such vision models, the Visual Concept Connectome (VCC), which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Matthew Kowal , Richard P. Wildes , Konstantinos G. Derpanis

Knowledge graphs represent real-world entities and their relations in a semantically-rich structure supported by ontologies. Exploring this data with machine learning methods often relies on knowledge graph embeddings, which produce latent…

Machine Learning · Computer Science 2023-06-23 Rita T. Sousa , Sara Silva , Catia Pesquita