English
Related papers

Related papers: Defining and Quantifying the Emergence of Sparse C…

200 papers

Sparse autoencoders can localize where concepts live in language models, but not how they interact during multi-step reasoning. We propose Causal Concept Graphs (CCG): a directed acyclic graph over sparse, interpretable latent features,…

Machine Learning · Computer Science 2026-04-27 Md Muntaqim Meherab , Noor Islam S. Mohammad , Faiza Feroz

As a contribution to metaphor analysis, we introduce a statistical, data-based investigation with empirical analysis of long-standing conjectures and a first-ever empirical exploration of the systematic features of metaphors. Conversely,…

Computation and Language · Computer Science 2023-09-18 Marie Teich , Wilmer Leal , Juergen Jost

Biomarker discovery from high-throughput transcriptomic data is crucial for advancing precision medicine. However, existing methods often neglect gene-gene regulatory relationships and lack stability across datasets, leading to conflation…

Quantitative Methods · Quantitative Biology 2025-11-18 Chaowang Lan , Jingxin Wu , Yulong Yuan , Chuxun Liu , Huangyi Kang , Caihua Liu

Sparse Neural Networks regained attention due to their potential for mathematical and computational advantages. We give motivation to study Artificial Neural Networks (ANNs) from a network science perspective, provide a technique to embed…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Julian Stier , Michael Granitzer

Graph Neural Networks (GNNs) have emerged as powerful representation learning tools for capturing complex dependencies within diverse graph-structured data. Despite their success in a wide range of graph mining tasks, GNNs have raised…

Machine Learning · Computer Science 2024-06-19 Wenzhao Jiang , Hao Liu , Hui Xiong

Causality can be described in terms of a structural causal model (SCM) that carries information on the variables of interest and their mechanistic relations. For most processes of interest the underlying SCM will only be partially…

Machine Learning · Computer Science 2021-10-26 Matej Zečević , Devendra Singh Dhami , Petar Veličković , Kristian Kersting

Causal abstractions allow us to relate causal models on different levels of granularity. To ensure that the models agree on cause and effect, frameworks for causal abstractions define notions of consistency. Two distinct methods for causal…

Artificial Intelligence · Computer Science 2025-03-17 Willem Schooltink , Fabio Massimo Zennaro

We study the problem of graph structure identification, i.e., of recovering the graph of dependencies among time series. We model these time series data as components of the state of linear stochastic networked dynamical systems. We assume…

Machine Learning · Computer Science 2023-06-29 Sérgio Machado , Anirudh Sridhar , Paulo Gil , Jorge Henriques , José M. F. Moura , Augusto Santos

Intrinsic interpretability of graph neural networks (GNNs) is to find a small subset of the input graph's features -- rationale -- which guides the model prediction. Unfortunately, the leading rationalization models often rely on data…

Machine Learning · Computer Science 2022-02-01 Ying-Xin Wu , Xiang Wang , An Zhang , Xiangnan He , Tat-Seng Chua

Masking some input variables of a deep neural network (DNN) and computing output changes on the masked input sample represent a typical way to compute attributions of input variables in the sample. People usually mask an input variable…

Machine Learning · Computer Science 2023-05-25 Jie Ren , Zhanpeng Zhou , Qirui Chen , Quanshi Zhang

Epidemic outcomes have a complex interplay with human behavior and beliefs. Most of the forecasting literature has focused on the task of predicting epidemic signals using simple mechanistic models or black-box models, such as deep…

Machine Learning · Computer Science 2025-12-02 Mulin Tian , Ajitesh Srivastava

Explainable Graph Neural Network (GNN) has emerged recently to foster the trust of using GNNs. Existing GNN explainers are developed from various perspectives to enhance the explanation performance. We take the first step to study GNN…

Cryptography and Security · Computer Science 2024-06-06 Jiate Li , Meng Pang , Yun Dong , Jinyuan Jia , Binghui Wang

Most Graph Neural Networks (GNNs) predict the labels of unseen graphs by learning the correlation between the input graphs and labels. However, by presenting a graph classification investigation on the training graphs with severe bias,…

Machine Learning · Computer Science 2022-09-29 Shaohua Fan , Xiao Wang , Yanhu Mo , Chuan Shi , Jian Tang

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

*Concept-based explanations* offer a promising approach for explaining the predictions of deep neural networks in terms of high-level, human-understandable concepts. However, existing methods either do not establish a causal connection…

Machine Learning · Computer Science 2026-05-08 Ronaldo Canizales , Divya Gopinath , Corina Păsăreanu , Ravi Mangal

In recent years, the remarkable success of graph neural networks (GNNs) on graph-structured data has prompted a surge of methods for explaining GNN predictions. However, the state-of-the-art for GNN explainability remains in flux. Different…

Machine Learning · Computer Science 2025-08-05 Jesse He , Akbar Rafiey , Gal Mishne , Yusu Wang

Causal models seek to unravel the cause-effect relationships among variables from observed data, as opposed to mere mappings among them, as traditional regression models do. This paper introduces a novel causal discovery algorithm designed…

Machine Learning · Computer Science 2024-10-03 Saeed Mohseni-Sehdeh , Walid Saad

Heterophily is a prevalent property of real-world graphs and is well known to impair the performance of homophilic Graph Neural Networks (GNNs). Prior work has attempted to adapt GNNs to heterophilic graphs through non-local neighbor…

Machine Learning · Computer Science 2026-04-22 Xiangmeng Wang , Qian Li , Haiyang Xia , Hao Miao , Qing Li , Guandong Xu

Graph Neural Networks (GNNs) have gained considerable traction for their capability to effectively process topological data, yet their interpretability remains a critical concern. Current interpretation methods are dominated by post-hoc…

Machine Learning · Computer Science 2024-02-08 Jiahua Rao , Jiancong Xie , Hanjing Lin , Shuangjia Zheng , Zhen Wang , Yuedong Yang

Directed acyclic graphs (DAGs) constitute a central modeling tool to enable principled reasoning about cause-effect interactions in complex systems. However, since the causal structure underlying a group of variables is often unknown and…

Machine Learning · Statistics 2026-05-25 Gonzalo Mateos , Samuel Rey , Hamed Ajorlou , Mariano Tepper