English

A Lightweight Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processes

Machine Learning 2025-10-28 v2 Artificial Intelligence

Abstract

With the advancement of deep learning technologies, various neural network-based Granger causality models have been proposed. Although these models have demonstrated notable improvements, several limitations remain. Most existing approaches adopt the component-wise architecture, necessitating the construction of a separate model for each time series, which results in substantial computational costs. In addition, imposing the sparsity-inducing penalty on the first-layer weights of the neural network to extract causal relationships weakens the model's ability to capture complex interactions. To address these limitations, we propose Gradient Regularization-based Neural Granger Causality (GRNGC), which requires only one time series prediction model and applies L1L_{1} regularization to the gradient between model's input and output to infer Granger causality. Moreover, GRNGC is not tied to a specific time series forecasting model and can be implemented with diverse architectures such as KAN, MLP, and LSTM, offering enhanced flexibility. Numerical simulations on DREAM, Lorenz-96, fMRI BOLD, and CausalTime show that GRNGC outperforms existing baselines and significantly reduces computational overhead. Meanwhile, experiments on real-world DNA, Yeast, HeLa, and bladder urothelial carcinoma datasets further validate the model's effectiveness in reconstructing gene regulatory networks.

Keywords

Cite

@article{arxiv.2507.11178,
  title  = {A Lightweight Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processes},
  author = {Meiliang Liu and Huiwen Dong and Xiaoxiao Yang and Yunfang Xu and Zijin Li and Zhengye Si and Xinyue Yang and Zhiwen Zhao},
  journal= {arXiv preprint arXiv:2507.11178},
  year   = {2025}
}

Comments

9 pages,3 figures, conference

R2 v1 2026-07-01T04:02:03.844Z