English

An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis

Machine Learning 2024-02-19 v2 Computational Engineering, Finance, and Science Systems and Control Systems and Control Methodology

Abstract

We investigate the relationship between system identification and intervention design in dynamical systems. While previous research demonstrated how identifiable representation learning methods, such as Independent Component Analysis (ICA), can reveal cause-effect relationships, it relied on a passive perspective without considering how to collect data. Our work shows that in Gaussian Linear Time-Invariant (LTI) systems, the system parameters can be identified by introducing diverse intervention signals in a multi-environment setting. By harnessing appropriate diversity assumptions motivated by the ICA literature, our findings connect experiment design and representational identifiability in dynamical systems. We corroborate our findings on synthetic and (simulated) physical data. Additionally, we show that Hidden Markov Models, in general, and (Gaussian) LTI systems, in particular, fulfil a generalization of the Causal de Finetti theorem with continuous parameters.

Keywords

Cite

@article{arxiv.2311.18048,
  title  = {An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis},
  author = {Goutham Rajendran and Patrik Reizinger and Wieland Brendel and Pradeep Ravikumar},
  journal= {arXiv preprint arXiv:2311.18048},
  year   = {2024}
}

Comments

CLeaR2024 camera ready. Code available at https://github.com/rpatrik96/lti-ica