English

Parallel Network Reconstruction with Multi-directional Regularization

Statistics Theory 2025-08-20 v2 Machine Learning Machine Learning Statistics Theory

Abstract

Reconstructing large-scale latent networks from observed dynamics is crucial for understanding complex systems. However, the existing methods based on compressive sensing are often rendered infeasible in practice by prohibitive computational and memory costs. To address this challenge, we introduce a new distributed computing framework for efficient large-scale network reconstruction with parallel computing, namely PALMS (Parallel Adaptive Lasso with Multi-directional Signals). The core idea of PALMS is to decompose the complex global problem by partitioning network nodes, enabling the parallel estimation of sub-networks across multiple computing units. This strategy substantially reduces the computational complexity and storage requirements of classic methods. By using the adaptive multi-directional regularization on each computing unit, we also establish the consistency of PALMS estimator theoretically. Extensive simulation studies and empirical analyses on several large-scale real-world networks validate the computational efficiency and robust reconstruction accuracy of our approach.

Keywords

Cite

@article{arxiv.2411.11464,
  title  = {Parallel Network Reconstruction with Multi-directional Regularization},
  author = {Zhaoyu Xing and Wei Zhong},
  journal= {arXiv preprint arXiv:2411.11464},
  year   = {2025}
}

Comments

48 pages