English

DAG DECORation: Continuous Optimization for Structure Learning under Hidden Confounding

Machine Learning 2025-10-03 v1 Methodology

Abstract

We study structure learning for linear Gaussian SEMs in the presence of latent confounding. Existing continuous methods excel when errors are independent, while deconfounding-first pipelines rely on pervasive factor structure or nonlinearity. We propose \textsc{DECOR}, a single likelihood-based and fully differentiable estimator that jointly learns a DAG and a correlated noise model. Our theory gives simple sufficient conditions for global parameter identifiability: if the mixed graph is bow free and the noise covariance has a uniform eigenvalue margin, then the map from (\B,\OmegaMat)(\B,\OmegaMat) to the observational covariance is injective, so both the directed structure and the noise are uniquely determined. The estimator alternates a smooth-acyclic graph update with a convex noise update and can include a light bow complementarity penalty or a post hoc reconciliation step. On synthetic benchmarks that vary confounding density, graph density, latent rank, and dimension with n<pn<p, \textsc{DECOR} matches or outperforms strong baselines and is especially robust when confounding is non-pervasive, while remaining competitive under pervasiveness.

Keywords

Cite

@article{arxiv.2510.02117,
  title  = {DAG DECORation: Continuous Optimization for Structure Learning under Hidden Confounding},
  author = {Samhita Pal and James O'quinn and Kaveh Aryan and Heather Pua and James P. Long and Amir Asiaee},
  journal= {arXiv preprint arXiv:2510.02117},
  year   = {2025}
}
R2 v1 2026-07-01T06:13:27.169Z