English

Neural Backward Filtering Forward Guiding

Machine Learning 2026-05-18 v2 Machine Learning Methodology

Abstract

Inference in nonlinear continuous stochastic processes on trees is challenging, particularly when observations are sparse and the topology is complex. Exact smoothing via Doob's hh-transform is intractable for general nonlinear dynamics. We propose Neural Backward Filtering Forward Guiding (NBFFG), a unified framework for both discrete transitions and continuous diffusions. Our method constructs a variational posterior by leveraging a proxy linear-Gaussian process. This proxy process yields a closed-form backward filter that serves as a guide, steering the generative path toward high-likelihood regions. We then learn a neural residual to capture the non-linear discrepancies. This formulation allows for an unbiased pathwise subsampling scheme, reducing the training complexity from tree-size dependent to path-length dependent. Empirical results show that NBFFG outperforms baselines on synthetic benchmarks, and we demonstrate the method on a high-dimensional inference task in phylogenetic analysis with reconstruction of ancestral butterfly wing shapes.

Keywords

Cite

@article{arxiv.2601.23030,
  title  = {Neural Backward Filtering Forward Guiding},
  author = {Gefan Yang and Frank van der Meulen and Stefan Sommer},
  journal= {arXiv preprint arXiv:2601.23030},
  year   = {2026}
}
R2 v1 2026-07-01T09:27:52.065Z