English

Fully differentiable model discovery

Machine Learning 2021-10-06 v2 Machine Learning

Abstract

Model discovery aims at autonomously discovering differential equations underlying a dataset. Approaches based on Physics Informed Neural Networks (PINNs) have shown great promise, but a fully-differentiable model which explicitly learns the equation has remained elusive. In this paper we propose such an approach by integrating neural network-based surrogates with Sparse Bayesian Learning (SBL). This combination yields a robust model discovery algorithm, which we showcase on various datasets. We then identify a connection with multitask learning, and build on it to construct a Physics Informed Normalizing Flow (PINF). We present a proof-of-concept using a PINF to directly learn a density model from single particle data. Our work expands PINNs to various types of neural network architectures, and connects neural network-based surrogates to the rich field of Bayesian parameter inference.

Keywords

Cite

@article{arxiv.2106.04886,
  title  = {Fully differentiable model discovery},
  author = {Gert-Jan Both and Remy Kusters},
  journal= {arXiv preprint arXiv:2106.04886},
  year   = {2021}
}
R2 v1 2026-06-24T02:59:36.562Z