English

DeepPySR -- A Symbolic Regression Framework with Dynamic Pruning, Pareto Selection, and Hierarchical Composition for Real-World Scientific Discovery

Machine Learning 2026-07-09 v1

Abstract

Symbolic regression (SR) discovers analytical equations from data, yielding glass-box models with directly interpretable formulas, unlike black-box methods that rely on unstable post-hoc tools such as SHAP or LIME. This transparency is crucial in clinical medicine and social science, but SR faces three challenges: high-dimensional inputs, principled selection of Pareto-front formulae, and data irregularities such as multicollinearity and class imbalance. We introduce DeepPySR, which addresses these issues with a dynamic variable-pruning schedule to remove irrelevant features during search, an exponential Pareto selection criterion that eliminates trade-offs between accuracy and complexity, and a multi-layer architecture for hierarchical symbolic composition. On four Feynman physics benchmarks and seven biomedical and social-science datasets, DeepPySR outperforms PySR and baselines on body fat (R2^2: 0.794 vs.\ 0.702), heart disease (F1: 0.898 vs.\ 0.787), student performance (R2^2: 0.964 vs.\ 0.948), and Raine BMI (R2^2: 0.525 vs.\ 0.370), producing interpretable formulas aligned with domain risk factors.

Keywords

Cite

@article{arxiv.2607.08150,
  title  = {DeepPySR -- A Symbolic Regression Framework with Dynamic Pruning, Pareto Selection, and Hierarchical Composition for Real-World Scientific Discovery},
  author = {Fuling Chen and Kevin Vinsen and Phillip Melton and Rae-Chi Huang},
  journal= {arXiv preprint arXiv:2607.08150},
  year   = {2026}
}