English
Related papers

Related papers: VaSST: Variational Inference for Symbolic Regressi…

200 papers

Symbolic regression (SR) is a powerful technique for discovering symbolic expressions that characterize nonlinear relationships in data, gaining increasing attention for its interpretability, compactness, and robustness. However, existing…

Machine Learning · Statistics 2025-06-09 Shengbin Ye , Meng Li

Modeling real-world systems requires accounting for noise - whether it arises from unpredictable fluctuations in financial markets, irregular rhythms in biological systems, or environmental variability in ecosystems. While the behavior of…

Machine Learning · Computer Science 2026-04-08 Matteo Bosso , Giovanni Franzese , Kushal Swamy , Maarten Theulings , Alejandro M. Aragón , Farbod Alijani

Tree-based methods are powerful nonparametric techniques in statistics and machine learning. However, their effectiveness, particularly in finite-sample settings, is not fully understood. Recent applications have revealed their surprising…

Statistics Theory · Mathematics 2024-10-04 Hengrui Luo , Meng Li

We introduce SymbolFit, a framework that automates parametric modeling by using symbolic regression to perform a machine-search for functions that fit the data while simultaneously providing uncertainty estimates in a single run.…

High Energy Physics - Experiment · Physics 2025-07-04 Ho Fung Tsoi , Dylan Rankin , Cecile Caillol , Miles Cranmer , Sridhara Dasu , Javier Duarte , Philip Harris , Elliot Lipeles , Vladimir Loncar

Symbolic regression plays a crucial role in modern scientific research thanks to its capability of discovering concise and interpretable mathematical expressions from data. A key challenge lies in the search for parsimonious and…

Machine Learning · Computer Science 2025-09-12 Kai Ruan , Yilong Xu , Ze-Feng Gao , Yike Guo , Hao Sun , Ji-Rong Wen , Yang Liu

As power systems evolve with the increasing integration of renewable energy sources and smart grid technologies, there is a growing demand for flexible and scalable modeling approaches capable of capturing the complex dynamics of modern…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Amir Bahador Javadi , Philip Pong

We propose a novel symbolic modeling framework for decision-making under risk that merges interpretability with the core insights of Prospect Theory. Our approach replaces opaque utility curves and probability weighting functions with…

Artificial Intelligence · Computer Science 2025-04-22 Ali Arslan Yousaf , Umair Rehman , Muhammad Umair Danish

Big Data often presents as massive non-probability samples. Not only is the selection mechanism often unknown, but larger data volume amplifies the relative contribution of selection bias to total error. Existing bias adjustment approaches…

Methodology · Statistics 2022-03-29 Ali Rafei , Carol A. C. Flannagan , Brady T. West , Michael R. Elliott

We demonstrate the efficacy of symbolic regression (SR) to probe models of particle physics Beyond the Standard Model (BSM), by considering the so-called Constrained Minimal Supersymmetric Standard Model (CMSSM). Like many incarnations of…

High Energy Physics - Phenomenology · Physics 2025-10-24 Shehu AbdusSalam , Steven Abel , Deaglan Bartlett , Miguel Crispim Romão

Finding a concise and interpretable mathematical formula that accurately describes the relationship between each variable and the predicted value in the data is a crucial task in scientific research, as well as a significant challenge in…

Machine Learning · Computer Science 2024-01-31 Yanjie Li , Weijun Li , Lina Yu , Min Wu , Jingyi Liu , Wenqiang Li , Meilan Hao , Shu Wei , Yusong Deng

Probability estimation of tree topologies is one of the fundamental tasks in phylogenetic inference. The recently proposed subsplit Bayesian networks (SBNs) provide a powerful probabilistic graphical model for tree topology probability…

Populations and Evolution · Quantitative Biology 2024-09-10 Tianyu Xie , Musu Yuan , Minghua Deng , Cheng Zhang

We introduce a composition-weighted symbolic regression framework for interpretable prediction of materials properties directly from chemical composition. The method jointly learns analytical functional forms and task-dependent elemental…

Materials Science · Physics 2026-05-05 Yang Huang , Jingrun Chen

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

This work develops formal statistical inference procedures for machine learning ensemble methods. Ensemble methods based on bootstrapping, such as bagging and random forests, have improved the predictive accuracy of individual trees, but…

Machine Learning · Statistics 2015-09-11 Lucas Mentch , Giles Hooker

Variable selection is an important statistical problem. This problem becomes more challenging when the candidate predictors are of mixed type (e.g. continuous and binary) and impact the response variable in nonlinear and/or non-additive…

Methodology · Statistics 2021-12-30 Chuji Luo , Michael J. Daniels

Five simple soft sensor methodologies with two update conditions were compared on two experimentally-obtained datasets and one simulated dataset. The soft sensors investigated were moving window partial least squares regression (and a…

Machine Learning · Statistics 2019-08-13 Casey Kneale , Steven D. Brown

Decision Trees have remained a popular machine learning method for tabular datasets, mainly due to their interpretability. However, they lack the expressiveness needed to handle highly nonlinear or unstructured datasets. Motivated by recent…

Machine Learning · Computer Science 2024-10-30 Dimitris Bertsimas , Lisa Everest , Jiayi Gu , Matthew Peroni , Vasiliki Stoumpou

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

Machine Learning · Statistics 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Govind Gandhi