English
Related papers

Related papers: Exhaustive Symbolic Regression

200 papers

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

We analyse the search behaviour of genetic programming for symbolic regression in practically relevant but limited settings, allowing exhaustive enumeration of all solutions. This enables us to quantify the success probability of finding…

Neural and Evolutionary Computing · Computer Science 2026-03-30 Gabriel Kronberger , Fabricio Olivetti de Franca , Harry Desmond , Deaglan J. Bartlett , Lukas Kammerer

In Symbolic Regression (SR), Genetic Programming (GP) is a popular search algorithm that delivers state-of-the-art results in term of accuracy. Its success relies on the concept of neutrality, which induces large plateaus that the search…

Machine Learning · Computer Science 2025-11-04 Fabricio Olivetti de Franca , Gabriel Kronberger

Symbolic regression is a type of discrete optimization problem that involves searching expressions that fit given data points. In many cases, other mathematical constraints about the unknown expression not only provide more information…

Machine Learning · Computer Science 2021-02-16 Li Li , Minjie Fan , Rishabh Singh , Patrick Riley

Symbolic regression (SR) is a powerful technique for discovering the underlying mathematical expressions from observed data. Inspired by the success of deep learning, recent deep generative SR methods have shown promising results. However,…

Machine Learning · Computer Science 2024-06-04 Wenqiang Li , Weijun Li , Lina Yu , Min Wu , Linjun Sun , Jingyi Liu , Yanjie Li , Shu Wei , Yusong Deng , Meilan Hao

This paper presents QDSR, an advanced symbolic Regression (SR) system that integrates genetic programming (GP), a quality-diversity (QD) algorithm, and a dimensional analysis (DA) engine. Our method focuses on exact symbolic recovery of…

Neural and Evolutionary Computing · Computer Science 2025-03-26 J. -P. Bruneton

The high-energy physics community is investigating the potential of deploying machine-learning-based solutions on Field-Programmable Gate Arrays (FPGAs) to enhance physics sensitivity while still meeting data processing time constraints. In…

We investigate the addition of constraints on the function image and its derivatives for the incorporation of prior knowledge in symbolic regression. The approach is called shape-constrained symbolic regression and allows us to enforce e.g.…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Gabriel Kronberger , Fabricio Olivetti de França , Bogdan Burlacu , Christian Haider , Michael Kommenda

Deep convolutional neural networks achieve remarkable performance by exhaustively processing dense spatial feature maps, yet this brute-force strategy introduces significant computational redundancy and encourages reliance on spurious…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tom Devynck , Bilal Faye , Djamel Bouchaffra , Nadjib Lazaar , Hanane Azzag , Mustapha Lebbah

We introduce an Invertible Symbolic Regression (ISR) method. It is a machine learning technique that generates analytical relationships between inputs and outputs of a given dataset via invertible maps (or architectures). The proposed ISR…

Machine Learning · Computer Science 2024-05-14 Tony Tohme , Mohammad Javad Khojasteh , Mohsen Sadr , Florian Meyer , Kamal Youcef-Toumi

Symbolic Regression (SR) is a powerful technique for automatically discovering mathematical expressions from input data. Mainstream SR algorithms search for the optimal symbolic tree in a vast function space, but the increasing complexity…

Machine Learning · Computer Science 2026-02-03 Xinxin Li , Juan Zhang , Da Li , Xingyu Liu , Jin Xu , Junping Yin

Symbolic regression is the process of identifying mathematical expressions that fit observed output from a black-box process. It is a discrete optimization problem generally believed to be NP-hard. Prior approaches to solving the problem…

Neural and Evolutionary Computing · Computer Science 2021-11-19 T. Nathan Mundhenk , Mikel Landajuela , Ruben Glatt , Claudio P. Santiago , Daniel M. Faissol , Brenden K. Petersen

The process of discovering equations from data lies at the heart of physics and in many other areas of research, including mathematical ecology and epidemiology. Recently, machine learning methods known as symbolic regression emerged as a…

Machine Learning · Computer Science 2026-01-21 Beatriz R. Brum , Luiza Lober , Isolde Previdelli , Francisco A. Rodrigues

We investigate the use of machine learning for solving analytic problems in theoretical physics. In particular, symbolic regression (SR) is making rapid progress in recent years as a tool to fit data using functions whose overall form is…

Computational Physics · Physics 2024-03-21 Sahel Ashhab

Fast Function Extraction (FFX) is a deterministic algorithm for solving symbolic regression problems. We improve the accuracy of FFX by adding parameters to the arguments of nonlinear functions. Instead of only optimizing linear parameters,…

Machine Learning · Computer Science 2023-03-10 Lukas Kammerer , Gabriel Kronberger , Michael Kommenda

Symbolic regression corresponds to an ensemble of techniques that allow to uncover an analytical equation from data. Through a closed form formula, these techniques provide great advantages such as potential scientific discovery of new…

Machine Learning · Computer Science 2021-10-27 Ismail Alaoui Abdellaoui , Siamak Mehrkanoon

In the realm of machine and deep learning regression tasks, the role of effective feature engineering (FE) is pivotal in enhancing model performance. Traditional approaches of FE often rely on domain expertise to manually design features…

Machine Learning · Computer Science 2024-06-18 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

Solutions of symbolic regression problems are expressions that are composed of input variables and operators from a finite set of function symbols. One measure for evaluating symbolic regression algorithms is their ability to recover…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Markus Fischer , Joachim Giesen

Symbolic regression (SR) aims to discover closed-form mathematical expressions that accurately describe data, offering interpretability and analytical insight beyond standard black-box models. Existing SR methods often rely on…

Machine Learning · Computer Science 2025-06-17 Mansooreh Montazerin , Majd Al Aawar , Antonio Ortega , Ajitesh Srivastava

Evolutionary symbolic regression approaches are powerful tools that can approximate an explicit mapping between input features and observation for various problems. However, ensuring that explored expressions maintain consistency with…

Optimization and Control · Mathematics 2024-11-19 Maximilian Reissmann , Yuan Fang , Andrew Ooi , Richard Sandberg