English
Related papers

Related papers: [RETRACTED]Evolving Form and Function: Dual-Object…

200 papers

Symbolic Regression (SR) algorithms attempt to learn analytic expressions which fit data accurately and in a highly interpretable manner. Conventional SR suffers from two fundamental issues which we address here. First, these methods search…

Cosmology and Nongalactic Astrophysics · Physics 2024-08-05 Deaglan J. Bartlett , Harry Desmond , Pedro G. Ferreira

Symbolic regression (SR) is a challenging task in machine learning that involves finding a mathematical expression for a function based on its values. Recent advancements in SR have demonstrated the effectiveness of pre-trained…

Machine Learning · Computer Science 2023-10-31 Parshin Shojaee , Kazem Meidani , Amir Barati Farimani , Chandan K. Reddy

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

Symbolic regression is a fundamental tool for discovering interpretable mathematical expressions from data, with broad applications across scientific and engineering domains. Recently, large language models (LLMs) have demonstrated strong…

Machine Learning · Computer Science 2025-06-06 Runxiang Wang , Boxiao Wang , Kai Li , Yifan Zhang , Jian Cheng

Symbolic regression (SR) with genetic programming (GP) aims to discover interpretable mathematical expressions directly from data. Despite its strong empirical success, the theoretical understanding of why GP-based SR generalizes beyond the…

Machine Learning · Computer Science 2026-04-21 Masahiro Nomura , Ryoki Hamano , Isao Ono

Symbolic Regression (SR) is a powerful technique for discovering interpretable mathematical expressions. However, benchmarking SR methods remains challenging due to the diversity of algorithms, datasets, and evaluation criteria. In this…

Symbolic Regression (SR) plays a central role in scientific knowledge discovery by distilling mathematical equations from observational data. Most existing SR methods function within a bi-level optimization framework: an outer loop that…

Machine Learning · Computer Science 2026-05-25 Boxiao Wang , Kai Li , Zhiwei Chen , Yang Huang , Runxiang Wang , Ziwen Zhang , Yifan Zhang , Jian Cheng

Evolutionary symbolic regression approaches are powerful tools that can approximate an explicit mapping between input features and observation for various problems. However, ensuring that explored expressions maintain consistency with…

Optimization and Control · Mathematics 2024-11-19 Maximilian Reissmann , Yuan Fang , Andrew Ooi , Richard Sandberg

Symbolic regression aims to derive interpretable symbolic expressions from data in order to better understand and interpret data. %which plays an important role in knowledge discovery and interpretable machine learning. In this study, a…

Machine Learning · Computer Science 2024-01-30 Min Wu , Weijun Li , Lina Yu , Wenqiang Li , Jingyi Liu , Yanjie Li , Meilan Hao

Symbolic Regression (SR) can generate interpretable, concise expressions that fit a given dataset, allowing for more human understanding of the structure than black-box approaches. The addition of background knowledge (in the form of…

Machine Learning · Computer Science 2023-05-05 Charles Fox , Neil Tran , Nikki Nacion , Samiha Sharlin , Tyler R. Josephson

Symbolic Regression searches for a function form that approximates a dataset often using Genetic Programming. Since there is usually no restriction to what form the function can have, Genetic Programming may return a hard to understand…

Neural and Evolutionary Computing · Computer Science 2022-05-16 Fabricio Olivetti de Franca

In symbolic regression, the search for analytic models is typically driven purely by the prediction error observed on the training data samples. However, when the data samples do not sufficiently cover the input space, the prediction error…

Machine Learning · Computer Science 2020-04-28 J. Kubalík , E. Derner , R. Babuška

Gradient descent typically converges to a single minimum of the training loss without mechanisms to explore alternative minima that may generalize better. Searching for diverse minima directly in high-dimensional parameter space is…

Machine Learning · Computer Science 2025-09-16 Akshay Vegesna , Samip Dahal

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extragradient), limiting SGD…

Machine Learning · Computer Science 2022-03-23 Amirkeivan Mohtashami , Martin Jaggi , Sebastian U. Stich

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Haichao Zhang , Kuangrong Hao , Lei Gao , Bing Wei , Xuesong Tang

Many real-world problems can be naturally described by mathematical formulas. The task of finding formulas from a set of observed inputs and outputs is called symbolic regression. Recently, neural networks have been applied to symbolic…

Machine Learning · Computer Science 2022-10-24 Martin Vastl , Jonáš Kulhánek , Jiří Kubalík , Erik Derner , Robert Babuška

Symbolic regression refers to the task of finding a closed-form mathematical expression to fit a set of data points. Genetic programming based techniques are the most common algorithms used to tackle this problem, but recently,…

Machine Learning · Computer Science 2025-10-10 Ryan T. Tymkow , Benjamin D. Schnapp , Mojtaba Valipour , Ali Ghodshi

Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require…

Neural and Evolutionary Computing · Computer Science 2022-12-05 Ying Bi , Bing Xue , Mengjie Zhang

In this paper, we present a machine learning method for the discovery of analytic solutions to differential equations. The method utilizes an inherently interpretable algorithm, genetic programming based symbolic regression. Unlike…

Machine Learning · Computer Science 2023-02-08 Hongsup Oh , Roman Amici , Geoffrey Bomarito , Shandian Zhe , Robert Kirby , Jacob Hochhalter

Symbolic regression is a type of discrete optimization problem that involves searching expressions that fit given data points. In many cases, other mathematical constraints about the unknown expression not only provide more information…

Machine Learning · Computer Science 2021-02-16 Li Li , Minjie Fan , Rishabh Singh , Patrick Riley