English
Related papers

Related papers: End-to-end symbolic regression with transformers

200 papers

Compact symbolic expressions have been shown to be more efficient than neural network models in terms of resource consumption and inference speed when implemented on custom hardware such as FPGAs, while maintaining comparable…

Machine Learning · Computer Science 2025-02-11 Ho Fung Tsoi , Vladimir Loncar , Sridhara Dasu , Philip Harris

Reinforcement learning algorithms can solve dynamic decision-making and optimal control problems. With continuous-valued state and input variables, reinforcement learning algorithms must rely on function approximators to represent the value…

Machine Learning · Computer Science 2021-11-16 Jiří Kubalík , Erik Derner , Jan Žegklitz , Robert Babuška

Interpretability is crucial for machine learning in many scenarios such as quantitative finance, banking, healthcare, etc. Symbolic regression (SR) is a classic interpretable machine learning method by bridging X and Y using mathematical…

Methodology · Statistics 2020-01-17 Ying Jin , Weilin Fu , Jian Kang , Jiadong Guo , Jian Guo

Symbolic regression (SR) models complex systems by discovering mathematical expressions that capture underlying relationships in observed data. However, most SR methods prioritize minimizing prediction error over identifying the governing…

Machine Learning · Computer Science 2026-03-31 Giorgio Morales , John W. Sheppard

Symbolic regression (SR) is a powerful technique for discovering the analytical mathematical expression from data, finding various applications in natural sciences due to its good interpretability of results. However, existing methods face…

Machine Learning · Computer Science 2024-07-11 Xieting Chu , Hongjue Zhao , Enze Xu , Hairong Qi , Minghan Chen , Huajie Shao

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Govind Gandhi

Conventional neural network elastoplasticity models are often perceived as lacking interpretability. This paper introduces a two-step machine learning approach that returns mathematical models interpretable by human experts. In particular,…

Computational Engineering, Finance, and Science · Computer Science 2024-02-09 Bahador Bahmani , Hyoung Suk Suh , WaiChing Sun

Symbolic regression algorithms search a space of mathematical expressions for formulas that explain given data. Transformer-based models have emerged as a promising, scalable approach shifting the expensive combinatorial search to a…

Machine Learning · Computer Science 2025-09-25 Henrik Voigt , Paul Kahlmeyer , Kai Lawonn , Michael Habeck , Joachim Giesen

We study the modeling and prediction of dynamical systems based on conventional models derived from measurements. Such algorithms are highly desirable in situations where the underlying dynamics are hard to model from physical principles or…

Data Analysis, Statistics and Probability · Physics 2016-08-03 Markus Quade , Markus Abel , Kamran Shafi , Robert K. Niven , Bernd R. Noack

Automated scientific discovery aims to improve scientific understanding through machine learning. A central approach in this field is symbolic regression, which uses genetic programming or sparse regression to learn interpretable…

Neural and Evolutionary Computing · Computer Science 2026-03-11 Sigur de Vries , Sander W. Keemink , Marcel A. J. van Gerven

Symbolic regression is a task aimed at identifying patterns in data and representing them through mathematical expressions, generally involving skeleton prediction and constant optimization. Many methods have achieved some success, however…

Machine Learning · Computer Science 2024-08-16 Yusong Deng , Min Wu , Lina Yu , Jingyi Liu , Shu Wei , Yanjie Li , Weijun Li

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

Gene expression programming is an evolutionary optimization algorithm with the potential to generate interpretable and easily implementable equations for regression problems. Despite knowledge gained from previous optimizations being…

Neural and Evolutionary Computing · Computer Science 2025-02-05 Maximilian Reissmann , Yuan Fang , Andrew S. H. Ooi , Richard D. Sandberg

Neural networks have in recent years shown promise for helping software engineers write programs and even formally verify them. While semantic information plays a crucial part in these processes, it remains unclear to what degree popular…

Machine Learning · Computer Science 2023-06-27 Shizhuo Dylan Zhang , Curt Tigges , Stella Biderman , Maxim Raginsky , Talia Ringer

Symbolic regression (SR) seeks closed-form mathematical expressions that fit observed data. Neural SR methods amortize the search by training an encoder to map observations directly to expressions in a single pass, but this amortized…

Machine Learning · Computer Science 2026-05-27 Xieting Chu , Sriram Vishwanath , Vijay Ganesh

Mathematical expressions were generated, evaluated and used to train neural network models based on the transformer architecture. The expressions and their targets were analyzed as a character-level sequence transduction task in which the…

Computation and Language · Computer Science 2019-09-17 Artit Wangperawong

Solutions of symbolic regression problems are expressions that are composed of input variables and operators from a finite set of function symbols. One measure for evaluating symbolic regression algorithms is their ability to recover…

Machine Learning · Computer Science 2025-06-25 Paul Kahlmeyer , Markus Fischer , Joachim Giesen

In science, we are interested not only in forecasting but also in understanding how predictions are made, specifically what the interpretable underlying model looks like. Data-driven machine learning technology can significantly streamline…

Symbolic Computation · Computer Science 2025-05-29 Weiting Liu , Jiaxu Cui , Jiao Hu , En Wang , Bo Yang

We introduce a data-driven framework to automatically identify interpretable and physically meaningful hyperelastic constitutive models from sparse data. Leveraging symbolic regression, an algorithm based on genetic programming, our…

Symbolic Computation · Computer Science 2025-01-14 Jixin Hou , Xianyan Chen , Taotao Wu , Ellen Kuhl , Xianqiao Wang