English
Related papers

Related papers: Deep Symbolic Regression for Recurrent Sequences

200 papers

Symbolic regression (SR) aims to discover closed-form mathematical expressions that accurately describe data, offering interpretability and analytical insight beyond standard black-box models. Existing SR methods often rely on…

Machine Learning · Computer Science 2025-06-17 Mansooreh Montazerin , Majd Al Aawar , Antonio Ortega , Ajitesh Srivastava

Symbolic Regression is the study of algorithms that automate the search for analytic expressions that fit data. While recent advances in deep learning have generated renewed interest in such approaches, the development of symbolic…

Instrumentation and Methods for Astrophysics · Physics 2023-12-27 Wassim Tenachi , Rodrigo Ibata , Foivos I. Diakogiannis

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna Narayanan , Mingyuan Zhou , Xiaoning Qian

In symbolic regression, the search for analytic models is typically driven purely by the prediction error observed on the training data samples. However, when the data samples do not sufficiently cover the input space, the prediction error…

Machine Learning · Computer Science 2020-04-28 J. Kubalík , E. Derner , R. Babuška

Inferring latent interaction structures from observed dynamics is a fundamental inverse problem in many-body interacting systems. Most neural approaches rely on black-box surrogates over trainable graphs, achieving accuracy at the expense…

Machine Learning · Computer Science 2026-04-15 Xiaoxiao Liang , Juyuan Zhang , Liming Pan , Linyuan Lü

Symbolic integration is a fundamental problem in mathematics: we consider how machine learning may be used to optimise this task in a Computer Algebra System (CAS). We train transformers that predict whether a particular integration method…

Machine Learning · Computer Science 2024-11-01 Rashid Barket , Uzma Shafiq , Matthew England , Juergen Gerhard

Symbolic regression corresponds to an ensemble of techniques that allow to uncover an analytical equation from data. Through a closed form formula, these techniques provide great advantages such as potential scientific discovery of new…

Machine Learning · Computer Science 2021-10-27 Ismail Alaoui Abdellaoui , Siamak Mehrkanoon

In social science, formal and quantitative models, such as ones describing economic growth and collective action, are used to formulate mechanistic explanations, provide predictions, and uncover questions about observed phenomena. Here, we…

Symbolic Computation · Computer Science 2023-08-17 Julia Balla , Sihao Huang , Owen Dugan , Rumen Dangovski , Marin Soljacic

There are many problems in physics, biology, and other natural sciences in which symbolic regression can provide valuable insights and discover new laws of nature. A widespread Deep Neural Networks do not provide interpretable solutions.…

Machine Learning · Computer Science 2023-01-18 Sergei Popov , Mikhail Lazarev , Vladislav Belavin , Denis Derkach , Andrey Ustyuzhanin

[RETRACTED]Data increasingly abounds, but distilling their underlying relationships down to something interpretable remains challenging. One approach is genetic programming, which `symbolically regresses' a data set down into an equation.…

Neural and Evolutionary Computing · Computer Science 2025-10-23 Amanda Bertschinger , James Bagrow , Joshua Bongard

Iterative refinement -- start with a random guess, then iteratively improve the guess -- is a useful paradigm for representation learning because it offers a way to break symmetries among equally plausible explanations for the data. This…

Machine Learning · Computer Science 2023-01-03 Michael Chang , Thomas L. Griffiths , Sergey Levine

Symbolic regression algorithms search a space of mathematical expressions for formulas that explain given data. Transformer-based models have emerged as a promising, scalable approach shifting the expensive combinatorial search to a…

Machine Learning · Computer Science 2025-09-25 Henrik Voigt , Paul Kahlmeyer , Kai Lawonn , Michael Habeck , Joachim Giesen

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main attraction of this approach is that it returns an interpretable model that can be insightful to users. Historically, the majority of…

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

Symbolic Regression (SR) holds great potential for uncovering underlying mathematical and physical relationships from observed data. However, the vast combinatorial space of possible expressions poses significant challenges for both online…

Machine Learning · Computer Science 2025-02-12 Yuan Tian , Wenqi Zhou , Michele Viscione , Hao Dong , David Kammer , Olga Fink

Symbolic Regression (SR) holds great potential for uncovering underlying mathematical and physical relationships from observed data. However, the vast combinatorial space of possible expressions poses significant challenges for both online…

Machine Learning · Computer Science 2025-02-14 Yuan Tian , Wenqi Zhou , Michele Viscione , Hao Dong , David Kammer , Olga Fink

Integration is indispensable, not only in mathematics, but also in a wide range of other fields. A deep learning method has recently been developed and shown to be capable of integrating mathematical functions that could not previously be…

Machine Learning · Computer Science 2022-05-10 Hazumi Kubota , Yuta Tokuoka , Takahiro G. Yamada , Akira Funahashi

Symbolic regression (SR) seeks closed-form mathematical expressions that fit observed data. Neural SR methods amortize the search by training an encoder to map observations directly to expressions in a single pass, but this amortized…

Machine Learning · Computer Science 2026-05-27 Xieting Chu , Sriram Vishwanath , Vijay Ganesh

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent…

Machine Learning · Computer Science 2020-11-19 Miles Cranmer , Alvaro Sanchez-Gonzalez , Peter Battaglia , Rui Xu , Kyle Cranmer , David Spergel , Shirley Ho

We explore the use of symbolic regression to derive compact analytical expressions for angular observables relevant to electroweak boson production at the Large Hadron Collider (LHC). Focusing on the angular coefficients that govern the…

High Energy Physics - Phenomenology · Physics 2025-12-05 Josh Bendavid , Daniel Conde , Manuel Morales-Alvarado , Veronica Sanz , Maria Ubiali