English
Related papers

Related papers: When Good Equations Get Bad Scores: Improving Symb…

200 papers

Symbolic regression (SR) is the process of discovering hidden relationships from data with mathematical expressions, which is considered an effective way to reach interpretable machine learning (ML). Genetic programming (GP) has been the…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Peng Zeng , Xiaotian Song , Andrew Lensen , Yuwei Ou , Yanan Sun , Mengjie Zhang , Jiancheng Lv

In this paper we introduce the SCoRe (Submodular Combinatorial Representation Learning) framework, a novel approach in representation learning that addresses inter-class bias and intra-class variance. SCoRe provides a new combinatorial…

Machine Learning · Computer Science 2024-06-07 Anay Majee , Suraj Kothawade , Krishnateja Killamsetty , Rishabh Iyer

Symbolic regression (SR) is an emerging branch of machine learning focused on discovering simple and interpretable mathematical expressions from data. Although a wide-variety of SR methods have been developed, they often face challenges…

Machine Learning · Computer Science 2025-02-06 Madhav R. Muthyala , Farshud Sorourifar , You Peng , Joel A. Paulson

Symbolic regression plays a crucial role in modern scientific research thanks to its capability of discovering concise and interpretable mathematical expressions from data. A key challenge lies in the search for parsimonious and…

Machine Learning · Computer Science 2025-09-12 Kai Ruan , Yilong Xu , Ze-Feng Gao , Yike Guo , Hao Sun , Ji-Rong Wen , Yang Liu

In symbolic regression, the search for analytic models is typically driven purely by the prediction error observed on the training data samples. However, when the data samples do not sufficiently cover the input space, the prediction error…

Machine Learning · Computer Science 2020-04-28 J. Kubalík , E. Derner , R. Babuška

Recent neural network-driven semantic role labeling (SRL) systems have shown impressive improvements in F1 scores. These improvements are due to expressive input representations, which, at least at the surface, are orthogonal to…

Computation and Language · Computer Science 2020-05-06 Tao Li , Parth Anand Jawale , Martha Palmer , Vivek Srikumar

Symbolic regression aims to find interpretable analytical expressions by searching over mathematical formula spaces to capture underlying system behavior, particularly in scientific modeling governed by physical laws. However, traditional…

Machine Learning · Computer Science 2025-10-09 Yunpeng Gong , Sihan Lan , Can Yang , Kunpeng Xu , Min Jiang

Symbolic Regression (SR) is a widely studied field of research that aims to infer symbolic expressions from data. A popular approach for SR is the Sparse Identification of Nonlinear Dynamical Systems (SINDy) framework, which uses sparse…

We present a novel method for symbolic regression (SR), the task of searching for compact programmatic hypotheses that best explain a dataset. The problem is commonly solved using genetic algorithms; we show that we can enhance such methods…

Machine Learning · Computer Science 2024-12-11 Arya Grayeli , Atharva Sehgal , Omar Costilla-Reyes , Miles Cranmer , Swarat Chaudhuri

This paper revisits datasets and evaluation criteria for Symbolic Regression (SR), specifically focused on its potential for scientific discovery. Focused on a set of formulas used in the existing datasets based on Feynman Lectures on…

Machine Learning · Computer Science 2025-01-06 Yoshitomo Matsubara , Naoya Chiba , Ryo Igarashi , Yoshitaka Ushiku

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in particular whenever…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Christian Haider , Fabricio Olivetti de França , Bogdan Burlacu , Gabriel Kronberger

Symbolic regression is a fundamental tool for discovering interpretable mathematical expressions from data, with broad applications across scientific and engineering domains. Recently, large language models (LLMs) have demonstrated strong…

Machine Learning · Computer Science 2025-06-06 Runxiang Wang , Boxiao Wang , Kai Li , Yifan Zhang , Jian Cheng

In symbolic regression, the goal is to find an analytical expression that accurately fits experimental data with the minimal use of mathematical symbols such as operators, variables, and constants. However, the combinatorial space of…

Machine Learning · Computer Science 2023-04-21 Tommaso Bendinelli , Luca Biggio , Pierre-Alexandre Kamienny

Symbolic regression (SR) has emerged as a pivotal technique for uncovering the intrinsic information within data and enhancing the interpretability of AI models. However, current state-of-the-art (sota) SR methods struggle to perform…

Machine Learning · Computer Science 2025-01-03 Chenglu Sun , Shuo Shen , Wenzhi Tao , Deyi Xue , Zixia Zhou

Medical decision-making makes frequent use of algorithms that combine risk equations with rules, providing clear and standardized treatment pathways. Symbolic regression (SR) traditionally limits its search space to continuous function…

How can neural networks perform so well on compositional tasks even though they lack explicit compositional representations? We use a novel analysis technique called ROLE to show that recurrent neural networks perform well on such tasks by…

Machine Learning · Computer Science 2023-02-10 Paul Soulos , Tom McCoy , Tal Linzen , Paul Smolensky

The high-energy physics community is investigating the potential of deploying machine-learning-based solutions on Field-Programmable Gate Arrays (FPGAs) to enhance physics sensitivity while still meeting data processing time constraints. In…

This article introduces a new symbolic regression algorithm based on the SPINEX (Similarity-based Predictions with Explainable Neighbors Exploration) family. This new algorithm (SPINEX_SymbolicRegression) adopts a similarity-based approach…

Machine Learning · Computer Science 2024-11-07 MZ Naser , Ahmed Z Naser

Model-based reinforcement learning algorithms are typically more sample efficient than their model-free counterparts, especially in sparse reward problems. Unfortunately, many interesting domains are too complex to specify the complete…

Machine Learning · Computer Science 2022-03-11 Andrew Chester , Michael Dann , Fabio Zambetta , John Thangarajah