English
Related papers

Related papers: Exploring Hidden Semantics in Neural Networks with…

200 papers

We develop a symbolic regression framework for extracting the governing mathematical expressions from observed data. The evolutionary approach, faiGP, is designed to leverage the properties of a function algebra that have been encoded into…

Neural and Evolutionary Computing · Computer Science 2022-03-18 Shahab Razavi , Eric R. Gamazon

Symbolic regression is a machine learning method with the goal to produce interpretable results. Unlike other machine learning methods such as, e.g. random forests or neural networks, which are opaque, symbolic regression aims to model and…

Machine Learning · Computer Science 2024-06-07 Yousef A. Radwan , Gabriel Kronberger , Stephan Winkler

Symbolic regression is emerging as a promising machine learning method for learning succinct underlying interpretable mathematical expressions directly from data. Whereas it has been traditionally tackled with genetic programming, it has…

Machine Learning · Computer Science 2025-01-14 Nour Makke , Sanjay Chawla

We develop a general approach to distill symbolic representations of a learned deep model by introducing strong inductive biases. We focus on Graph Neural Networks (GNNs). The technique works as follows: we first encourage sparse latent…

Machine Learning · Computer Science 2020-11-19 Miles Cranmer , Alvaro Sanchez-Gonzalez , Peter Battaglia , Rui Xu , Kyle Cranmer , David Spergel , Shirley Ho

Symbolic regression is a type of discrete optimization problem that involves searching expressions that fit given data points. In many cases, other mathematical constraints about the unknown expression not only provide more information…

Machine Learning · Computer Science 2021-02-16 Li Li , Minjie Fan , Rishabh Singh , Patrick Riley

To handle AI tasks that combine perception and logical reasoning, recent work introduces Neurosymbolic Deep Neural Networks (NS-DNNs), which contain -- in addition to traditional neural layers -- symbolic layers: symbolic expressions (e.g.,…

Machine Learning · Computer Science 2024-02-07 Aaron Bembenek , Toby Murray

Subgraph-enhanced graph neural networks (SGNN) can increase the expressive power of the standard message-passing framework. This model family represents each graph as a collection of subgraphs, generally extracted by random sampling or with…

Machine Learning · Computer Science 2023-04-17 Indro Spinelli , Michele Guerra , Filippo Maria Bianchi , Simone Scardapane

Symbolic regression (SR) is a powerful technique for discovering the analytical mathematical expression from data, finding various applications in natural sciences due to its good interpretability of results. However, existing methods face…

Machine Learning · Computer Science 2024-07-11 Xieting Chu , Hongjue Zhao , Enze Xu , Hairong Qi , Minghan Chen , Huajie Shao

In symbolic regression, the goal is to find an analytical expression that accurately fits experimental data with the minimal use of mathematical symbols such as operators, variables, and constants. However, the combinatorial space of…

Machine Learning · Computer Science 2023-04-21 Tommaso Bendinelli , Luca Biggio , Pierre-Alexandre Kamienny

When neural networks are used to solve differential equations, they usually produce solutions in the form of black-box functions that are not directly mathematically interpretable. We introduce a method for generating symbolic expressions…

Machine Learning · Computer Science 2020-11-05 Maysum Panju , Ali Ghodsi

Many real-world systems can be described by mathematical models that are human-comprehensible, easy to analyze and help explain the system's behavior. Symbolic regression is a method that can automatically generate such models from data.…

Neural and Evolutionary Computing · Computer Science 2023-06-28 Jiří Kubalík , Erik Derner , Robert Babuška

Symbolic regression (SR) is an area of interpretable machine learning that aims to identify mathematical expressions, often composed of simple functions, that best fit in a given set of covariates $X$ and response $y$. In recent years, deep…

Machine Learning · Computer Science 2023-12-04 Sida Li , Ioana Marinescu , Sebastian Musslick

Symbolic regression is a task aimed at identifying patterns in data and representing them through mathematical expressions, generally involving skeleton prediction and constant optimization. Many methods have achieved some success, however…

Machine Learning · Computer Science 2024-08-16 Yusong Deng , Min Wu , Lina Yu , Jingyi Liu , Shu Wei , Yanjie Li , Weijun Li

Symbolic regression (SR) is the process of discovering hidden relationships from data with mathematical expressions, which is considered an effective way to reach interpretable machine learning (ML). Genetic programming (GP) has been the…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Peng Zeng , Xiaotian Song , Andrew Lensen , Yuwei Ou , Yanan Sun , Mengjie Zhang , Jiancheng Lv

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Govind Gandhi

We challenge black-box purely deep neural approaches for molecules and graph generation, which are limited in controllability and lack formal guarantees. We introduce Neuro-Symbolic Graph Generative Modeling (NSGGM), a neurosymbolic…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Mark Zhang , Haolin Ye , Ziyu Zhao , Xujie Si

Symbolic regression is essential for deriving interpretable expressions that elucidate complex phenomena by exposing the underlying mathematical and physical relationships in data. In this paper, we present an advanced symbolic regression…

Machine Learning · Computer Science 2025-03-13 Sikai Huang , Yixin Berry Wen , Tara Adusumilli , Kusum Choudhary , Haizhao Yang

We present a novel method for symbolic regression (SR), the task of searching for compact programmatic hypotheses that best explain a dataset. The problem is commonly solved using genetic algorithms; we show that we can enhance such methods…

Machine Learning · Computer Science 2024-12-11 Arya Grayeli , Atharva Sehgal , Omar Costilla-Reyes , Miles Cranmer , Swarat Chaudhuri

Symbolic regression (SR) models complex systems by discovering mathematical expressions that capture underlying relationships in observed data. However, most SR methods prioritize minimizing prediction error over identifying the governing…

Machine Learning · Computer Science 2026-03-31 Giorgio Morales , John W. Sheppard

The Symbolic Regression (SR) problem, where the goal is to find a regression function that does not have a pre-specified form but is any function that can be composed of a list of operators, is a hard problem in machine learning, both…

Machine Learning · Computer Science 2020-06-15 Vernon Austel , Cristina Cornelio , Sanjeeb Dash , Joao Goncalves , Lior Horesh , Tyler Josephson , Nimrod Megiddo