English
Related papers

Related papers: Symbolic Regression with a Learned Concept Library

200 papers

Learned Sparse Retrieval (LSR) is a group of neural methods designed to encode queries and documents into sparse lexical vectors. These vectors can be efficiently indexed and retrieved using an inverted index. While LSR has shown promise in…

Information Retrieval · Computer Science 2024-02-13 Thong Nguyen , Mariya Hendriksen , Andrew Yates

Learned sparse retrieval (LSR) is a family of neural methods that encode queries and documents into sparse lexical vectors that can be indexed and retrieved efficiently with an inverted index. We explore the application of LSR to the…

Information Retrieval · Computer Science 2024-02-28 Thong Nguyen , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

Automating scientific discovery has been a grand goal of Artificial Intelligence (AI) and will bring tremendous societal impact. Learning symbolic expressions from experimental data is a vital step in AI-driven scientific discovery. Despite…

Artificial Intelligence · Computer Science 2023-12-20 Nan Jiang , Md Nasim , Yexiang Xue

We present Label Space Reduction (LSR), a novel method for improving zero-shot classification performance of Large Language Models (LLMs). LSR iteratively refines the classification label space by systematically ranking and reducing…

Computation and Language · Computer Science 2025-11-06 Nathan Vandemoortele , Bram Steenwinckel , Femke Ongenae , Sofie Van Hoecke

Symbolic regression (SR) is a powerful technique for discovering the underlying mathematical expressions from observed data. Inspired by the success of deep learning, recent deep generative SR methods have shown promising results. However,…

Machine Learning · Computer Science 2024-06-04 Wenqiang Li , Weijun Li , Lina Yu , Min Wu , Linjun Sun , Jingyi Liu , Yanjie Li , Shu Wei , Yusong Deng , Meilan Hao

Large language models (LLMs) continue to face challenges in reliably solving reasoning tasks, particularly those that require precise rule following, as often found in mathematical reasoning. This paper introduces a novel neurosymbolic…

Machine Learning · Computer Science 2025-11-19 Varun Dhanraj , Chris Eliasmith

Symbolic regression is the process of identifying mathematical expressions that fit observed output from a black-box process. It is a discrete optimization problem generally believed to be NP-hard. Prior approaches to solving the problem…

Neural and Evolutionary Computing · Computer Science 2021-11-19 T. Nathan Mundhenk , Mikel Landajuela , Ruben Glatt , Claudio P. Santiago , Daniel M. Faissol , Brenden K. Petersen

This paper presents QDSR, an advanced symbolic Regression (SR) system that integrates genetic programming (GP), a quality-diversity (QD) algorithm, and a dimensional analysis (DA) engine. Our method focuses on exact symbolic recovery of…

Neural and Evolutionary Computing · Computer Science 2025-03-26 J. -P. Bruneton

This paper describes a new method for Symbolic Regression that allows to find mathematical expressions from a dataset. This method has a strong mathematical basis. As opposed to other methods such as Genetic Programming, this method is…

Machine Learning · Computer Science 2022-03-22 Daniel Rivero , Enrique Fernandez-Blanco

We propose a novel deep symbolic regression approach to enhance the robustness and interpretability of data-driven mathematical expression discovery. Our work is aligned with the popular DSR framework which focuses on learning a…

Machine Learning · Computer Science 2026-03-30 Zachary Bastiani , Robert M. Kirby , Jacob Hochhalter , Shandian Zhe

Large Language Models (LLM) exhibit zero-shot mathematical reasoning capacity as a behavior emergent with scale, commonly manifesting as chain-of-thoughts (CoT) reasoning. However, multiple empirical findings suggest that this prowess is…

Artificial Intelligence · Computer Science 2023-12-20 Subhabrata Dutta , Joykirat Singh , Ishan Pandey , Sunny Manchanda , Soumen Chakrabarti , Tanmoy Chakraborty

Despite their linguistic competence, Large Language Models (LLMs) often struggle to reason reliably and flexibly. To identify these shortcomings, we introduce the Non-Linear Reasoning (NLR) dataset, a collection of 55 unique, hand-designed…

Computation and Language · Computer Science 2025-12-02 Nasim Borazjanizadeh , Steven T. Piantadosi

We present a novel approach to symbolic regression using vision-capable large language models (LLMs) and the ideas behind Google DeepMind's Funsearch. The LLM is given a plot of a univariate function and tasked with proposing an ansatz for…

Machine Learning · Computer Science 2025-05-20 Thomas R. Harvey , Fabian Ruehle , Kit Fraser-Taliente , James Halverson

Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modifications of equations rarely align with their numerical behavior,…

Machine Learning · Computer Science 2026-02-25 Qian Li , Yuxiao Hu , Juncheng Liu , Yuntian Chen

Symbolic equations are at the core of scientific discovery. The task of discovering the underlying equation from a set of input-output pairs is called symbolic regression. Traditionally, symbolic regression methods use hand-designed…

Machine Learning · Computer Science 2021-06-14 Luca Biggio , Tommaso Bendinelli , Alexander Neitz , Aurelien Lucchi , Giambattista Parascandolo

Symbolic regression (SR) has emerged as a pivotal technique for uncovering the intrinsic information within data and enhancing the interpretability of AI models. However, current state-of-the-art (sota) SR methods struggle to perform…

Machine Learning · Computer Science 2025-01-03 Chenglu Sun , Shuo Shen , Wenzhi Tao , Deyi Xue , Zixia Zhou

Classical models for supervised machine learning, such as decision trees, are efficient and interpretable predictors, but their quality is highly dependent on the particular choice of input features. Although neural networks can learn…

Machine Learning · Computer Science 2025-10-17 Gabriel Poesia , Georgia Gabriela Sampaio

Genetic Programming (GP) has traditionally entangled the evolution of symbolic representations with their performance-based evaluation, often relying solely on raw fitness scores. This tight coupling makes GP solutions more fragile and…

Neural and Evolutionary Computing · Computer Science 2025-06-09 Nam H. Le , Josh Bongard

Symbolic regression (SR) is an emerging branch of machine learning focused on discovering simple and interpretable mathematical expressions from data. Although a wide-variety of SR methods have been developed, they often face challenges…

Machine Learning · Computer Science 2025-02-06 Madhav R. Muthyala , Farshud Sorourifar , You Peng , Joel A. Paulson

This paper revisits datasets and evaluation criteria for Symbolic Regression (SR), specifically focused on its potential for scientific discovery. Focused on a set of formulas used in the existing datasets based on Feynman Lectures on…

Machine Learning · Computer Science 2025-01-06 Yoshitomo Matsubara , Naoya Chiba , Ryo Igarashi , Yoshitaka Ushiku