English
Related papers

Related papers: Correlation versus RMSE Loss Functions in Symbolic…

200 papers

Identifying the mathematical relationships that best describe a dataset remains a very challenging problem in machine learning, and is known as Symbolic Regression (SR). In contrast to neural networks which are often treated as black boxes,…

Machine Learning · Computer Science 2023-01-10 Tony Tohme , Dehong Liu , Kamal Youcef-Toumi

In some situations, the interpretability of the machine learning models plays a role as important as the model accuracy. Interpretability comes from the need to trust the prediction model, verify some of its properties, or even enforce them…

Machine Learning · Computer Science 2024-04-10 Guilherme Seidyo Imai Aldeia , Fabricio Olivetti de Franca

As one of the most powerful tools for examining the association between functional covariates and a response, the functional regression model has been widely adopted in various interdisciplinary studies. Usually, a limited number of…

Methodology · Statistics 2025-01-07 Hanteng Ma , Ziliang Shen , Xingdong Feng , Xin Liu

Reward models (RMs) play a crucial role in reinforcement learning from human feedback (RLHF), aligning model behavior with human preferences. However, existing benchmarks for reward models show a weak correlation with the performance of…

Machine Learning · Computer Science 2025-05-20 Sunghwan Kim , Dongjin Kang , Taeyoon Kwon , Hyungjoo Chae , Dongha Lee , Jinyoung Yeo

Functional linear regression analysis aims to model regression relations which include a functional predictor. The analog of the regression parameter vector or matrix in conventional multivariate or multiple-response linear regression…

Statistics Theory · Mathematics 2011-02-28 Yichao Wu , Jianqing Fan , Hans-Georg Müller

Resting-state functional magnetic resonance imaging (rs-fMRI)-derived functional connectivity patterns have been extensively utilized to delineate global functional organization of the human brain in health, development, and…

Quantitative Methods · Quantitative Biology 2020-10-02 Li Xiao , Biao Cai , Gang Qu , Julia M. Stephen , Tony W. Wilson , Vince D. Calhoun , Yu-Ping Wang

Symbolic regression seeks to uncover physical laws from experimental data by searching for closed-form expressions, which is an important task in AI-driven scientific discovery. Yet the exponential growth of the search space of expression…

Symbolic Computation · Computer Science 2026-02-13 Nan Jiang , Ziyi Wang , Yexiang Xue

The reconstruction of particle tracks from hits in tracking detectors is a computationally intensive task due to the large combinatorics of detector signals. Recent efforts have proven that ML techniques can be successfully applied to the…

High Energy Physics - Experiment · Physics 2024-11-19 Nathalie Soybelman , Carlo Schiavi , Francesco A. Di Bello , Eilam Gross

[RETRACTED]Data increasingly abounds, but distilling their underlying relationships down to something interpretable remains challenging. One approach is genetic programming, which `symbolically regresses' a data set down into an equation.…

Neural and Evolutionary Computing · Computer Science 2025-10-23 Amanda Bertschinger , James Bagrow , Joshua Bongard

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

This paper revisits datasets and evaluation criteria for Symbolic Regression (SR), specifically focused on its potential for scientific discovery. Focused on a set of formulas used in the existing datasets based on Feynman Lectures on…

Machine Learning · Computer Science 2025-01-06 Yoshitomo Matsubara , Naoya Chiba , Ryo Igarashi , Yoshitaka Ushiku

Functional connectomes capture brain interactions via synchronized fluctuations in the functional magnetic resonance imaging signal. If measured during rest, they map the intrinsic functional architecture of the brain. With task-driven…

Neurons and Cognition · Quantitative Biology 2013-04-16 Gaël Varoquaux , R. C. Craddock

The search for binary sequences with low peak sidelobe level value represents a formidable computational problem. To locate better sequences for this problem, we designed a stochastic algorithm that uses two fitness functions. In these…

Artificial Intelligence · Computer Science 2024-06-12 Borko Bošković , Janez Brest

Reward design remains a significant bottleneck in applying reinforcement learning (RL) to real-world problems. A popular alternative is reward learning, where reward functions are inferred from human feedback rather than manually specified.…

Machine Learning · Computer Science 2026-01-16 Chaitanya Kharyal , Calarina Muslimani , Matthew E. Taylor

Regression models usually tend to recover a noisy signal in the form of a combination of regressors, also called features in machine learning, themselves being the result of a learning process.The alignment of the prior covariance feature…

Statistical Mechanics · Physics 2023-01-25 Cyril Furtlehner

Regression analysis is used for prediction and to understand the effect of independent variables on dependent variables. Symbolic regression (SR) automates the search for non-linear regression models, delivering a set of hypotheses that…

Machine Learning · Computer Science 2025-04-09 Fabricio Olivetti de Franca , Gabriel Kronberger

Symbolic Regression (SR) plays a central role in scientific knowledge discovery by distilling mathematical equations from observational data. Most existing SR methods function within a bi-level optimization framework: an outer loop that…

Machine Learning · Computer Science 2026-05-25 Boxiao Wang , Kai Li , Zhiwei Chen , Yang Huang , Runxiang Wang , Ziwen Zhang , Yifan Zhang , Jian Cheng

Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can…

Machine Learning · Computer Science 2025-06-24 Ju-Seung Byun , Andrew Perrault

We present the covariance analysis of two successful nuclear energy density functionals, (i) a non-relativistic Skyrme functional built from a zero-range effective interaction, and (ii) a relativistic nuclear energy density functional based…

Nuclear Theory · Physics 2016-11-25 X. Roca-Maza , N. Paar , G. Colò

Reinforcement learning agents are fundamentally limited by the quality of the reward functions they learn from, yet reward design is often overlooked under the assumption that a well-defined reward is readily available. However, in…