English
Related papers

Related papers: Globally Optimal Symbolic Regression

200 papers

Symbolic regression is a technique that can automatically derive analytic models from data. Traditionally, symbolic regression has been implemented primarily through genetic programming that evolves populations of candidate solutions…

Neural and Evolutionary Computing · Computer Science 2025-04-24 Jiří Kubalík , Robert Babuška

We prove that the global minimum of the backpropagation (BP) training problem of neural networks with an arbitrary nonlinear activation is given by the ridgelet transform. A series of computational experiments show that there exists an…

Machine Learning · Statistics 2019-01-31 Sho Sonoda , Isao Ishikawa , Masahiro Ikeda , Kei Hagihara , Yoshihiro Sawano , Takuo Matsubara , Noboru Murata

This paper introduces a numerical method to enclose the global minimum of a nonlinear function subject to simple bounds on the variables. Using interval analysis, coupled with the computational power and architecture of graphics processing…

Numerical Analysis · Mathematics 2026-04-15 Guanglu Zhang , Qihang Shan , Jonathan Cagan

In most global optimization problems, finding global optimal point inthe multidimensional and great search space needs high computations. In this paper, we present a new approach to find global optimal point with the low computation and few…

Neural and Evolutionary Computing · Computer Science 2013-07-24 Masoumeh Vali

The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local…

Machine Learning · Computer Science 2017-11-27 Fabien Lauer

Symbolic Regression is the study of algorithms that automate the search for analytic expressions that fit data. While recent advances in deep learning have generated renewed interest in such approaches, the development of symbolic…

Instrumentation and Methods for Astrophysics · Physics 2023-12-27 Wassim Tenachi , Rodrigo Ibata , Foivos I. Diakogiannis

We consider the so-called Keplerian periodogram, in which the putative detectable signal is modelled by a highly non-linear Keplerian radial velocity function, appearing in Doppler exoplanetary surveys. We demonstrate that for planets on…

Instrumentation and Methods for Astrophysics · Physics 2014-10-29 Roman V. Baluev

Many promising approaches to symbolic regression have been presented in recent years, yet progress in the field continues to suffer from a lack of uniform, robust, and transparent benchmarking standards. In this paper, we address this…

Neural and Evolutionary Computing · Computer Science 2021-08-02 William La Cava , Patryk Orzechowski , Bogdan Burlacu , Fabrício Olivetti de França , Marco Virgolin , Ying Jin , Michael Kommenda , Jason H. Moore

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

A new approach to solving a large class of factorable nonlinear programming (NLP) problems to global optimality is presented in this paper. Unlike the traditional strategy of partitioning the decision-variable space employed in many…

Optimization and Control · Mathematics 2015-04-28 Gene A. Bunin

Symbolic regression corresponds to an ensemble of techniques that allow to uncover an analytical equation from data. Through a closed form formula, these techniques provide great advantages such as potential scientific discovery of new…

Machine Learning · Computer Science 2021-10-27 Ismail Alaoui Abdellaoui , Siamak Mehrkanoon

Symbolic regression is a machine learning method with the goal to produce interpretable results. Unlike other machine learning methods such as, e.g. random forests or neural networks, which are opaque, symbolic regression aims to model and…

Machine Learning · Computer Science 2024-06-07 Yousef A. Radwan , Gabriel Kronberger , Stephan Winkler

The problem of computing an exact experimental design that is optimal for the least-squares estimation of the parameters of a regression model is considered. We show that this problem can be solved via mixed-integer linear programming…

Computation · Statistics 2024-06-18 Radoslav Harman , Samuel Rosa

We demonstrate the use of symbolic regression in deriving analytical formulas, which are needed at various stages of a typical experimental analysis in collider phenomenology. As a first application, we consider kinematic variables like the…

High Energy Physics - Phenomenology · Physics 2023-03-29 Zhongtian Dong , Kyoungchul Kong , Konstantin T. Matchev , Katia Matcheva

Autonomous systems must solve motion planning problems subject to increasingly complex, time-sensitive, and uncertain missions. These problems often involve high-level task specifications, such as temporal logic or chance constraints, which…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Junyang Cai , Weimin Huang , Brendan Long , Matthew Cleaveland , Jyotirmoy V. Deshmukh , Lars Lindemann , Bistra Dilkina

Mixed-integer linear programming (MILP) is widely employed for modeling combinatorial optimization problems. In practice, similar MILP instances with only coefficient variations are routinely solved, and machine learning (ML) algorithms are…

Optimization and Control · Mathematics 2023-03-07 Qingyu Han , Linxin Yang , Qian Chen , Xiang Zhou , Dong Zhang , Akang Wang , Ruoyu Sun , Xiaodong Luo

We develop an optimization framework for identifying ideal Mixed Binary Linear Programs (MBLP) which is linear when using known input data and nonconvex quadratic over parametric input data. These techniques are applied to various…

Optimization and Control · Mathematics 2024-07-09 Jamie Fravel , Robert Hildebrand

Symbolic equations are at the core of scientific discovery. The task of discovering the underlying equation from a set of input-output pairs is called symbolic regression. Traditionally, symbolic regression methods use hand-designed…

Machine Learning · Computer Science 2021-06-14 Luca Biggio , Tommaso Bendinelli , Alexander Neitz , Aurelien Lucchi , Giambattista Parascandolo

Symbolic regression (SR) aims to discover mathematical expressions from data, a task traditionally tackled using Genetic Programming (GP) through combinatorial search over symbolic structures. Latent Space Optimization (LSO) methods use…

Neural and Evolutionary Computing · Computer Science 2026-04-14 Benjamin Léger , Kazem Meidani , Christian Gagné

In optimization problems, often equations and inequalities are represented using if-else (implication) construct which is known to be equivalent to a disjunction. Such statements are modeled and incorporated in an optimization problem using…

Optimization and Control · Mathematics 2015-10-08 Anshul Agarwal