English
Related papers

Related papers: Data-Informed Model Complexity Metric for Optimizi…

200 papers

In this paper, we present a new procedure to automatically generate interpretable hyperelastic material models. This approach is based on symbolic regression which represents an evolutionary algorithm searching for a mathematical model in…

Computational Engineering, Finance, and Science · Computer Science 2022-11-08 Rasul Abdusalamov , Markus Hillgärtner , Mikhail Itskov

Developing mathematical models of dynamic systems is central to many disciplines of engineering and science. Models facilitate simulations, analysis of the system's behavior, decision making and design of automatic control algorithms. Even…

Machine Learning · Computer Science 2020-06-19 Erik Derner , Jiří Kubalík , Nicola Ancona , Robert Babuška

A core challenge for both physics and artificial intellicence (AI) is symbolic regression: finding a symbolic expression that matches data from an unknown function. Although this problem is likely to be NP-hard in principle, functions of…

Computational Physics · Physics 2020-04-16 Silviu-Marian Udrescu , Max Tegmark

Symbolic regression (SR) is the task of discovering a symbolic expression that fits a given data set from the space of mathematical expressions. Despite the abundance of research surrounding the SR problem, there's a scarcity of works that…

Computational Complexity · Computer Science 2024-04-23 Jinglu Song , Qiang Lu , Bozhou Tian , Jingwen Zhang , Jake Luo , Zhiguang Wang

Estimating the difficulty of input questions as perceived by large language models (LLMs) is essential for accurate performance evaluation and adaptive inference. Existing methods typically rely on repeated response sampling, auxiliary…

Computation and Language · Computer Science 2025-09-17 Yubo Zhu , Dongrui Liu , Zecheng Lin , Wei Tong , Sheng Zhong , Jing Shao

In science, we are interested not only in forecasting but also in understanding how predictions are made, specifically what the interpretable underlying model looks like. Data-driven machine learning technology can significantly streamline…

Symbolic Computation · Computer Science 2025-05-29 Weiting Liu , Jiaxu Cui , Jiao Hu , En Wang , Bo Yang

Growing interest in modelling complex systems from brains to societies to cities using networks has led to increased efforts to describe generative processes that explain those networks. Recent successes in machine learning have prompted…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Govind Gandhi

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

This paper describes a new method for Symbolic Regression that allows to find mathematical expressions from a dataset. This method has a strong mathematical basis. As opposed to other methods such as Genetic Programming, this method is…

Machine Learning · Computer Science 2022-03-22 Daniel Rivero , Enrique Fernandez-Blanco

The rapid growth and distribution of IT systems increases their complexity and aggravates operation and maintenance. To sustain control over large sets of hosts and the connecting networks, monitoring solutions are employed and constantly…

Machine Learning · Computer Science 2020-07-08 Alexander Acker , Thorsten Wittkopp , Sasho Nedelkoski , Jasmin Bogatinovski , Odej Kao

Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since the tensor rank controls the complexity of the CPD model, its inaccurate learning would cause…

Machine Learning · Computer Science 2022-03-30 Lei Cheng , Zhongtao Chen , Qingjiang Shi , Yik-Chung Wu , Sergios Theodoridis

We propose and study a method for learning interpretable representations for the task of regression. Features are represented as networks of multi-type expression trees comprised of activation functions common in neural networks in addition…

Neural and Evolutionary Computing · Computer Science 2019-03-26 William La Cava , Tilak Raj Singh , James Taggart , Srinivas Suri , Jason H. Moore

Complexity measures are essential to understand complex systems and there are numerous definitions to analyze one-dimensional data. However, extensions of these approaches to two or higher-dimensional data, such as images, are much less…

Data Analysis, Statistics and Probability · Physics 2012-12-27 H. V. Ribeiro , L. Zunino , E. K. Lenzi , P. A. Santoro , R. S. Mendes

We describe a method for the identification of models for dynamical systems from observational data. The method is based on the concept of symbolic regression and uses genetic programming to evolve a system of ordinary differential…

Machine Learning · Computer Science 2021-07-14 Gabriel Kronberger , Lukas Kammerer , Michael Kommenda

Higher-order tensor datasets arise commonly in recommendation systems, neuroimaging, and social networks. Here we develop probable methods for estimating a possibly high rank signal tensor from noisy observations. We consider a generative…

Methodology · Statistics 2023-04-11 Chanwoo Lee , Miaoyan Wang

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in particular whenever…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Christian Haider , Fabricio Olivetti de França , Bogdan Burlacu , Gabriel Kronberger

We present an improved method for symbolic regression that seeks to fit data to formulas that are Pareto-optimal, in the sense of having the best accuracy for a given complexity. It improves on the previous state-of-the-art by typically…

Machine Learning · Computer Science 2020-12-17 Silviu-Marian Udrescu , Andrew Tan , Jiahai Feng , Orisvaldo Neto , Tailin Wu , Max Tegmark

We study the modeling and prediction of dynamical systems based on conventional models derived from measurements. Such algorithms are highly desirable in situations where the underlying dynamics are hard to model from physical principles or…

Data Analysis, Statistics and Probability · Physics 2016-08-03 Markus Quade , Markus Abel , Kamran Shafi , Robert K. Niven , Bernd R. Noack

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Testing Machine Learning (ML) models and AI-Infused Applications (AIIAs), or systems that contain ML models, is highly challenging. In addition to the challenges of testing classical software, it is acceptable and expected that statistical…

Machine Learning · Computer Science 2022-10-28 George Kour , Marcel Zalmanovici , Orna Raz , Samuel Ackerman , Ateret Anaby-Tavor