English
Related papers

Related papers: Shape-constrained Symbolic Regression with NSGA-II…

200 papers

We propose and analyse a reduced-rank method for solving least-squares regression problems with infinite dimensional output. We derive learning bounds for our method, and study under which setting statistical performance is improved in…

Machine Learning · Statistics 2022-11-17 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Data driven models of dynamical systems help planners and controllers to provide more precise and accurate motions. Most model learning algorithms will try to minimize a loss function between the observed data and the model's predictions.…

Artificial Intelligence · Computer Science 2021-02-12 Clark Zhang , Santiago Paternain , Alejandro Ribeiro

This tutorial paper provides a general overview of symbolic regression (SR) with specific focus on standards of interpretability. We posit that interpretable modeling, although its definition is still disputed in the literature, is a…

Machine Learning · Computer Science 2023-06-02 Jennifer J. Schnur , Nitesh V. Chawla

We consider a generic empirical composition optimization problem, where there are empirical averages present both outside and inside nonlinear loss functions. Such a problem is of interest in various machine learning applications, and…

Optimization and Control · Mathematics 2019-11-04 Adithya M. Devraj , Jianshu Chen

Symbolic Regression (SR) enables the discovery of interpretable mathematical relationships from experimental and simulation data. These relationships are often coined descriptors which are defined as a fundamental materials property that is…

Computational Physics · Physics 2026-02-10 Udaykumar Gajera , Mohsen Sotoudeh , Kanchan Sarkar , Axel Groß

We introduce 'Class Symbolic Regression' (Class SR) a first framework for automatically finding a single analytical functional form that accurately fits multiple datasets - each realization being governed by its own (possibly) unique set of…

Machine Learning · Computer Science 2024-06-19 Wassim Tenachi , Rodrigo Ibata , Thibaut L. François , Foivos I. Diakogiannis

In the area of physical simulations, nearly all neural-network-based methods directly predict future states from the input states. However, many traditional simulation engines instead model the constraints of the system and select the state…

Machine Learning · Computer Science 2022-01-31 Yulia Rubanova , Alvaro Sanchez-Gonzalez , Tobias Pfaff , Peter Battaglia

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

Symbolic Regression (SR) is a powerful technique for automatically discovering mathematical expressions from input data. Mainstream SR algorithms search for the optimal symbolic tree in a vast function space, but the increasing complexity…

Machine Learning · Computer Science 2026-02-03 Xinxin Li , Juan Zhang , Da Li , Xingyu Liu , Jin Xu , Junping Yin

Spiking neural networks (SNNs) can be used for implementing cost-efficient artificial intelligence computing or mechanistic modelling of experimentally observed neural data. In the latter, fitting neural data with recurrent SNNs (RSNNs)…

Neurons and Cognition · Quantitative Biology 2026-05-26 Divyansh Sethi , Muhammad Faraz , KongFatt Wong-Lin

This paper considers smooth convex optimization problems with many functional constraints. To solve this general class of problems we propose a new stochastic perturbed augmented Lagrangian method, called SGDPA, where a perturbation is…

Optimization and Control · Mathematics 2025-04-01 Nitesh Kumar Singh , Ion Necoara

Hypothesis testing procedures are developed to assess linear operator constraints in function-on-scalar regression when incomplete functional responses are observed. The approach enables statistical inferences about the shape and other…

Methodology · Statistics 2022-12-06 Yeonjoo Park , Kyunghee Han , Douglas G. Simpson

Magnetic Resonance Imaging (MRI) is a leading diagnostic modality for a wide range of exams, where multiple contrast images are often acquired for characterizing different tissues. However, acquiring high-resolution MRI typically extends…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Shaoming Zheng , Yinsong Wang , Siyi Du , Chen Qin

Symbolic regression searches for analytic expressions that accurately describe studied phenomena. The main attraction of this approach is that it returns an interpretable model that can be insightful to users. Historically, the majority of…

Current learning models often struggle with human-like systematic generalization, particularly in learning compositional rules from limited data and extrapolating them to novel combinations. We introduce the Neural-Symbolic Recursive…

Machine Learning · Computer Science 2024-04-30 Qing Li , Yixin Zhu , Yitao Liang , Ying Nian Wu , Song-Chun Zhu , Siyuan Huang

Symbolic regression is a machine learning technique, and it has seen many advancements in recent years, especially in genetic programming approaches (GPSR). Furthermore, it has been known for many years that constant optimization of…

Machine Learning · Computer Science 2024-12-04 L. G. A dos Reis , V. L. P. S. Caminha , T. J. P. Penna

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou

Convolutional neural network (CNN) based architectures, such as Mask R-CNN, constitute the state of the art in object detection and segmentation. Recently, these methods have been extended for model-based segmentation where the network…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Wenbo Dong , Volkan Isler

This report extends the Spectral Neuro-Symbolic Reasoning (Spectral NSR) framework by introducing three semantically grounded enhancements: (1) transformer-based node merging using contextual embeddings (e.g., Sentence-BERT, SimCSE) to…

Computation and Language · Computer Science 2025-11-17 Andrew Kiruluta , Priscilla Burity

Generalized Additive Models (GAMs) balance predictive accuracy and interpretability, but manually configuring their structure is challenging. We propose using the multi-objective genetic algorithm NSGA-II to automatically optimize GAMs,…

Machine Learning · Computer Science 2026-02-19 Kaaustaaub Shankar , Kelly Cohen