English
Related papers

Related papers: Feature engineering and symbolic regression method…

200 papers

Feature selection aims to identify the optimal feature subset for enhancing downstream models. Effective feature selection can remove redundant features, save computational resources, accelerate the model learning process, and improve the…

Machine Learning · Computer Science 2024-12-19 Nanxu Gong , Wangyang Ying , Dongjie Wang , Yanjie Fu

We introduce a new approach to systematically map features discovered by sparse autoencoder across consecutive layers of large language models, extending earlier work that examined inter-layer feature links. By using a data-free cosine…

Machine Learning · Computer Science 2025-07-28 Daniil Laptev , Nikita Balagansky , Yaroslav Aksenov , Daniil Gavrilov

In recent years, genetic programming (GP)-based evolutionary feature construction has achieved significant success. However, a primary challenge with evolutionary feature construction is its tendency to overfit the training data, resulting…

Machine Learning · Computer Science 2024-05-14 Hengzhe Zhang , Qi Chen , Bing Xue , Wolfgang Banzhaf , Mengjie Zhang

The estimation of static parameters in dynamical systems and control theory has been extensively studied, with significant progress made in estimating varying parameters in specific system types. Suppose, in the general case, we have data…

Optimization and Control · Mathematics 2025-07-10 Jamiree Harrison , Enoch Yeung

We present a novel computational approach for extracting weak signals, whose exact location and width may be unknown, from complex background distributions with an arbitrary functional form. We focus on datasets that can be naturally…

High Energy Physics - Experiment · Physics 2023-03-22 Abhijith Gandrakota , Amitabh Lath , Alexandre V. Morozov , Sindhu Murthy

The ability to discover physical laws and governing equations from data is one of humankind's greatest intellectual achievements. A quantitative understanding of dynamic constraints and balances in nature has facilitated rapid development…

Dynamical Systems · Mathematics 2016-04-27 Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

Data-driven modeling for nonlinear fluid flows using sparse convolution-based mapping into a feature space where the dynamics are Markov linear is explored in this article. The underlying principle of low-order models for fluid systems is…

Fluid Dynamics · Physics 2020-10-28 Chen Lu , Balaji Jayaraman , Joshua Whitman , Girish Chowdhary

Data-driven discovery of partial differential equations (PDEs) offers a promising paradigm for uncovering governing physical laws from observational data. However, in practical scenarios, measurements are often contaminated by noise and…

Machine Learning · Computer Science 2026-03-25 Xingyu Chen , Junxiu An , Jun Guo , Yuqian Zhou

The working mechanisms of complex natural systems tend to abide by concise and profound partial differential equations (PDEs). Methods that directly mine equations from data are called PDE discovery, which reveals consistent physical laws…

Machine Learning · Computer Science 2023-03-17 Mengge Du , Yuntian Chen , Dongxiao Zhang

Learning symbolic turbulence models from indirect observation data is of significant interest as it not only improves the accuracy of posterior prediction but also provides explicit model formulations with good interpretability. However, it…

Fluid Dynamics · Physics 2025-05-12 Chutian Wu , Xin-Lei Zhang , Duo Xu , Guowei He

Sparse regression on a library of candidate features has developed as the prime method to discover the partial differential equation underlying a spatio-temporal data-set. These features consist of higher order derivatives, limiting model…

Machine Learning · Computer Science 2021-05-05 Gert-Jan Both , Gijs Vermarien , Remy Kusters

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

Machine Learning · Computer Science 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

This study presents a systematic machine learning approach for creating efficient hybrid models and discovering sorption uptake models in non-linear advection-diffusion-sorption systems. It demonstrates an effective method to train these…

Computational Engineering, Finance, and Science · Computer Science 2023-04-27 Vinicius V. Santana , Erbet Costa , Carine M. Rebello , Ana Mafalda Ribeiro , Chris Rackauckas , Idelfonso B. R. Nogueira

This paper presents an innovative approach to dimensionality reduction and feature extraction in high-dimensional datasets, with a specific application focus on wood surface defect detection. The proposed framework integrates sparse…

Machine Learning · Computer Science 2024-10-01 Harish Neelam , Koushik Sai Veerella , Souradip Biswas

Discovering a meaningful symbolic expression that explains experimental data is a fundamental challenge in many scientific fields. We present a novel, open-source computational framework called Scientist-Machine Equation Detector (SciMED),…

Machine Learning · Computer Science 2023-03-02 Liron Simon Keren , Alex Liberzon , Teddy Lazebnik

In this paper, an evolutionary-based sparse regression algorithm is proposed and applied onto experimental data collected from a Duffing oscillator setup and numerical simulation data. Our purpose is to identify the Coulomb friction terms…

Computational Engineering, Finance, and Science · Computer Science 2020-05-19 Saeideh Khatiry Goharoodi , Kevin Dekemele , Mia Loccufier , Luc Dupre , Guillaume Crevecoeur

Symbolic regression is a powerful system identification technique in industrial scenarios where no prior knowledge on model structure is available. Such scenarios often require specific model properties such as interpretability, robustness,…

Data-driven discovery of governing equations from data remains a fundamental challenge in nonlinear dynamics. Although sparse regression techniques have advanced system identification, they struggle with rational functions and noise…

Machine Learning · Computer Science 2025-11-17 Zitong Zhang , Hao Sun

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey

Symbolic regression is a machine learning technique that can learn the governing formulas of data and thus has the potential to transform scientific discovery. However, symbolic regression is still limited in the complexity and…

Machine Learning · Computer Science 2023-05-30 Michael Zhang , Samuel Kim , Peter Y. Lu , Marin Soljačić