English
Related papers

Related papers: Active Learning Improves Performance on Symbolic R…

200 papers

Data-driven soft sensors are extensively used in industrial and chemical processes to predict hard-to-measure process variables whose real value is difficult to track during routine operations. The regression models used by these sensors…

Machine Learning · Computer Science 2023-04-11 Davide Cacciarelli , Murat Kulahci , John Tyssedal

We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe practical…

Machine Learning · Statistics 2013-10-28 Roman Garnett , Michael A. Osborne , Philipp Hennig

Active learning is proposed for selection of the next operating points in the design of experiments, for identifying linear parameter-varying systems. We extend existing approaches found in literature to multiple-input multiple-output…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Robert Chin , Alejandro I. Maass , Nalika Ulapane , Chris Manzie , Iman Shames , Dragan Nešić , Jonathan E. Rowe , Hayato Nakada

The workhorse of machine learning is stochastic gradient descent. To access stochastic gradients, it is common to consider iteratively input/output pairs of a training dataset. Interestingly, it appears that one does not need full…

Machine Learning · Computer Science 2022-12-08 Vivien Cabannes , Francis Bach , Vianney Perchet , Alessandro Rudi

Symbolic Regression (SR) is a powerful technique for discovering interpretable mathematical expressions. However, benchmarking SR methods remains challenging due to the diversity of algorithms, datasets, and evaluation criteria. In this…

We present a new method for enhancing symbolic regression for differential equations via dimensional analysis, specifically Ipsen's and Buckingham pi methods. Since symbolic regression often suffers from high computational costs and…

Machine Learning · Computer Science 2024-11-26 Lena Podina , Diba Darooneh , Joshveer Grewal , Mohammad Kohandel

In this paper we provide a broad benchmarking of recent genetic programming approaches to symbolic regression in the context of state of the art machine learning approaches. We use a set of nearly 100 regression benchmark problems culled…

Neural and Evolutionary Computing · Computer Science 2018-06-08 Patryk Orzechowski , William La Cava , Jason H. Moore

Symbolic regression is a machine learning technique that can learn the governing formulas of data and thus has the potential to transform scientific discovery. However, symbolic regression is still limited in the complexity and…

Machine Learning · Computer Science 2023-05-30 Michael Zhang , Samuel Kim , Peter Y. Lu , Marin Soljačić

We propose a general purpose active learning algorithm for structured prediction, gathering labeled data for training a model that outputs a set of related labels for an image or video. Active learning starts with a limited initial training…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Mehran Khodabandeh , Zhiwei Deng , Mostafa S. Ibrahim , Shinichi Satoh , Greg Mori

The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a…

Machine Learning · Statistics 2023-08-02 David Holzmüller , Viktor Zaverkin , Johannes Kästner , Ingo Steinwart

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau

Symbolic regression is a powerful system identification technique in industrial scenarios where no prior knowledge on model structure is available. Such scenarios often require specific model properties such as interpretability, robustness,…

Batch active learning is a popular approach for efficiently training machine learning models on large, initially unlabelled datasets by repeatedly acquiring labels for batches of data points. However, many recent batch active learning…

Machine Learning · Computer Science 2023-07-10 Andreas Kirsch

Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ke Yu , Stephen Albro , Giulia DeSalvo , Suraj Kothawade , Abdullah Rashwan , Sasan Tavakkol , Kayhan Batmanghelich , Xiaoqi Yin

Symbolic Regression is the study of algorithms that automate the search for analytic expressions that fit data. While recent advances in deep learning have generated renewed interest in such approaches, the development of symbolic…

Instrumentation and Methods for Astrophysics · Physics 2023-12-27 Wassim Tenachi , Rodrigo Ibata , Foivos I. Diakogiannis

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time…

Machine Learning · Computer Science 2020-01-24 Evgenii Tsymbalov , Maxim Panov , Alexander Shapeev

We investigate the use of active-learning (AL) strategies to generate the input excitation signal at runtime for system identification of linear and nonlinear autoregressive and state-space models. We adapt various existing AL approaches…

Systems and Control · Electrical Eng. & Systems 2025-06-30 Kui Xie , Alberto Bemporad

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

With the rising complexity of numerous novel applications that serve our modern society comes the strong need to design efficient computing platforms. Designing efficient hardware is, however, a complex multi-objective problem that deals…

Hardware Architecture · Computer Science 2023-04-11 Alireza Ghaffari , Masoud Asgharian , Yvon Savaria