English
Related papers

Related papers: Lexidate: Model Evaluation and Selection with Lexi…

200 papers

The deployment of Machine Learning (ML) models is a difficult and time-consuming job that comprises a series of sequential and correlated tasks that go from the data pre-processing, and the design and extraction of features, to the choice…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

Automated machine learning (AutoML) aims for constructing machine learning (ML) pipelines automatically. Many studies have investigated efficient methods for algorithm selection and hyperparameter optimization. However, methods for ML…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Tien-Dung Nguyen , Marco F. Huber

The evaluation of machine learning (ML) pipelines is essential during automatic ML pipeline composition and optimisation. The previous methods such as Bayesian-based and genetic-based optimisation, which are implemented in Auto-Weka,…

Machine Learning · Computer Science 2020-02-04 Tien-Dung Nguyen , Tomasz Maszczyk , Katarzyna Musial , Marc-Andre Zöller , Bogdan Gabrys

Lexicase selection has been shown to provide advantages over other selection algorithms in several areas of evolutionary computation and machine learning. In its standard form, lexicase selection filters a population or other collection…

Neural and Evolutionary Computing · Computer Science 2024-02-12 Andrew Ni , Li Ding , Lee Spector

Automated data preparation is crucial for democratizing machine learning, yet existing reinforcement learning (RL) based approaches suffer from inefficient exploration in the vast space of possible preprocessing pipelines. We present…

Databases · Computer Science 2025-07-21 Jing Chang , Chang Liu , Jinbin Huang , Rui Mao , Jianbin Qin

The automated machine learning (AutoML) process can require searching through complex configuration spaces of not only machine learning (ML) components and their hyperparameters but also ways of composing them together, i.e. forming ML…

Machine Learning · Computer Science 2022-08-10 David Jacob Kedziora , Tien-Dung Nguyen , Katarzyna Musial , Bogdan Gabrys

Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML…

Machine Learning · Computer Science 2020-07-24 Tuomas Halvari , Jukka K. Nurminen , Tommi Mikkonen

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Machine Learning · Computer Science 2024-11-28 Mark Zhao , Emanuel Adamiak , Christos Kozyrakis

Automated machine learning (AutoML) systems propose an end-to-end solution to a given machine learning problem, creating either fixed or flexible pipelines. Fixed pipelines are task independent constructs: their general composition remains…

Lexicase parent selection filters the population by considering one random training case at a time, eliminating any individuals with errors for the current case that are worse than the best error in the selection pool, until a single…

Neural and Evolutionary Computing · Computer Science 2020-01-03 Thomas Helmuth , Edward Pantridge , Lee Spector

Automated machine learning makes it easier for data scientists to develop pipelines by searching over possible choices for hyperparameters, algorithms, and even pipeline topologies. Unfortunately, the syntax for automated machine learning…

Machine Learning · Computer Science 2020-07-07 Guillaume Baudart , Martin Hirzel , Kiran Kate , Parikshit Ram , Avraham Shinnar

To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML)…

Machine Learning · Computer Science 2019-04-19 Weilin Zhou , Frederic Precioso

In real-world machine learning (ML) pipelines, datasets are continuously growing. Models must incorporate this new training data to improve generalization and adapt to potential distribution shifts. The cost of model retraining is…

Machine Learning · Computer Science 2025-01-27 Maximilian Böther , Ties Robroek , Viktor Gsteiger , Robin Holzinger , Xianzhe Ma , Pınar Tözün , Ana Klimovic

Function calling significantly extends the application boundary of large language models, where high-quality and diverse training data is critical for unlocking this capability. However, real function-calling data is quite challenging to…

In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increasing number of machine learning models being developed, model…

Machine Learning · Statistics 2018-05-03 Nicolo Fusi , Rishit Sheth , Huseyn Melih Elibol

Embeddings are a powerful way to enrich data-driven machine learning models with the world knowledge of large language models (LLMs). Yet, there is limited evidence on how to design effective LLM-based embedding pipelines for tabular…

Machine Learning · Computer Science 2026-03-19 Oksana Kolomenko , Ricardo Knauer , Erik Rodner

An essential task of Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on a given dataset. This problem has been addressed with sophisticated black-box…

Machine Learning · Computer Science 2021-11-30 Felix Mohr , Marcel Wever

Automated machine learning (AutoML) aims to select and configure machine learning algorithms and combine them into machine learning pipelines tailored to a dataset at hand. For supervised learning tasks, most notably binary and multinomial…

Machine Learning · Computer Science 2024-02-29 Marcel Wever

In genetic programming, an evolutionary method for producing computer programs that solve specified computational problems, parent selection is ordinarily based on aggregate measures of performance across an entire training set. Lexicase…

Neural and Evolutionary Computing · Computer Science 2021-06-14 Thomas Helmuth , Lee Spector

With the growing popularity of Large Reasoning Models and their results in solving mathematical problems, it becomes crucial to measure their capabilities. We introduce a pipeline for both automatic and interactive verification as a more…

Artificial Intelligence · Computer Science 2026-02-25 Varvara Sazonova , Dmitri Shmelkin , Stanislav Kikot , Vasily Motolygin