English
Related papers

Related papers: Data Pipeline Training: Integrating AutoML to Opti…

200 papers

Machine learning (ML) is now commonplace, powering data-driven applications in various organizations. Unlike the traditional perception of ML in research, ML production pipelines are complex, with many interlocking analytical components…

Databases · Computer Science 2021-03-31 Doris Xin , Hui Miao , Aditya Parameswaran , Neoklis Polyzotis

To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML)…

Machine Learning · Computer Science 2019-04-19 Weilin Zhou , Frederic Precioso

Recent advancements in software and hardware technologies have enabled the use of AI/ML models in everyday applications has significantly improved the quality of service rendered. However, for a given application, finding the right AI/ML…

Machine Learning · Computer Science 2023-04-19 Haoxiang Zhang , Juliana Freire , Yash Garg

Building a machine learning (ML) pipeline in an automated way is a crucial and complex task as it is constrained with the available time budget and resources. This encouraged the research community to introduce several solutions to utilize…

Machine Learning · Computer Science 2020-01-01 Hassan Eldeeb , Abdelrhman Eldallal

Currently, a variety of pipeline tools are available for use in data engineering. Data scientists can use these tools to resolve data wrangling issues associated with data and accomplish some data engineering tasks from data ingestion…

Machine Learning · Computer Science 2024-06-21 Anthony Mbata , Yaji Sripada , Mingjun Zhong

Over the last decade, the long-running endeavour to automate high-level processes in machine learning (ML) has risen to mainstream prominence, stimulated by advances in optimisation techniques and their impact on selecting ML…

Machine Learning · Computer Science 2022-03-30 David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

Machine learning models are routinely integrated into process mining pipelines to carry out tasks like data transformation, noise reduction, anomaly detection, classification, and prediction. Often, the design of such models is based on…

Machine Learning · Computer Science 2024-02-21 Paolo Ceravolo , Sylvio Barbon Junior , Ernesto Damiani , Wil van der Aalst

The deployment of Machine Learning (ML) models is a difficult and time-consuming job that comprises a series of sequential and correlated tasks that go from the data pre-processing, and the design and extraction of features, to the choice…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached…

Machine Learning · Computer Science 2019-05-27 Iddo Drori , Yamuna Krishnamurthy , Raoni Lourenco , Remi Rampin , Kyunghyun Cho , Claudio Silva , Juliana Freire

AutoML systems can speed up routine data science work and make machine learning available to those without expertise in statistics and computer science. These systems have gained traction in enterprise settings where pools of skilled data…

Human-Computer Interaction · Computer Science 2021-01-13 Anamaria Crisan , Brittany Fiore-Gartland

Automated Machine Learning (AutoML) has significantly advanced the efficiency of ML-focused software development by automating hyperparameter optimization and pipeline construction, reducing the need for manual intervention. Quantum Machine…

The pipeline optimization problem in machine learning requires simultaneous optimization of pipeline structures and parameter adaptation of their elements. Having an elegant way to express these structures can help lessen the complexity in…

Machine Learning · Computer Science 2021-07-15 Paulito P. Palmes , Akihiro Kishimoto , Radu Marinescu , Parikshit Ram , Elizabeth Daly

This paper explores the application of automated machine learning (AutoML) techniques to the construction industry, a sector vital to the global economy. Traditional ML model construction methods were complex, time-consuming, reliant on…

Software Engineering · Computer Science 2023-08-04 Rui Zhao , Zhongze Yang , Dong Liang , Fan Xue

Automated machine learning (AutoML) has emerged as a promising paradigm for automating machine learning (ML) pipeline design, broadening AI adoption. Yet its reliability in complex domains such as cybersecurity remains underexplored. This…

Cryptography and Security · Computer Science 2025-09-30 Sherif Saad , Kevin Shi , Mohammed Mamun , Hythem Elmiligi

Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML…

Machine Learning · Computer Science 2020-07-24 Tuomas Halvari , Jukka K. Nurminen , Tommi Mikkonen

The popularity of automated machine learning (AutoML) tools in different domains has increased over the past few years. Machine learning (ML) practitioners use AutoML tools to automate and optimize the process of feature engineering, model…

Software Engineering · Computer Science 2022-08-30 Forough Majidi , Moses Openja , Foutse Khomh , Heng Li

Automated machine learning (AutoML) algorithms have grown in popularity due to their high performance and flexibility to adapt to different problems and data sets. With the increasing number of AutoML algorithms, deciding which would best…

Machine Learning · Computer Science 2023-03-10 Pedro Henrique Ribeiro , Patryk Orzechowski , Joost Wagenaar , Jason H. Moore

This article introduces the importance of machine learning in real-world applications and explores the rise of MLOps (Machine Learning Operations) and its importance for solving challenges such as model deployment and performance…

Software Engineering · Computer Science 2024-05-17 Penghao Liang , Bo Song , Xiaoan Zhan , Zhou Chen , Jiaqiang Yuan

Advances in machine learning methods for computer vision tasks have led to their consideration for safety-critical applications like autonomous driving. However, effectively integrating these methods into the automotive development…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Youssef Shoeb , Azarm Nowzad , Hanno Gottschalk

An essential task of Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on a given dataset. This problem has been addressed with sophisticated black-box…

Machine Learning · Computer Science 2021-11-30 Felix Mohr , Marcel Wever