English
Related papers

Related papers: Production Machine Learning Pipelines: Empirical A…

200 papers

Classical Machine Learning (ML) pipelines often comprise of multiple ML models where models, within a pipeline, are trained in isolation. Conversely, when training neural network models, layers composing the neural models are simultaneously…

Machine Learning · Computer Science 2019-12-13 Gyeong-In Yu , Saeed Amizadeh , Sehoon Kim , Artidoro Pagnoni , Byung-Gon Chun , Markus Weimer , Matteo Interlandi

In real-world machine learning (ML) pipelines, datasets are continuously growing. Models must incorporate this new training data to improve generalization and adapt to potential distribution shifts. The cost of model retraining is…

Machine Learning · Computer Science 2025-01-27 Maximilian Böther , Ties Robroek , Viktor Gsteiger , Robin Holzinger , Xianzhe Ma , Pınar Tözün , Ana Klimovic

Building a machine learning (ML) pipeline in an automated way is a crucial and complex task as it is constrained with the available time budget and resources. This encouraged the research community to introduce several solutions to utilize…

Machine Learning · Computer Science 2020-01-01 Hassan Eldeeb , Abdelrhman Eldallal

As data science continues to grow in popularity, there will be an increasing need to make data science tools more scalable, flexible, and accessible. In particular, automated machine learning (AutoML) systems seek to automate the process of…

Neural and Evolutionary Computing · Computer Science 2016-08-01 Randal S. Olson , Jason H. Moore

Machine Learning Operations (MLOps) has become increasingly critical as more organisations move ML models into production. However, the growing landscape of MLOps solutions has introduced complexity for practitioners trying to select…

Software Engineering · Computer Science 2026-04-21 Zakkarija Micallef , Keerthiga Rajenthiram , Ilias Gerostathopoulos

Development of new machine learning models is typically done on manually curated data sets, making them unsuitable for evaluating the models' performance during operations, where the evaluation needs to be performed automatically on…

Machine Learning · Computer Science 2021-10-15 Awalin Sopan , Konstantin Berlin

Machine learning tasks entail the use of complex computational pipelines to reach quantitative and qualitative conclusions. If some of the activities in a pipeline produce erroneous or uninformative outputs, the pipeline may fail or produce…

Machine Learning · Computer Science 2020-02-13 Raoni Lourenço , Juliana Freire , Dennis Shasha

Currently, a variety of pipeline tools are available for use in data engineering. Data scientists can use these tools to resolve data wrangling issues associated with data and accomplish some data engineering tasks from data ingestion…

Machine Learning · Computer Science 2024-06-21 Anthony Mbata , Yaji Sripada , Mingjun Zhong

Machine learning (ML) provides algorithms to create computer programs based on data without explicitly programming them. In business process management (BPM), ML applications are used to analyse and improve processes efficiently. Three…

Machine Learning · Computer Science 2024-05-28 Sven Weinzierl , Sandra Zilker , Sebastian Dunzer , Martin Matzner

The automated machine learning (AutoML) process can require searching through complex configuration spaces of not only machine learning (ML) components and their hyperparameters but also ways of composing them together, i.e. forming ML…

Machine Learning · Computer Science 2022-08-10 David Jacob Kedziora , Tien-Dung Nguyen , Katarzyna Musial , Bogdan Gabrys

Automated Machine Learning (AutoML) has been used successfully in settings where the learning task is assumed to be static. In many real-world scenarios, however, the data distribution will evolve over time, and it is yet to be shown…

Machine Learning · Computer Science 2022-12-08 Bilge Celik , Prabhant Singh , Joaquin Vanschoren

As applications in large organizations evolve, the machine learning (ML) models that power them must adapt the same predictive tasks to newly arising data modalities (e.g., a new video content launch in a social media application requires…

Fatigue life prediction is essential in both the design and operational phases of any aircraft, and in this sense safety in the aerospace industry requires early detection of fatigue cracks to prevent in-flight failures. Robust and precise…

Machine learning (ML) pipeline composition and optimisation have been studied to seek multi-stage ML models, i.e. preprocessor-inclusive, that are both valid and well-performing. These processes typically require the design and traversal of…

Machine Learning · Computer Science 2021-05-04 Tien-Dung Nguyen , David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

In recent years, a wide variety of automated machine learning (AutoML) methods have been proposed to search and generate end-to-end learning pipelines. While these techniques facilitate the creation of models for real-world applications,…

Human-Computer Interaction · Computer Science 2020-09-07 Jorge Piazentin Ono , Sonia Castelo , Roque Lopez , Enrico Bertini , Juliana Freire , Claudio Silva

Automated machine learning (AutoML) systems aim at finding the best machine learning (ML) pipeline that automatically matches the task and data at hand. We investigate the robustness of machine learning pipelines generated with three AutoML…

Machine Learning · Computer Science 2020-07-24 Tuomas Halvari , Jukka K. Nurminen , Tommi Mikkonen

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

As Machine Learning (ML) gains adoption across industries and new use cases, practitioners increasingly realize the challenges around effectively developing and iterating on ML systems: reproducibility, debugging, scalability, and…

Machine Learning · Computer Science 2023-03-22 Jacopo Tagliabue , Hugo Bowne-Anderson , Ville Tuulos , Savin Goyal , Romain Cledat , David Berg

Programming Language Processing (PLP) using machine learning has made vast improvements in the past few years. Increasingly more people are interested in exploring this promising field. However, it is challenging for new researchers and…

Machine Learning · Computer Science 2023-06-19 Patrick Flynn , Tristan Vanderbruggen , Chunhua Liao , Pei-Hung Lin , Murali Emani , Xipeng Shen

While algorithmic fairness is a thriving area of research, in practice, mitigating issues of bias often gets reduced to enforcing an arbitrarily chosen fairness metric, either by enforcing fairness constraints during the optimization step,…

Machine Learning · Computer Science 2023-10-02 Emily Black , Rakshit Naidu , Rayid Ghani , Kit T. Rodolfa , Daniel E. Ho , Hoda Heidari