English
Related papers

Related papers: Automatic Pipeline Provisioning

200 papers

The pipeline optimization problem in machine learning requires simultaneous optimization of pipeline structures and parameter adaptation of their elements. Having an elegant way to express these structures can help lessen the complexity in…

Machine Learning · Computer Science 2021-07-15 Paulito P. Palmes , Akihiro Kishimoto , Radu Marinescu , Parikshit Ram , Elizabeth Daly

Bayesian decision theory outlines a rigorous framework for making optimal decisions based on maximizing expected utility over a model posterior. However, practitioners often do not have access to the full posterior and resort to approximate…

Machine Learning · Statistics 2019-10-29 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware…

Machine Learning · Computer Science 2019-03-14 Liam Li , Evan Sparks , Kevin Jamieson , Ameet Talwalkar

Aspects such as limited resources, frequently changing market demands, and different technical restrictions regarding the implementation of software requirements (features) often demand for the prioritization of requirements. The task of…

Software Engineering · Computer Science 2021-08-03 Alexander Felfernig

Fully automated astronomical data calibration and imaging pipelines are difficult to develop without a good prototyping method which permits to bridge the time between observatory commissioning and the moment when the special features and…

Instrumentation and Methods for Astrophysics · Physics 2021-12-21 Dirk Petry

In recent years, a wide variety of automated machine learning (AutoML) methods have been proposed to search and generate end-to-end learning pipelines. While these techniques facilitate the creation of models for real-world applications,…

Human-Computer Interaction · Computer Science 2020-09-07 Jorge Piazentin Ono , Sonia Castelo , Roque Lopez , Enrico Bertini , Juliana Freire , Claudio Silva

Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Aditya Kapoor , Nijil George , Vartika Sengar , Vighnesh Vatsal , Jayavardhana Gubbi

It is well understood that a system built from individually fair components may not itself be individually fair. In this work, we investigate individual fairness under pipeline composition. Pipelines differ from ordinary sequential or…

Computers and Society · Computer Science 2020-04-14 Cynthia Dwork , Christina Ilvento , Meena Jagadeesan

Compared to other transportation modes, road, railroad and vessel, multiproduct pipelines are the safest and most economical way of conveying petroleum products over long distances day and night. During the last two decades, the operational…

Differential Geometry · Mathematics 2022-03-30 Amir Baghban , Majid Yousefikhoshbakht

Automated machine learning (AutoML) aims for constructing machine learning (ML) pipelines automatically. Many studies have investigated efficient methods for algorithm selection and hyperparameter optimization. However, methods for ML…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Tien-Dung Nguyen , Marco F. Huber

The paper is devoted to studying the performance of a computational pipeline, the number of simultaneously executing stages of which at each time is bounded from above by a fixed number. A look at the restriction as a structural hazard…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-31 Ahmet A. Husainov

An essential task of Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on a given dataset. This problem has been addressed with sophisticated black-box…

Machine Learning · Computer Science 2021-11-30 Felix Mohr , Marcel Wever

Clustering analysis of daily load profiles represents an effective technique to classify and aggregate electric users based on their actual consumption patterns. Among other purposes, it may be exploited as a preliminary stage for load…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Francesca Soldan , Alberto Maldarella , Gabriele Paludetto , Enea Bionda , Federico Belloni , Samuele Grillo

The study aims to decrease gas loss and enhance system reliability during gas pipeline accidents. A computational scheme has been developed that can enable the elimination of gas leakage through the modeling and management of parallel gas…

Optimization and Control · Mathematics 2025-04-15 Ilgar Aliyev

Predictive analytics systems are currently one of the most important areas of research and development within the Artificial Intelligence domain and particularly in Machine Learning. One of the "holy grails" of predictive analytics is the…

Information Retrieval · Computer Science 2019-07-23 Laurentiu Piciu , Andrei Damian , Nicolae Tapus , Andrei Simion-Constantinescu , Bogdan Dumitrescu

This paper describes a set of tools for automating and controlling the development and maintenance of software systems. The mental model is a software assembly line. Program design and construction take place at individual programmer…

Software Engineering · Computer Science 2010-06-14 Martin J. McGowan , William L. Anderson

To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML)…

Machine Learning · Computer Science 2019-04-19 Weilin Zhou , Frederic Precioso

Machines learning techniques plays a preponderant role in dealing with massive amount of data and are employed in almost every possible domain. Building a high quality machine learning model to be deployed in production is a challenging…

Machine Learning · Computer Science 2019-07-02 Alexandre Quemy

Machine learning tasks entail the use of complex computational pipelines to reach quantitative and qualitative conclusions. If some of the activities in a pipeline produce erroneous or uninformative outputs, the pipeline may fail or produce…

Machine Learning · Computer Science 2020-02-13 Raoni Lourenço , Juliana Freire , Dennis Shasha

Data engineering pipelines are a widespread way to provide high-quality data for all kinds of data science applications. However, numerous challenges still remain in the composition and operation of such pipelines. Data engineering…

Databases · Computer Science 2025-07-30 Kevin M. Kramer , Valerie Restat , Sebastian Strasser , Uta Störl , Meike Klettke