English
Related papers

Related papers: Auto-Pipeline: Synthesizing Complex Data Pipelines…

200 papers

Automated machine learning (AutoML) aims for constructing machine learning (ML) pipelines automatically. Many studies have investigated efficient methods for algorithm selection and hyperparameter optimization. However, methods for ML…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Tien-Dung Nguyen , Marco F. Huber

Automatic machine learning (AutoML) is an area of research aimed at automating machine learning (ML) activities that currently require human experts. One of the most challenging tasks in this field is the automatic generation of end-to-end…

Machine Learning · Computer Science 2019-11-04 Yuval Heffetz , Roman Vainstein , Gilad Katz , Lior Rokach

Automatic machine learning is an important problem in the forefront of machine learning. The strongest AutoML systems are based on neural networks, evolutionary algorithms, and Bayesian optimization. Recently AlphaD3M reached…

Machine Learning · Computer Science 2019-05-27 Iddo Drori , Yamuna Krishnamurthy , Raoni Lourenco , Remi Rampin , Kyunghyun Cho , Claudio Silva , Juliana Freire

Automatic machine learning, or AutoML, holds the promise of truly democratizing the use of machine learning (ML), by substantially automating the work of data scientists. However, the huge combinatorial search space of candidate pipelines…

Machine Learning · Computer Science 2022-04-21 Ripon K. Saha , Akira Ura , Sonal Mahajan , Chenguang Zhu , Linyi Li , Yang Hu , Hiroaki Yoshida , Sarfraz Khurshid , Mukul R. Prasad

Relational tables, where each row corresponds to an entity and each column corresponds to an attribute, have been the standard for tables in relational databases. However, such a standard cannot be taken for granted when dealing with tables…

Databases · Computer Science 2023-08-10 Peng Li , Yeye He , Cong Yan , Yue Wang , Surajit Chaudhuri

Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for…

Machine Learning · Computer Science 2021-05-04 Xudong Sun , Jiali Lin , Bernd Bischl

This paper proposes a knowledge-driven AutoML architecture for pipeline and deep feature synthesis. The main goal is to render the AutoML process explainable and to leverage domain knowledge in the synthesis of pipelines and features. The…

Machine Learning · Computer Science 2023-11-30 Corneliu Cofaru , Johan Loeckx

Over the past decade, data science and machine learning has grown from a mysterious art form to a staple tool across a variety of fields in academia, business, and government. In this paper, we introduce the concept of tree-based pipeline…

Machine Learning · Computer Science 2016-02-01 Randal S. Olson , Ryan J. Urbanowicz , Peter C. Andrews , Nicole A. Lavender , La Creis Kidd , Jason H. Moore

Automated Machine Learning (AutoML) is a promising direction for democratizing AI by automatically deploying Machine Learning systems with minimal human expertise. The core technical challenge behind AutoML is optimizing the pipelines of…

Machine Learning · Computer Science 2023-05-26 Sebastian Pineda Arango , Josif Grabocka

Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Aditya Kapoor , Nijil George , Vartika Sengar , Vighnesh Vatsal , Jayavardhana Gubbi

Feature preprocessing, which transforms raw input features into numerical representations, is a crucial step in automated machine learning (AutoML) systems. However, the existing systems often have a very small search space for feature…

Machine Learning · Computer Science 2023-03-01 Diego Martinez , Daochen Zha , Qiaoyu Tan , Xia Hu

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

An insufficient number of training samples is a common problem in neural network applications. While data augmentation methods require at least a minimum number of samples, we propose a novel, rendering-based pipeline for synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Andreas Spruck , Maximilane Gruber , Anatol Maier , Denise Moussa , Jürgen Seiler , Christian Riess , André Kaup

As the field of data science continues to grow, there will be an ever-increasing demand for tools that make machine learning accessible to non-experts. In this paper, we introduce the concept of tree-based pipeline optimization for…

Neural and Evolutionary Computing · Computer Science 2016-03-22 Randal S. Olson , Nathan Bartley , Ryan J. Urbanowicz , Jason H. Moore

Modern approach to artificial intelligence (AI) aims to design algorithms that learn directly from data. This approach has achieved impressive results and has contributed significantly to the progress of AI, particularly in the sphere of…

Machine Learning · Computer Science 2024-03-20 Alhassan Mumuni , Fuseini Mumuni

Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training dataset. Yet, depending…

Machine Learning · Computer Science 2023-10-17 Felix Neutatz , Marius Lindauer , Ziawasch Abedjan

Data preparation is a foundational yet notoriously challenging component of the machine learning lifecycle, characterized by a vast combinatorial search space. While reinforcement learning (RL) offers a promising direction, state-of-the-art…

Databases · Computer Science 2025-07-29 Jing Chang , Chang Liu , Jinbin Huang , Shuyuan Zheng , Rui Mao , Jianbin Qin

The aim of this study is to investigate an automated industrial manipulation pipeline, where assembly tasks can be flexibly adapted to production without the need for a robotic expert, both for the vision system and the robot program. The…

Robotics · Computer Science 2024-04-02 Alireza Barekatain , Hamed Rahimi Nohooji , Holger Voos

Automated data preparation pipeline construction is critical for machine learning success, yet existing methods suffer from two fundamental limitations: they treat pipeline construction as black-box optimization without quantifying…

Databases · Computer Science 2025-11-03 Jing Chang , Chang Liu , Jinbin Huang , Shuyuan Zheng , Rui Mao , Jianbin Qin

Table processing-including cleaning, transformation, augmentation, and matching-is a foundational yet error-prone stage in real-world data pipelines. While recent LLM-based approaches show promise for automating such tasks, they often…

Artificial Intelligence · Computer Science 2026-05-13 Wei Liu , Yang Gu , Xi Yan , Zihan Nan , Beicheng Xu , Keyao Ding , Bin Cui , Wentao Zhang
‹ Prev 1 2 3 10 Next ›