English
Related papers

Related papers: Deep Pipeline Embeddings for AutoML

200 papers

With the booming demand for machine learning applications, it has been recognized that the number of knowledgeable data scientists can not scale with the growing data volumes and application needs in our digital world. In response to this…

Machine Learning · Computer Science 2023-04-13 Hassan Eldeeb , Mohamed Maher , Radwa Elshawi , Sherif Sakr

Recent years have witnessed an upsurge in research interests and applications of machine learning on graphs. However, manually designing the optimal machine learning algorithms for different graph datasets and tasks is inflexible,…

Input pipelines, which ingest and transform input data, are an essential part of training Machine Learning (ML) models. However, it is challenging to implement efficient input pipelines, as it requires reasoning about parallelism,…

Machine Learning · Computer Science 2022-03-22 Michael Kuchnik , Ana Klimovic , Jiri Simsa , Virginia Smith , George Amvrosiadis

The industrial machine learning pipeline requires iterating on model features, training and deploying models, and monitoring deployed models at scale. Feature stores were developed to manage and standardize the engineer's workflow in this…

Machine Learning · Computer Science 2021-08-12 Laurel Orr , Atindriyo Sanyal , Xiao Ling , Karan Goel , Megan Leszczynski

A comprehensive guide to Automated Machine Learning (AutoML) is presented, covering fundamental principles, practical implementations, and future trends. The paper is structured to assist both beginners and experienced practitioners, with…

Advances in machine learning methods for computer vision tasks have led to their consideration for safety-critical applications like autonomous driving. However, effectively integrating these methods into the automotive development…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Youssef Shoeb , Azarm Nowzad , Hanno Gottschalk

Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural network topologies, other aspects of neural network design can…

Machine Learning · Computer Science 2023-04-10 Garrett Bingham

The layout design of pipelines is a critical task in the construction industry. Currently, pipeline layout is designed manually by engineers, which is time-consuming and laborious. Automating and streamlining this process can reduce the…

Machine Learning · Computer Science 2023-05-19 Chen Yang , Zhe Zheng , Jia-Rui Lin

Motivated by the progress made by large language models (LLMs), we introduce the framework of verbalized machine learning (VML). In contrast to conventional machine learning (ML) models that are typically optimized over a continuous…

Machine Learning · Computer Science 2025-02-17 Tim Z. Xiao , Robert Bamler , Bernhard Schölkopf , Weiyang Liu

Experts in machine learning leverage domain knowledge to navigate decisions in model selection, hyperparameter optimization, and resource allocation. This is particularly critical for fine-tuning language models (LMs), where repeated trials…

Computation and Language · Computer Science 2025-10-07 Ernesto L. Estevanell-Valladares , Suilan Estevez-Velarde , Yoan Gutiérrez , Andrés Montoyo , Ruslan Mitkov

Recent Large Language Model (LLM)-based AutoML systems demonstrate impressive capabilities but face significant limitations such as constrained exploration strategies and a severe execution bottleneck. Exploration is hindered by one-shot…

Artificial Intelligence · Computer Science 2026-04-24 Stepan Kulibaba , Artem Dzhalilov , Roman Pakhomov , Oleg Svidchenko , Alexander Gasnikov , Aleksei Shpilman

In this paper, we present an end-to-end automated motion recognition (AutoMR) pipeline designed for multimodal datasets. The proposed framework seamlessly integrates data preprocessing, model training, hyperparameter tuning, and evaluation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Likun Zhang , Sicheng Yang , Zhuo Wang , Haining Liang , Junxiao Shen

Multiple Deep Neural Networks (DNNs) integrated into single Deep Learning (DL) inference pipelines e.g. Multi-Task Learning (MTL) or Ensemble Learning (EL), etc., albeit very accurate, pose challenges for edge deployment. In these systems,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Jayeeta Mondal , Swarnava Dey , Arijit Mukherjee

Machine Learning (ML) has gained popularity in actuarial research and insurance industrial applications. However, the performance of most ML tasks heavily depends on data preprocessing, model selection, and hyperparameter optimization,…

Machine Learning · Computer Science 2024-08-27 Panyi Dong , Zhiyu Quan

Deep learning has been widely applied in neuroimaging, including predicting brain-phenotype relationships from magnetic resonance imaging (MRI) volumes. MRI data usually requires extensive preprocessing prior to modeling, but variation…

Machine Learning · Computer Science 2023-10-17 Xinhui Li , Alex Fedorov , Mrinal Mathur , Anees Abrol , Gregory Kiar , Sergey Plis , Vince Calhoun

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Machine Learning · Computer Science 2024-11-28 Mark Zhao , Emanuel Adamiak , Christos Kozyrakis

Automated Machine Learning (AutoML) systems have been shown to efficiently build good models for new datasets. However, it is often not clear how well they can adapt when the data evolves over time. The main goal of this study is to…

Machine Learning · Computer Science 2022-05-11 Bilge Celik , Joaquin Vanschoren

Automated Machine Learning (AutoML) approaches encompass traditional methods that optimize fixed pipelines for model selection and ensembling, as well as newer LLM-based frameworks that autonomously build pipelines. While LLM-based agents…

Artificial Intelligence · Computer Science 2024-10-23 Yizhou Chi , Yizhang Lin , Sirui Hong , Duyi Pan , Yaying Fei , Guanghao Mei , Bangbang Liu , Tianqi Pang , Jacky Kwok , Ceyao Zhang , Bang Liu , Chenglin Wu

Automated machine learning makes it easier for data scientists to develop pipelines by searching over possible choices for hyperparameters, algorithms, and even pipeline topologies. Unfortunately, the syntax for automated machine learning…

Machine Learning · Computer Science 2020-07-07 Guillaume Baudart , Martin Hirzel , Kiran Kate , Parikshit Ram , Avraham Shinnar

As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexible combinations of…

Neural and Evolutionary Computing · Computer Science 2019-01-24 Fei Qi , Zhaohui Xia , Gaoyang Tang , Hang Yang , Yu Song , Guangrui Qian , Xiong An , Chunhuan Lin , Guangming Shi