English
Related papers

Related papers: Production Machine Learning Pipelines: Empirical A…

200 papers

Automatic machine learning, or AutoML, holds the promise of truly democratizing the use of machine learning (ML), by substantially automating the work of data scientists. However, the huge combinatorial search space of candidate pipelines…

Machine Learning · Computer Science 2022-04-21 Ripon K. Saha , Akira Ura , Sonal Mahajan , Chenguang Zhu , Linyi Li , Yang Hu , Hiroaki Yoshida , Sarfraz Khurshid , Mukul R. Prasad

Automatic machine learning (AutoML) is an area of research aimed at automating machine learning (ML) activities that currently require human experts. One of the most challenging tasks in this field is the automatic generation of end-to-end…

Machine Learning · Computer Science 2019-11-04 Yuval Heffetz , Roman Vainstein , Gilad Katz , Lior Rokach

Embeddings are a powerful way to enrich data-driven machine learning models with the world knowledge of large language models (LLMs). Yet, there is limited evidence on how to design effective LLM-based embedding pipelines for tabular…

Machine Learning · Computer Science 2026-03-19 Oksana Kolomenko , Ricardo Knauer , Erik Rodner

Recent years have seen the emergence of machine learning (ML) workloads deployed in warehouse-scale computing (WSC) settings, also known as ML fleets. As the computational demands placed on ML fleets have increased due to the rise of large…

The rise of Big Data has led to new demands for Machine Learning (ML) systems to learn complex models with millions to billions of parameters, that promise adequate capacity to digest massive datasets and offer powerful predictive analytics…

Machine Learning · Statistics 2016-01-01 Eric P. Xing , Qirong Ho , Pengtao Xie , Wei Dai

Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware…

Machine Learning · Computer Science 2019-03-14 Liam Li , Evan Sparks , Kevin Jamieson , Ameet Talwalkar

Time series forecasting is fundamental for various use cases in different domains such as energy systems and economics. Creating a forecasting model for a specific use case requires an iterative and complex design process. The typical…

Machine Learning · Computer Science 2022-08-11 Stefan Meisenbacher , Marian Turowski , Kaleb Phipps , Martin Rätz , Dirk Müller , Veit Hagenmeyer , Ralf Mikut

Organizations rely on machine learning engineers (MLEs) to deploy models and maintain ML pipelines in production. Due to models' extensive reliance on fresh data, the operationalization of machine learning, or MLOps, requires MLEs to have…

Human-Computer Interaction · Computer Science 2024-03-26 Shreya Shankar , Rolando Garcia , Joseph M Hellerstein , Aditya G Parameswaran

Price forecasting for used construction equipment is a challenging task due to spatial and temporal price fluctuations. It is thus of high interest to automate the forecasting process based on current market data. Even though applying…

Machine Learning · Computer Science 2023-09-28 Horst Stühler , Marc-André Zöller , Dennis Klau , Alexandre Beiderwellen-Bedrikow , Christian Tutschku

Training machine learning models requires feeding input data for models to ingest. Input pipelines for machine learning jobs are often challenging to implement efficiently as they require reading large volumes of data, applying complex…

Machine Learning · Computer Science 2021-02-25 Derek G. Murray , Jiri Simsa , Ana Klimovic , Ihor Indyk

Machines learning techniques plays a preponderant role in dealing with massive amount of data and are employed in almost every possible domain. Building a high quality machine learning model to be deployed in production is a challenging…

Machine Learning · Computer Science 2019-07-02 Alexandre Quemy

Recent advancements in software and hardware technologies have enabled the use of AI/ML models in everyday applications has significantly improved the quality of service rendered. However, for a given application, finding the right AI/ML…

Machine Learning · Computer Science 2023-04-19 Haoxiang Zhang , Juliana Freire , Yash Garg

Supervised machine learning pipelines trained on features derived from persistent homology have been experimentally observed to ignore much of the information contained in a persistence diagram. Computing persistence diagrams is often the…

Machine Learning · Statistics 2025-07-11 Nicole Abreu , Parker B. Edwards , Francis Motta

Automating machine learning has achieved remarkable technological developments in recent years, and building an automated machine learning pipeline is now an essential task. The model ensemble is the technique of combining multiple models…

Machine Learning · Computer Science 2022-07-21 Yunpu Zhao , Rui Zhang , Xiaqing Li

The focus of this paper is a proof of concept, machine learning (ML) pipeline that extracts heart rate from pressure sensor data acquired on low-power edge devices. The ML pipeline consists an upsampler neural network, a signal quality…

Machine Learning · Computer Science 2022-08-18 Preetam Anbukarasu , Shailesh Nanisetty , Ganesh Tata , Nilanjan Ray

Dynamic manufacturing processes exhibit complex characteristics defined by time-varying parameters, nonlinear behaviors, and uncertainties. These characteristics require sophisticated in-situ monitoring techniques utilizing multimodal…

Machine Learning · Computer Science 2025-08-26 Suk Ki Lee , Hyunwoong Ko

The industrial machine learning pipeline requires iterating on model features, training and deploying models, and monitoring deployed models at scale. Feature stores were developed to manage and standardize the engineer's workflow in this…

Machine Learning · Computer Science 2021-08-12 Laurel Orr , Atindriyo Sanyal , Xiao Ling , Karan Goel , Megan Leszczynski

Machine learning interatomic potentials (MLIPs) have become powerful tools to extend molecular simulations beyond the limits of quantum methods, offering near-quantum accuracy at much lower computational cost. Yet, developing reliable MLIPs…

Materials Science · Physics 2025-12-30 Adam Lahouari , Jutta Rogal , Mark E. Tuckerman

The pipeline optimization problem in machine learning requires simultaneous optimization of pipeline structures and parameter adaptation of their elements. Having an elegant way to express these structures can help lessen the complexity in…

Machine Learning · Computer Science 2021-07-15 Paulito P. Palmes , Akihiro Kishimoto , Radu Marinescu , Parikshit Ram , Elizabeth Daly

Material scientists are increasingly adopting the use of machine learning (ML) for making potentially important decisions, such as, discovery, development, optimization, synthesis and characterization of materials. However, despite ML's…

Computational Physics · Physics 2019-03-12 Bhavya Kailkhura , Brian Gallagher , Sookyung Kim , Anna Hiszpanski , T. Yong-Jin Han