English
Related papers

Related papers: Two-stage Optimization for Machine Learning Workfl…

200 papers

Machine learning is disruptive. At the same time, machine learning can only succeed by collaboration among many parties in multiple steps naturally as pipelines in an eco-system, such as collecting data for possible machine learning…

Machine Learning · Computer Science 2021-08-19 Zicun Cong , Xuan Luo , Pei Jian , Feida Zhu , Yong Zhang

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Automated machine learning (AutoML) frameworks have become important tools in the data scientists' arsenal, as they dramatically reduce the manual work devoted to the construction of ML pipelines. Such frameworks intelligently search among…

Machine Learning · Computer Science 2024-12-31 Teddy Lazebnik , Amit Somech , Abraham Itzhak Weinberg

Building effective machine learning (ML) workflows to address complex tasks is a primary focus of the Automatic ML (AutoML) community and a critical step toward achieving artificial general intelligence (AGI). Recently, the integration of…

Machine Learning · Computer Science 2024-12-30 Yang Gu , Hengyu You , Jian Cao , Muran Yu , Haoran Fan , Shiyou Qian

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

This paper provides a short overview of how to use machine learning to build data-driven models in fluid mechanics. The process of machine learning is broken down into five stages: (1) formulating a problem to model, (2) collecting and…

Fluid Dynamics · Physics 2021-10-06 Steven L. Brunton

As data science continues to grow in popularity, there will be an increasing need to make data science tools more scalable, flexible, and accessible. In particular, automated machine learning (AutoML) systems seek to automate the process of…

Neural and Evolutionary Computing · Computer Science 2016-08-01 Randal S. Olson , Jason H. Moore

We propose an approach based on machine learning to solve two-stage linear adaptive robust optimization (ARO) problems with binary here-and-now variables and polyhedral uncertainty sets. We encode the optimal here-and-now decisions, the…

Machine Learning · Computer Science 2026-04-21 Dimitris Bertsimas , Cheol Woo Kim

As a human choosing a supervised learning algorithm, it is natural to begin by reading a text description of the dataset and documentation for the algorithms you might use. We demonstrate that the same idea improves the performance of…

Machine Learning · Computer Science 2019-10-10 Iddo Drori , Lu Liu , Yi Nian , Sharath C. Koorathota , Jie S. Li , Antonio Khalil Moretti , Juliana Freire , Madeleine Udell

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Machine Learning · Computer Science 2024-11-28 Mark Zhao , Emanuel Adamiak , Christos Kozyrakis

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

Machine learning (ML) methods have been developing rapidly, but configuring and selecting proper methods to achieve a desired performance is increasingly difficult and tedious. To address this challenge, automated machine learning (AutoML)…

Artificial Intelligence · Computer Science 2024-02-28 Zhenqian Shen , Yongqi Zhang , Lanning Wei , Huan Zhao , Quanming Yao

Machine learning (ML) pipeline composition and optimisation have been studied to seek multi-stage ML models, i.e. preprocessor-inclusive, that are both valid and well-performing. These processes typically require the design and traversal of…

Machine Learning · Computer Science 2021-05-04 Tien-Dung Nguyen , David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

Price forecasting for used construction equipment is a challenging task due to spatial and temporal price fluctuations. It is thus of high interest to automate the forecasting process based on current market data. Even though applying…

Machine Learning · Computer Science 2023-09-28 Horst Stühler , Marc-André Zöller , Dennis Klau , Alexandre Beiderwellen-Bedrikow , Christian Tutschku

Trace clustering has been extensively used to preprocess event logs. By grouping similar behavior, these techniques guide the identification of sub-logs, producing more understandable models and conformance analytics. Nevertheless, little…

Machine Learning · Computer Science 2021-09-03 Sylvio Barbon , Paolo Ceravolo , Ernesto Damiani , Gabriel Marques Tavares

Organizations rely on machine learning engineers (MLEs) to operationalize ML, i.e., deploy and maintain ML pipelines in production. The process of operationalizing ML, or MLOps, consists of a continual loop of (i) data collection and…

Software Engineering · Computer Science 2022-09-20 Shreya Shankar , Rolando Garcia , Joseph M. Hellerstein , Aditya G. Parameswaran

Motivated by the current research in data centers and cloud computing, we study the problem of scheduling a set of two-stage jobs on multiple two-stage flowshops. A new formulation for configurations of such scheduling is proposed, which…

Data Structures and Algorithms · Computer Science 2018-01-30 Guangwei Wu , Jianer Chen , Jianxin Wang

This work formulates the machine learning mechanism as a bi-level optimization problem. The inner level optimization loop entails minimizing a properly chosen loss function evaluated on the training data. This is nothing but the…

Machine Learning · Computer Science 2023-01-27 Maziar Raissi

We address the challenge of optimizing meta-parameters (hyperparameters) in machine learning, a key factor for efficient training and high model performance. Rather than relying on expensive meta-parameter search methods, we introduce…

Machine Learning · Computer Science 2025-07-10 Arsalan Sharifnassab , Saber Salehkaleybar , Richard Sutton

Machine learning (ML) is now commonplace, powering data-driven applications in various organizations. Unlike the traditional perception of ML in research, ML production pipelines are complex, with many interlocking analytical components…

Databases · Computer Science 2021-03-31 Doris Xin , Hui Miao , Aditya Parameswaran , Neoklis Polyzotis