English
Related papers

Related papers: Auto-Pipeline: Synthesizing Complex Data Pipelines…

200 papers

State-of-the-art techniques of artificial intelligence, in particular deep learning, are mostly data-driven. However, collecting and manually labeling a large scale dataset is both difficult and expensive. A promising alternative is to…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Qi Chen , Weichao Qiu , Yi Zhang , Lingxi Xie , Alan Yuille

Training LLMs to invoke tools and leverage retrieved information necessitates high-quality, diverse data. However, existing pipelines for synthetic data generation often rely on tens of thousands of real API calls to enhance generalization,…

Artificial Intelligence · Computer Science 2025-12-19 Hao Chen , Zhexin Hu , Jiajun Chai , Haocheng Yang , Hang He , Xiaohan Wang , Wei Lin , Luhang Wang , Guojun Yin , Zhuofeng zhao

To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML)…

Machine Learning · Computer Science 2019-04-19 Weilin Zhou , Frederic Precioso

In order to achieve state-of-the-art performance, modern machine learning techniques require careful data pre-processing and hyperparameter tuning. Moreover, given the ever increasing number of machine learning models being developed, model…

Machine Learning · Statistics 2018-05-03 Nicolo Fusi , Rishit Sheth , Huseyn Melih Elibol

Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware…

Machine Learning · Computer Science 2019-03-14 Liam Li , Evan Sparks , Kevin Jamieson , Ameet Talwalkar

Complex image processing and computer vision systems often consist of a processing pipeline of functional modules. We intend to replace parts or all of a target pipeline with deep neural networks to achieve benefits such as increased…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Kilho Son , Jesse Hostetler , Sek Chai

The analyst effort in data cleaning is gradually shifting away from the design of hand-written scripts to building and tuning complex pipelines of automated data cleaning libraries. Hyper-parameter tuning for data cleaning is very different…

Databases · Computer Science 2019-05-08 Sanjay Krishnan , Eugene Wu

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

In this paper, we present an automated pipeline for generating domain-specific synthetic datasets with diffusion models, addressing the distribution shift between pre-trained models and real-world deployment environments. Our three-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Dongsik Yoon , Jongeun Kim

In this survey, we systematically summarize the current literature on studies that apply reinforcement learning (RL) to the motion planning and control of autonomous vehicles. Many existing contributions can be attributed to the pipeline…

Robotics · Computer Science 2021-06-02 Fei Ye , Shen Zhang , Pin Wang , Ching-Yao Chan

AutoML systems build machine learning models automatically by performing a search over valid data transformations and learners, along with hyper-parameter optimization for each learner. Many AutoML systems use meta-learning to guide search…

Machine Learning · Computer Science 2022-07-18 Mossad Helali , Essam Mansour , Ibrahim Abdelaziz , Julian Dolby , Kavitha Srinivas

Systematic reviews, which entail the extraction of data from large numbers of scientific documents, are an ideal avenue for the application of machine learning. They are vital to many fields of science and philanthropy, but are very…

Computation and Language · Computer Science 2020-10-12 Seraphina Goldfarb-Tarrant , Alexander Robertson , Jasmina Lazic , Theodora Tsouloufi , Louise Donnison , Karen Smyth

This paper presents an example-driven synthesis technique for automating a large class of data preparation tasks that arise in data science. Given a set of input tables and an out- put table, our approach synthesizes a table transformation…

Programming Languages · Computer Science 2016-11-23 Yu Feng , Ruben Martins , Jacob Van Geffen , Isil Dillig , Swarat Chaudhuri

Automated Reinforcement Learning (AutoRL) is a relatively new area of research that is gaining increasing attention. The objective of AutoRL consists in easing the employment of Reinforcement Learning (RL) techniques for the broader public…

Machine Learning · Computer Science 2022-05-24 Marco Mussi , Davide Lombarda , Alberto Maria Metelli , Francesco Trovò , Marcello Restelli

Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize performance optimization to patterns in popular networks, they…

Machine Learning · Computer Science 2022-08-31 Oliver Rausch , Tal Ben-Nun , Nikoli Dryden , Andrei Ivanov , Shigang Li , Torsten Hoefler

Data mixing augmentation have proved to be effective in improving the generalization ability of deep neural networks. While early methods mix samples by hand-crafted policies (e.g., linear interpolation), recent methods utilize saliency…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Zicheng Liu , Siyuan Li , Di Wu , Zihan Liu , Zhiyuan Chen , Lirong Wu , Stan Z. Li

Data preprocessing is a crucial step in the machine learning process that transforms raw data into a more usable format for downstream ML models. However, it can be costly and time-consuming, often requiring the expertise of domain experts.…

Databases · Computer Science 2023-08-23 Peng Li , Zhiyi Chen , Xu Chu , Kexin Rong

The layout design of pipelines is a critical task in the construction industry. Currently, pipeline layout is designed manually by engineers, which is time-consuming and laborious. Automating and streamlining this process can reduce the…

Machine Learning · Computer Science 2023-05-19 Chen Yang , Zhe Zheng , Jia-Rui Lin

Training data is an essential resource for creating capable and robust vision systems which are integral to the proper function of many robotic systems. Synthesized training data has been shown in recent years to be a viable alternative to…

Robotics · Computer Science 2024-11-12 Peter Gavriel , Adam Norton , Kenneth Kimble , Megan Zimmerman

Automated data preparation is crucial for democratizing machine learning, yet existing reinforcement learning (RL) based approaches suffer from inefficient exploration in the vast space of possible preprocessing pipelines. We present…

Databases · Computer Science 2025-07-21 Jing Chang , Chang Liu , Jinbin Huang , Rui Mao , Jianbin Qin