English
Related papers

Related papers: Benchmarking Automatic Machine Learning Frameworks

200 papers

AutoML systems provide a black-box solution to machine learning problems by selecting the right way of processing features, choosing an algorithm and tuning the hyperparameters of the entire pipeline. Although these systems perform well on…

Automated machine learning (AutoML) systems aim to enable training machine learning (ML) models for non-ML experts. A shortcoming of these systems is that when they fail to produce a model with high accuracy, the user has no path to improve…

Machine Learning · Computer Science 2021-02-23 Behnaz Arzani , Kevin Hsieh , Haoxian Chen

Automated machine learning (AutoML) is a collection of techniques designed to automate the machine learning development process. While traditional AutoML approaches have been successfully applied in several critical steps of model…

Machine Learning · Computer Science 2024-12-30 Zekang Yang , Wang Zeng , Sheng Jin , Chen Qian , Ping Luo , Wentao Liu

As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexible combinations of…

Neural and Evolutionary Computing · Computer Science 2019-01-24 Fei Qi , Zhaohui Xia , Gaoyang Tang , Hang Yang , Yu Song , Guangrui Qian , Xiong An , Chunhuan Lin , Guangming Shi

Automatic Machine Learning (Auto-ML) has attracted more and more attention in recent years, our work is to solve the problem of data drift, which means that the distribution of data will gradually change with the acquisition process,…

Machine Learning · Computer Science 2019-08-30 Jinlong Chai , Jiangeng Chang , Yakun Zhao , Honggang Liu

We consider the use of automated supervised learning systems for data tables that not only contain numeric/categorical columns, but one or more text fields as well. Here we assemble 18 multimodal data tables that each contain some text…

Machine Learning · Computer Science 2021-11-05 Xingjian Shi , Jonas Mueller , Nick Erickson , Mu Li , Alexander J. Smola

In recent years, multi-agent frameworks powered by large language models (LLMs) have advanced rapidly. Despite this progress, there is still a notable absence of benchmark datasets specifically tailored to evaluate their performance. To…

Computation and Language · Computer Science 2025-04-28 Lei Shen , Xiaoyu Shen

Algorithm selection and hyperparameter tuning remain two of the most challenging tasks in machine learning. Automated machine learning (AutoML) seeks to automate these tasks to enable widespread use of machine learning by non-experts. This…

Machine Learning · Computer Science 2019-05-22 Chengrun Yang , Yuji Akimoto , Dae Won Kim , Madeleine Udell

OpenAutoNLU is an open-source automated machine learning library for natural language understanding (NLU) tasks, covering both text classification and named entity recognition (NER). Unlike existing solutions, we introduce data-aware…

Computation and Language · Computer Science 2026-03-03 Grigory Arshinov , Aleksandr Boriskin , Sergey Senichev , Ayaz Zaripov , Daria Galimzianova , Daniil Karpov , Leonid Sanochkin

Background. Due to the widespread adoption of Artificial Intelligence (AI) and Machine Learning (ML) for building software applications, companies are struggling to recruit employees with a deep understanding of such technologies. In this…

Software Engineering · Computer Science 2025-01-24 Fabio Calefato , Luigi Quaranta , Filippo Lanubile , Marcos Kalinowski

Many industry verticals are confronted with small-sized tabular data. In this low-data regime, it is currently unclear whether the best performance can be expected from simple baselines, or more complex machine learning approaches that…

Machine Learning · Computer Science 2024-05-14 Ricardo Knauer , Erik Rodner

Automated Machine Learning (AutoML) is a rapidly growing set of technologies that automate the model development pipeline by searching model space and generating candidate models. A critical, final step of AutoML is human selection of a…

Human-Computer Interaction · Computer Science 2021-04-12 Shweta Narkar , Yunfeng Zhang , Q. Vera Liao , Dakuo Wang , Justin D Weisz

We propose an AutoML system that enables model selection on clustering problems by leveraging optimal transport-based dataset similarity. Our objective is to establish a comprehensive AutoML pipeline for clustering problems and provide…

Machine Learning · Computer Science 2024-07-17 Prabhant Singh , Pieter Gijsbers , Murat Onur Yildirim , Elif Ceren Gok , Joaquin Vanschoren

AI is increasingly playing a pivotal role in businesses and organizations, impacting the outcomes and interests of human users. Automated Machine Learning (AutoML) streamlines the machine learning model development process by automating…

Human-Computer Interaction · Computer Science 2023-12-21 Sundaraparipurnan Narayanan

Intelligent Transportation Systems are producing tons of hardly manageable traffic data, which motivates the use of Machine Learning (ML) for data-driven applications, such as Traffic Forecasting (TF). TF is gaining relevance due to its…

Machine Learning · Computer Science 2023-03-21 Juan S. Angarita-Zapata , Antonio D. Masegosa , Isaac Triguero

Automatic machine learning (AutoML) is a key enabler of the mass deployment of the next generation of machine learning systems. A key desideratum for future ML systems is the automatic selection of models and hyperparameters. We present a…

Machine Learning · Computer Science 2022-02-22 Moe Kayali , Chi Wang

AutoGluon-Multimodal (AutoMM) is introduced as an open-source AutoML library designed specifically for multimodal learning. Distinguished by its exceptional ease of use, AutoMM enables fine-tuning of foundation models with just three lines…

Machine Learning · Computer Science 2024-05-02 Zhiqiang Tang , Haoyang Fang , Su Zhou , Taojiannan Yang , Zihan Zhong , Tony Hu , Katrin Kirchhoff , George Karypis

The open-source model ecosystem now contains hundreds of thousands of pretrained models, yet picking the best model for a new dataset is increasingly infeasible: new models and unbenchmarked datasets emerge continuously, leaving…

Machine Learning · Computer Science 2026-05-11 Rui Cai , Weijie Jacky Mo , Xiaofei Wen , Qiyao Ma , Wenhui Zhu , Xiwen Chen , Muhao Chen , Zhe Zhao

Medical datasets are typically affected by issues such as missing values, class imbalance, a heterogeneous feature types, and a high number of features versus a relatively small number of samples, preventing machine learning models from…

Understanding the influence of hyperparameters on the performance of a machine learning algorithm is an important scientific topic in itself and can help to improve automatic hyperparameter tuning procedures. Unfortunately, experimental…

Machine Learning · Statistics 2018-10-22 Daniel Kühn , Philipp Probst , Janek Thomas , Bernd Bischl