English
Related papers

Related papers: Task Selection for AutoML System Evaluation

200 papers

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Marco F. Huber

As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning…

Systematic task allocation to different development sites in global software de- velopment projects can open business and engineering perspectives and help to reduce risks and problems inherent in distributed development. Relying only on a…

Software Engineering · Computer Science 2014-02-04 Jürgen Münch , Ansgar Lamersdorf

Upon the significant performance of the supervised deep neural networks, conventional procedures of developing ML system are \textit{task-centric}, which aims to maximize the task accuracy. However, we scrutinized this \textit{task-centric}…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Kyung Ho Park , Hyunhee Chung , Soonwoo Kwon

Selecting techniques is a crucial element of the business analysis approach planning in IT projects. Particular attention is paid to the choice of techniques for requirements elicitation. One of the promising methods for selecting…

Software Engineering · Computer Science 2023-08-22 Denys Gobov , Olga Solovei

This paper presents a SysML-based approach to enhance functional and software development process within an industrial context. The recent changes in technology such as electromobility and increased automation in heavy construction…

Software Engineering · Computer Science 2019-06-21 Saurabh Tiwari , Emina Smajlovic , Amina Krekic , Jagadish Suryadevara

Automating machine learning has achieved remarkable technological developments in recent years, and building an automated machine learning pipeline is now an essential task. The model ensemble is the technique of combining multiple models…

Machine Learning · Computer Science 2022-07-21 Yunpu Zhao , Rui Zhang , Xiaqing Li

We propose an AutoML system that enables model selection on clustering problems by leveraging optimal transport-based dataset similarity. Our objective is to establish a comprehensive AutoML pipeline for clustering problems and provide…

Machine Learning · Computer Science 2024-07-17 Prabhant Singh , Pieter Gijsbers , Murat Onur Yildirim , Elif Ceren Gok , Joaquin Vanschoren

Automated machine learning (AutoML) has democratized the design of machine learning based systems, by automating model selection, hyperparameter tuning and feature engineering. However, the high computational cost associated with…

Machine Learning · Computer Science 2025-08-20 Edesio Alcobaça , André C. P. L. F. de Carvalho

The AutoSpeech challenge calls for automated machine learning (AutoML) solutions to automate the process of applying machine learning to speech processing tasks. These tasks, which cover a large variety of domains, will be shown to the…

Artificial Intelligence · Computer Science 2020-10-27 Jingsong Wang , Tom Ko , Zhen Xu , Xiawei Guo , Souxiang Liu , Wei-Wei Tu , Lei Xie

Automated machine learning (AutoML) and deep learning (DL) are two cutting-edge paradigms used to solve a myriad of inductive learning tasks. In spite of their successes, little guidance exists for when to choose one approach over the other…

Machine Learning · Computer Science 2021-10-25 Joseph D. Romano , Trang T. Le , Weixuan Fu , Jason H. Moore

With the emerging trend of GPT models, we have established a framework called AutoML-GPT that integrates a comprehensive set of tools and libraries. This framework grants users access to a wide range of data preprocessing techniques,…

Machine Learning · Computer Science 2023-09-06 Yun-Da Tsai , Yu-Che Tsai , Bo-Wei Huang , Chun-Pai Yang , Shou-De Lin

This work describes the selection approach and analysis of existing AutoML frameworks regarding their capability of a) incorporating Quantum Machine Learning (QML) algorithms into this automated solving approach of the AutoML framing and b)…

Machine Learning · Computer Science 2023-10-09 Dennis Klau , Marc Zöller , Christian Tutschku

Evaluating learned robot control policies to determine their physical task-level capabilities costs experimenter time and effort. The growing number of policies and tasks exacerbates this issue. It is impractical to test every policy on…

Robotics · Computer Science 2025-02-17 Abrar Anwar , Rohan Gupta , Zain Merchant , Sayan Ghosh , Willie Neiswanger , Jesse Thomason

This paper considers a distributed decision-making approach for manufacturing task assignment and condition-based machine health maintenance. Our approach considers information sharing between the task assignment and health management…

Artificial Intelligence · Computer Science 2025-10-22 Ali Nasir , Samir Mekid , Zaid Sawlan , Omar Alsawafy

A challenge that machine learning practitioners in the industry face is the task of selecting the best model to deploy in production. As a model is often an intermediate component of a production system, online controlled experiments such…

Machine Learning · Statistics 2021-05-31 Zhenwen Dai , Praveen Chandar , Ghazal Fazelnia , Ben Carterette , Mounia Lalmas-Roelleke

In this work, we propose an Automated Machine Learning (AutoML) system to search for models not only with good prediction accuracy but also fair. We first investigate the necessity and impact of unfairness mitigation in the AutoML context.…

Machine Learning · Computer Science 2022-11-28 Qingyun Wu , Chi Wang

Efforts to make machine learning more widely accessible have led to a rapid increase in Auto-ML tools that aim to automate the process of training and deploying machine learning. To understand how Auto-ML tools are used in practice today,…

Human-Computer Interaction · Computer Science 2021-01-14 Doris Xin , Eva Yiwei Wu , Doris Jung-Lin Lee , Niloufar Salehi , Aditya Parameswaran

The performance of large language models (LLMs) depends on how they are prompted, with choices spanning both the high-level prompting pattern (e.g., Zero-Shot, CoT, ReAct, ReWOO) and the specific prompt content (instructions and few-shot…

Machine Learning · Computer Science 2025-11-05 Claudio Spiess , Mandana Vaziri , Louis Mandel , Martin Hirzel

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka