English
Related papers

Related papers: Automatic model training under restrictive time co…

200 papers

In this work we introduce an implementation for which machine learning techniques helped improve the overall performance of an evolutionary algorithm for an optimization problem, namely a variation of robust minimum-cost path in graphs. In…

Neural and Evolutionary Computing · Computer Science 2021-02-04 Ricardo Di Pasquale , Javier Marenco

We study the optimization of the expected long-term reward in finite partially observable Markov decision processes over the set of stationary stochastic policies. In the case of deterministic observations, also known as state aggregation,…

Optimization and Control · Mathematics 2022-11-18 Mareike Dressler , Marina Garrote-López , Guido Montúfar , Johannes Müller , Kemal Rose

Automatic machine learning performs predictive modeling with high performing machine learning tools without human interference. This is achieved by making machine learning applications parameter-free, i.e. only a dataset is provided while…

Machine Learning · Statistics 2018-07-16 Janek Thomas , Stefan Coors , Bernd Bischl

Hyperparameter tuning in machine learning algorithms is a computationally challenging task due to the large-scale nature of the problem. In order to develop an efficient strategy for hyper-parameter tuning, one promising solution is to use…

Neural and Evolutionary Computing · Computer Science 2021-12-17 Leila Zahedi , Farid Ghareh Mohammadi , M. Hadi Amini

Continual learning aims to enable models to adapt to new datasets without losing performance on previously learned data, often assuming that prior data is no longer available. However, in many practical scenarios, both old and new data are…

Machine Learning · Computer Science 2025-03-03 Eli Verwimp , Guy Hacohen , Tinne Tuytelaars

Quantum machine learning with quantum kernels for classification problems is a growing area of research. Recently, quantum kernel alignment techniques that parameterise the kernel have been developed, allowing the kernel to be trained and…

Robots performing manipulation tasks must operate under uncertainty about both their pose and the dynamics of the system. In order to remain robust to modeling error and shifts in payload dynamics, agents must simultaneously perform…

Systems and Control · Computer Science 2017-07-31 Patrick Slade , Preston Culbertson , Zachary Sunberg , Mykel Kochenderfer

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

Machine Learning · Computer Science 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

We introduce the model selection problem in pure exploration linear bandits, where the learner needs to adapt to the instance-dependent complexity measure of the smallest hypothesis class containing the true model. We design algorithms in…

Machine Learning · Statistics 2022-03-18 Yinglun Zhu , Julian Katz-Samuels , Robert Nowak

One promising approach towards effective robot decision making in complex, long-horizon tasks is to sequence together parameterized skills. We consider a setting where a robot is initially equipped with (1) a library of parameterized…

HyperParameter Optimization (HPO) aims at finding the best HyperParameters (HPs) of learning models, such as neural networks, in the fastest and most efficient way possible. Most recent HPO algorithms try to optimize HPs regardless of the…

Machine Learning · Computer Science 2023-04-11 Antoine Scardigli , Paul Fournier , Matteo Vilucchio , David Naccache

Prior research in resource scheduling for machine learning training workloads has largely focused on minimizing job completion times. Commonly, these model training workloads collectively search over a large number of parameter values that…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Richard Liaw , Romil Bhardwaj , Lisa Dunlap , Yitian Zou , Joseph Gonzalez , Ion Stoica , Alexey Tumanov

Hard optimisation problems such as Boolean Satisfiability typically have long solving times and can usually be solved by many algorithms, although the performance can vary widely in practice. Research has shown that no single algorithm…

Machine Learning · Computer Science 2019-09-10 Riccardo Volpato , Guangyan Song

We explore the idea of automatically crafting a tuning dataset for Statistical Machine Translation (SMT) that makes the hyper-parameters of the SMT system more robust with respect to some specific deficiencies of the parameter tuning…

Computation and Language · Computer Science 2017-10-03 Preslav Nakov , Stephan Vogel

With the advent of automated machine learning, automated hyperparameter optimization methods are by now routinely used in data mining. However, this progress is not yet matched by equal progress on automatic analyses that yield information…

Machine Learning · Statistics 2018-05-30 J. N. van Rijn , F. Hutter

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

In the rapidly evolving research on artificial intelligence (AI) the demand for fast, computationally efficient, and scalable solutions has increased in recent years. The problem of optimizing the computing resources for distributed machine…

Machine Learning · Computer Science 2025-10-30 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

The successful training of neural networks typically involves careful and time consuming hyperparameter tuning. Population Based Training (PBT) has recently been proposed to automate this process. PBT trains a population of neural networks…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Valentin Dalibard , Max Jaderberg

This paper shows that the optimal policy and value functions of a Markov Decision Process (MDP), either discounted or not, can be captured by a finite-horizon undiscounted Optimal Control Problem (OCP), even if based on an inexact model.…

Systems and Control · Electrical Eng. & Systems 2023-02-08 Arash Bahari Kordabad , Mario Zanon , Sebastien Gros