English
Related papers

Related papers: Understanding Algorithm Performance on an Oversubs…

200 papers

Data driven algorithm design is an important aspect of modern data science and algorithm design. Rather than using off the shelf algorithms that only have worst case performance guarantees, practitioners often optimize over large families…

Data Structures and Algorithms · Computer Science 2020-11-17 Maria-Florina Balcan

This paper studies optimal scheduling and resource allocation under allowable over-scheduling. Formulating an optimisation problem where over-scheduling is embedded, we derive an optimal solution that can be implemented by means of a new…

Optimization and Control · Mathematics 2022-04-04 Wei Ren , Eleftherios Vlahakis , Nikolaos Athanasopoulos , Raphael M. Jungers

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-21 Elli Zavou , Antonio Fernández Anta

It is well-known that proper scaling can increase the efficiency of computational problems. In this paper we define and show that a balancing technique can substantially improve the computational efficiency of optimal control algorithms. We…

Optimization and Control · Mathematics 2018-10-29 I. M. Ross , Q. Gong , M. Karpenko , R. J. Proulx

The aim of this research is twofold: Firstly, to model and solve a complex nurse scheduling problem with an integer programming formulation and evolutionary algorithms. Secondly, to detail a novel statistical method of comparing and hence…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Uwe Aickelin , Paul White

The performance of any algorithm will largely depend on the setting of its algorithm-dependent parameters. The optimal setting should allow the algorithm to achieve the best performance for solving a range of optimization problems. However,…

Optimization and Control · Mathematics 2013-12-20 Xin-She Yang , Suash Deb , M. Loomes , M. Karamanoglu

We consider a multi-agent system where agents compete for the access to the radio resource. By combining some application-level parameters, such as the resilience, with a knowledge of the radio environment, we propose a new way of modeling…

Information Theory · Computer Science 2023-02-21 Jean-Christophe Sibel , Nicolas Gresset , Vincent Corlay

Developing CPU scheduling algorithms and understanding their impact in practice can be difficult and time consuming due to the need to modify and test operating system kernel code and measure the resulting performance on a consistent…

Operating Systems · Computer Science 2013-07-17 Neetu Goel , R. B. Garg

The performance of optimizers, particularly in deep learning, depends considerably on their chosen hyperparameter configuration. The efficacy of optimizers is often studied under near-optimal problem-specific hyperparameters, and finding…

Machine Learning · Computer Science 2020-08-18 Prabhu Teja Sivaprasad , Florian Mai , Thijs Vogels , Martin Jaggi , François Fleuret

Automatic performance tuning (auto-tuning) is essential for optimizing high-performance applications, where vast and irregular search spaces make manual exploration infeasible. While auto-tuners traditionally rely on classical approaches…

Machine Learning · Computer Science 2026-04-01 Floris-Jan Willemsen , Niki van Stein , Ben van Werkhoven

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden

Scheduling with testing is a recent online problem within the framework of explorable uncertainty motivated by environments where some preliminary action can influence the duration of a task. Jobs have an unknown processing time that can be…

Data Structures and Algorithms · Computer Science 2021-08-20 Susanne Albers , Alexander Eckl

Aircraft performance models play a key role in airline operations, especially in planning a fuel-efficient flight. In practice, manufacturers provide guidelines which are slightly modified throughout the aircraft life cycle via the tuning…

Applications · Statistics 2021-02-05 Florent Dewez , Benjamin Guedj , Vincent Vandewalle

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

A different parametrization of the hyperplanes is used in the neural network algorithm. As demonstrated on several autoencoder examples it significantly outperforms the usual parametrization, reaching lower training error values with only a…

Machine Learning · Computer Science 2017-06-05 Michael F. Zimmer

Algorithm configuration methods optimize the performance of a parameterized heuristic algorithm on a given distribution of problem instances. Recent work introduced an algorithm configuration procedure ("Structured Procrastination") that…

Artificial Intelligence · Computer Science 2019-11-11 Robert Kleinberg , Kevin Leyton-Brown , Brendan Lucier , Devon Graham

Algorithm evaluation and comparison are fundamental questions in machine learning and statistics -- how well does an algorithm perform at a given modeling task, and which algorithm performs best? Many methods have been developed to assess…

Statistics Theory · Mathematics 2025-11-25 Yuetian Luo , Rina Foygel Barber

Many systems require optimisation over multiple objectives, where objectives are characteristics of the system such as energy consumed or increase in time to perform the work. Optimisation is performed by selecting the `best' set of input…

Performance · Computer Science 2019-10-08 Alexander J. M. Kell , Matthew Forshaw , A. Stephen McGough

Selecting an optimizer is a central step in the contemporary deep learning pipeline. In this paper, we demonstrate the sensitivity of optimizer comparisons to the hyperparameter tuning protocol. Our findings suggest that the hyperparameter…

Machine Learning · Computer Science 2020-06-17 Dami Choi , Christopher J. Shallue , Zachary Nado , Jaehoon Lee , Chris J. Maddison , George E. Dahl