English
Related papers

Related papers: Improving Upon the generalized c-mu rule: a Whittl…

200 papers

We consider the contextual bandit problem on general action and context spaces, where the learner's rewards depend on their selected actions and an observable context. This generalizes the standard multi-armed bandit to the case where side…

Machine Learning · Statistics 2023-01-03 Moise Blanchard , Steve Hanneke , Patrick Jaillet

In this work, we study a single-machine scheduling problem that aims at minimizing the total cost of a schedule subject to start-time dependent costs. This framework naturally captures scenarios where costs fluctuate throughout the day,…

Optimization and Control · Mathematics 2026-04-17 Sofía Rodríguez-Ballesteros , Javier Alcaraz , Laura Anton-Sanchez , Marc Goerigk , Dorothee Henke

In budget-limited multi-armed bandit (MAB) problems, the learner's actions are costly and constrained by a fixed budget. Consequently, an optimal exploitation policy may not be to pull the optimal arm repeatedly, as is the case in other…

Artificial Intelligence · Computer Science 2012-04-10 Long Tran-Thanh , Archie Chapman , Alex Rogers , Nicholas R. Jennings

Scheduling problems are fundamental in combinatorial optimization. Much work has been done on approximation algorithms for NP-hard cases, but relatively little is known about exact solutions when some part of the input is a fixed parameter.…

Data Structures and Algorithms · Computer Science 2018-01-09 Dušan Knop , Martin Koutecký

Scheduling jobs with precedence constraints on a set of identical machines to minimize the total processing time (makespan) is a fundamental problem in combinatorial optimization. In practical settings such as cloud computing, jobs are…

Data Structures and Algorithms · Computer Science 2014-04-29 Konstantin Makarychev , Debmalya Panigrahi

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

Machine Learning · Statistics 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

Multi-armed bandits (MAB) model sequential decision making problems, in which a learner sequentially chooses arms with unknown reward distributions in order to maximize its cumulative reward. Most of the prior work on MAB assumes that the…

Machine Learning · Computer Science 2018-03-22 Onur Atan , Cem Tekin , Mihaela van der Schaar

This paper investigates whether a single, unified cost function can explain and predict human reaching movements, in contrast with existing approaches that rely on subject- or posture-specific optimization criteria. Using the Minimal…

Robotics · Computer Science 2026-03-10 Sarmad Mehrdad , Maxime Sabbah , Vincent Bonnet , Ludovic Righetti

Round Robin, considered as the most widely adopted CPU scheduling algorithm, undergoes severe problems directly related to quantum size. If time quantum chosen is too large, the response time of the processes is considered too high. On the…

Operating Systems · Computer Science 2011-11-24 Abbas Noon , Ali Kalakech , Seifedine Kadry

In parallel machine scheduling, we are given a set of jobs, together with a number of machines and our goal is to decide for each job, when and on which machine(s) it should be scheduled in order to minimize some objective function.…

Data Structures and Algorithms · Computer Science 2023-02-09 Klaus Jansen , Kai Kahler

In moldable job scheduling, we are provided $m$ identical machines and $n$ jobs that can be executed on a variable number of machines. The execution time of each job depends on the number of machines assigned to execute that job. For the…

Data Structures and Algorithms · Computer Science 2026-01-07 Klaus Jansen , Felix Ohnesorge

In this paper, we consider a novel variant of the multi-armed bandit (MAB) problem, MAB with cost subsidy, which models many real-life applications where the learning agent has to pay to select an arm and is concerned about optimizing…

Machine Learning · Computer Science 2021-03-16 Deeksha Sinha , Karthik Abinav Sankararama , Abbas Kazerouni , Vashist Avadhanula

The aim of this work is to present a meta-heuristically approach of the spatial assignment problem of human resources in multi-sites enterprise. Usually, this problem consists to move employees from one site to another based on one or more…

Artificial Intelligence · Computer Science 2013-11-01 Tkatek Said , Abdoun Otman , Abouchabaka Jaafar , Rafalia Najat

We study the problem of scheduling periodic real-time tasks so as to meet their individual minimum reward requirements. A task generates jobs that can be given arbitrary service times before their deadlines. A task then obtains rewards…

Other Computer Science · Computer Science 2010-07-06 I-Hong Hou , P. R. Kumar

We consider here the MultiBot problem for the scheduling and the resource parametrization of jobs related to the production or the transportation of different products inside a given time horizon. Those jobs must meet known in advance…

Data Structures and Algorithms · Computer Science 2024-01-02 Pierre Bergé , Mari Chaikovskaia , Jean-Philippe Gayon , Alain Quilliot

In this paper, we consider a general observation model for restless multi-armed bandit problems. The operation of the player is based on the past observation history that is limited (partial) and error-prone due to resource constraints or…

Machine Learning · Statistics 2025-12-17 Keqin Liu , Qizhen Jia

We study a difficult problem of how to schedule complex workflows with precedence constraints under a limited budget in the cloud environment. We first formulate the scheduling problem as an integer programming problem, which can be…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-05 Hang Zhang , Xiaoying Zheng , Ye Xia , Mingqi Li

In this paper we consider the classic scheduling problem of minimizing total weighted completion time on unrelated machines when jobs have release times, i.e, $R | r_{ij} | \sum_j w_j C_j$ using the three-field notation. For this problem, a…

Data Structures and Algorithms · Computer Science 2016-06-29 Sungjin Im , Shi Li

We consider the distributed SGD problem, where a main node distributes gradient calculations among $n$ workers. By assigning tasks to all the workers and waiting only for the $k$ fastest ones, the main node can trade-off the algorithm's…

Information Theory · Computer Science 2022-06-29 Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh , Deniz Gündüz

This paper studies an instance of the multi-armed bandit (MAB) problem, specifically where several causal MABs operate chronologically in the same dynamical system. Practically the reward distribution of each bandit is governed by the same…

Machine Learning · Statistics 2021-12-06 Neil Dhir