English
Related papers

Related papers: Procrastinating with Confidence: Near-Optimal, Any…

200 papers

An acceptable response time of a server is an important aspect in many client-server applications; this is evident in situations in which the server is overloaded by many computationally intensive requests. In this work, we consider that…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-09 István Módos , Přemysl Šůcha , Roman Václavík , Jan Smejkal , Zdeněk Hanzálek

In their seminal paper that initiated the field of algorithmic mechanism design, \citet{NR99} studied the problem of designing strategyproof mechanisms for scheduling jobs on unrelated machines aiming to minimize the makespan. They provided…

Computer Science and Game Theory · Computer Science 2022-09-12 Eric Balkanski , Vasilis Gkatzelis , Xizhi Tan

Performance portability is a major concern on current architectures. One way to achieve it is by using autotuning. In this paper, we are presenting how we exten ded a just-in-time compilation infrastructure to introduce autotuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-13 Elian Morel , Camille Coti

Recently, there has been substantial interest in clustering research that takes a beyond worst-case approach to the analysis of algorithms. The typical idea is to design a clustering algorithm that outputs a near-optimal solution, provided…

Data Structures and Algorithms · Computer Science 2018-12-31 Maria-Florina Balcan , Colin White

Continual fine-tuning aims to adapt a pre-trained backbone to new tasks sequentially while preserving performance on earlier tasks whose data are no longer available. Existing approaches fall into two categories which include input- and…

Machine Learning · Computer Science 2026-03-17 Hang Thi-Thuy Le , Long Minh Bui , Minh Hoang , Trong Nghia Hoang

We study a budgeted hyper-parameter tuning problem, where we optimize the tuning result under a hard resource constraint. We propose to solve it as a sequential decision making problem, such that we can use the partial training progress of…

Machine Learning · Computer Science 2019-02-05 Zhiyun Lu , Chao-Kai Chiang , Fei Sha

In this paper we study the adaptivity of submodular maximization. Adaptivity quantifies the number of sequential rounds that an algorithm makes when function evaluations can be executed in parallel. Adaptivity is a fundamental concept that…

Data Structures and Algorithms · Computer Science 2018-04-18 Eric Balkanski , Aviad Rubinstein , Yaron Singer

The mean completion time of a stochastic process may be rendered finite and minimised by a judiciously chosen restart protocol, which may either be stochastic or deterministic. Here we study analytically an arbitrary stochastic search…

Quantitative Methods · Quantitative Biology 2016-09-14 Kabir Husain , Sandeep Krishna

Strongly adaptive algorithms are algorithms whose performance on every time interval is close to optimal. We present a reduction that can transform standard low-regret algorithms to strongly adaptive. As a consequence, we derive simple, yet…

Machine Learning · Computer Science 2015-06-22 Amit Daniely , Alon Gonen , Shai Shalev-Shwartz

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

Optimization and Control · Mathematics 2024-01-17 Michael J. Neely

Real-life parallel machine scheduling problems can be characterized by: (i) limited information about the exact task duration at scheduling time, and (ii) an opportunity to reschedule the remaining tasks each time a task processing is…

Optimization and Control · Mathematics 2023-11-22 Izack Cohen , Krzysztof Postek , Shimrit Shtern

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

We consider adaptive decision-making problems where an agent optimizes a cumulative performance objective by repeatedly choosing among a finite set of options. Compared to the classical prediction-with-expert-advice set-up, we consider…

Machine Learning · Computer Science 2023-04-10 Michael Muehlebach

We present a new method for scaling automatic configuration of computer networks. The key idea is to relax the computationally hard search problem of finding a configuration that satisfies a given specification into an approximate objective…

Networking and Internet Architecture · Computer Science 2022-11-04 Luca Beurer-Kellner , Martin Vechev , Laurent Vanbever , Petar Veličković

A key challenge in satisficing planning is to use multiple heuristics within one heuristic search. An aggregation of multiple heuristic estimates, for example by taking the maximum, has the disadvantage that bad estimates of a single…

Artificial Intelligence · Computer Science 2021-04-13 David Speck , André Biedenkapp , Frank Hutter , Robert Mattmüller , Marius Lindauer

This paper is an attempt to remedy the problem of slow convergence for first-order numerical algorithms by proposing an adaptive conditioning heuristic. First, we propose a parallelizable numerical algorithm that is capable of solving…

Optimization and Control · Mathematics 2021-03-02 Muhammad Adil , Sasan Tavakkol , Ramtin Madani

The goal of machine learning is to provide solutions which are trained by data or by experience coming from the environment. Many training algorithms exist and some brilliant successes were achieved. But even in structured environments for…

Adaptation and Self-Organizing Systems · Physics 2011-09-06 Wolfgang Konen

In this paper, we study the behavior of the Hedge algorithm in the online stochastic setting. We prove that anytime Hedge with decreasing learning rate, which is one of the simplest algorithm for the problem of prediction with expert…

Machine Learning · Statistics 2019-07-10 Jaouad Mourtada , Stéphane Gaïffas

Optimization lies at the heart of machine learning and signal processing. Contemporary approaches based on the stochastic gradient method are non-adaptive in the sense that their implementation employs prescribed parameter values that need…

Optimization and Control · Mathematics 2020-01-22 Frank E. Curtis , Katya Scheinberg

We formulate and study a fundamental search and detection problem, Schedule Optimization, motivated by a variety of real-world applications, ranging from monitoring content changes on the web, social networks, and user activities to…

Data Structures and Algorithms · Computer Science 2015-09-11 Ahmad Mahmoody , Evgenios M. Kornaropoulos , Eli Upfal