English
Related papers

Related papers: A Simple Learning-Augmented Algorithm for Online P…

200 papers

We propose a novel technique for algorithm-selection, applicable to optimisation domains in which there is implicit sequential information encapsulated in the data, e.g., in online bin-packing. Specifically we train two types of recurrent…

Machine Learning · Computer Science 2022-03-28 Mohamad Alissa , Kevin Sim , Emma Hart

We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and robust, meaning that the algorithm performs well when…

Machine Learning · Computer Science 2020-10-23 Alexander Wei , Fred Zhang

We introduce a new online convex optimization algorithm that adaptively chooses its regularization function based on the loss functions observed so far. This is in contrast to previous algorithms that use a fixed regularization function…

Machine Learning · Computer Science 2010-07-08 H. Brendan McMahan , Matthew Streeter

To approach different business objectives, online traffic shaping algorithms aim at improving exposures of a target set of items, such as boosting the growth of new commodities. Generally, these algorithms assume that the utility of each…

Machine Learning · Computer Science 2022-01-03 Chenlin Shen , Guangda Huzhang , Yuhang Zhou , Chen Liang , Qing Da

The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks. It is common belief that the optimizer dynamics, network…

Machine Learning · Computer Science 2022-02-18 Xinyi Chen , Edgar Minasyan , Jason D. Lee , Elad Hazan

Online optimization problems arise in many resource allocation tasks, where the future demands for each resource and the associated utility functions change over time and are not known apriori, yet resources need to be allocated at every…

Optimization and Control · Mathematics 2015-02-06 Reza Eghbali , Jon Swenson , Maryam Fazel

This paper presents fast first-order methods for solving linear programs (LPs) approximately. We adapt online linear programming algorithms to offline LPs and obtain algorithms that avoid any matrix multiplication. We also introduce a…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Dongdong Ge , Chunlin Sun , Yinyu Ye

Off-policy learning algorithms have been known to be sensitive to the choice of hyper-parameters. However, unlike near on-policy algorithms for which hyper-parameters could be optimized via e.g. meta-gradients, similar techniques could not…

Machine Learning · Computer Science 2020-06-16 Yunhao Tang , Krzysztof Choromanski

We consider the problem of black-box function optimization over the boolean hypercube. Despite the vast literature on black-box function optimization over continuous domains, not much attention has been paid to learning models for…

We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of local curvature and Lipschitz smoothness, our method dynamically adapts the search direction and step-size.…

Machine Learning · Computer Science 2021-09-14 Majid Jahani , Sergey Rusakov , Zheng Shi , Peter Richtárik , Michael W. Mahoney , Martin Takáč

We study a generalization of the advice complexity model of online computation in which the advice is provided by an untrusted source. Our objective is to quantify the impact of untrusted advice so as to design and analyze online algorithms…

Data Structures and Algorithms · Computer Science 2024-04-17 Spyros Angelopoulos , Christoph Dürr , Shendan Jin , Shahin Kamali , Marc Renault

The priority model was introduced to capture "greedy-like" algorithms. Motivated by the success of advice complexity in the area of online algorithms, the fixed priority model was extended to include advice, and a reduction-based framework…

Data Structures and Algorithms · Computer Science 2022-01-27 Joan Boyar , Kim S. Larsen , Denis Pankratov

A major technique in learning-augmented online algorithms is combining multiple algorithms or predictors. Since the performance of each predictor may vary over time, it is desirable to use not the single best predictor as a benchmark, but…

Machine Learning · Computer Science 2023-12-19 Antonios Antoniadis , Christian Coester , Marek Eliáš , Adam Polak , Bertrand Simon

Pushing is a useful robotic capability for positioning and reorienting objects. The ability to accurately predict the effect of pushes can enable efficient trajectory planning and complicated object manipulation. Physical prediction models…

Robotics · Computer Science 2019-10-21 Huidong Gao , Yi Ouyang , Masayoshi Tomizuka

Online learning algorithms are fast, memory-efficient, easy to implement, and applicable to many prediction problems, including classification, regression, and ranking. Several online algorithms were proposed in the past few decades, some…

Machine Learning · Computer Science 2015-07-03 Francesco Orabona , Koby Crammer , Nicolò Cesa-Bianchi

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive…

Numerical Analysis · Mathematics 2019-03-27 Yuhan Ding , Fred J. Hickernell , Peter Kritzer , Simon Mak

Online learning is the process of answering a sequence of questions based on the correct answers to the previous questions. It is studied in many research areas such as game theory, information theory and machine learning. There are two…

Machine Learning · Computer Science 2019-03-27 Ankit Sharma , Late C. A. Murthy

Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed…

Machine Learning · Statistics 2019-03-20 Tor Lattimore , Branislav Kveton , Shuai Li , Csaba Szepesvari

Machine learning algorithms can now outperform classic economic models in predicting quantities ranging from bargaining outcomes, to choice under uncertainty, to an individual's future jobs and wages. Yet this predictive accuracy comes at a…

Theoretical Economics · Economics 2025-08-27 Annie Liang

Decomposition is a fundamental skill in algorithmic programming, requiring learners to break down complex problems into smaller, manageable parts. However, current self-study methods, such as browsing reference solutions or using LLM…

Human-Computer Interaction · Computer Science 2025-02-27 Shuai Ma , Junling Wang , Yuanhao Zhang , Xiaojuan Ma , April Yi Wang