English
Related papers

Related papers: Bandit Convex Optimisation

200 papers

We address learning Nash equilibria in convex games under the payoff information setting. We consider the case in which the game pseudo-gradient is monotone but not necessarily strictly monotone. This relaxation of strict monotonicity…

Optimization and Control · Mathematics 2023-08-17 Tatiana Tatarenko , Maryam Kamgarpour

We consider the problem of online boosting for regression tasks, when only limited information is available to the learner. We give an efficient regret minimization method that has two implications: an online boosting algorithm with noisy…

Machine Learning · Computer Science 2020-07-24 Nataly Brukhim , Elad Hazan

Current state-of-the-art methods for solving discrete optimization problems are usually restricted to convex settings. In this paper, we propose a general approach based on cutting planes for solving nonlinear, possibly nonconvex, binary…

Optimization and Control · Mathematics 2022-03-21 Hoa T. Bui , Qun Lin , Ryan Loxton

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

Machine Learning · Computer Science 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

Optimization and Control · Mathematics 2026-04-09 Alberto De Marchi

We consider a the general online convex optimization framework introduced by Zinkevich. In this setting, there is a sequence of convex functions. Each period, we must choose a signle point (from some feasible set) and pay a cost equal to…

Machine Learning · Computer Science 2007-05-23 Abraham D. Flaxman , Adam Tauman Kalai , H. Brendan McMahan

Modern decision-making scenarios often involve data that is both high-dimensional and rich in higher-order contextual information, where existing bandits algorithms fail to generate effective policies. In response, we propose in this paper…

Machine Learning · Computer Science 2025-01-24 Jiannan Li , Yiyang Yang , Yao Wang , Shaojie Tang

Modern stochastic optimization methods often rely on uniform sampling which is agnostic to the underlying characteristics of the data. This might degrade the convergence by yielding estimates that suffer from a high variance. A possible…

Machine Learning · Statistics 2018-06-07 Zalán Borsos , Andreas Krause , Kfir Y. Levy

We study offline data poisoning attacks in contextual bandits, a class of reinforcement learning problems with important applications in online recommendation and adaptive medical treatment, among others. We provide a general attack…

Machine Learning · Computer Science 2018-08-27 Yuzhe Ma , Kwang-Sung Jun , Lihong Li , Xiaojin Zhu

This paper considers the problem of online optimization where the objective function is time-varying. In particular, we extend coordinate descent type algorithms to the online case, where the objective function varies after a finite number…

Optimization and Control · Mathematics 2024-04-26 Yankai Lin , Iman Shames , Dragan Nešić

We consider the problem of controlling a known linear dynamical system under stochastic noise, adversarially chosen costs, and bandit feedback. Unlike the full feedback setting where the entire cost function is revealed after each decision,…

Machine Learning · Computer Science 2020-07-03 Asaf Cassel , Tomer Koren

This paper provides a zeroth-order optimisation framework for non-smooth and possibly non-convex cost functions with matrix parameters that are real and symmetric. We provide complexity bounds on the number of iterations required to ensure…

Optimization and Control · Mathematics 2021-06-29 Alejandro I. Maass , Chris Manzie , Iman Shames , Hayato Nakada

Optimization is a ubiquitous modeling tool and is often deployed in settings which repeatedly solve similar instances of the same problem. Amortized optimization methods use learning to predict the solutions to problems in these settings,…

Machine Learning · Computer Science 2025-10-07 Brandon Amos

This paper introduces the notion of upper-linearizable/quadratizable functions, a class that extends concavity and DR-submodularity in various settings, including monotone and non-monotone cases over different convex sets. A general…

Optimization and Control · Mathematics 2024-11-04 Mohammad Pedramfar , Vaneet Aggarwal

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

Boosting is a popular way to derive powerful learners from simpler hypothesis classes. Following previous work (Mason et al., 1999; Friedman, 2000) on general boosting frameworks, we analyze gradient-based descent algorithms for boosting…

Machine Learning · Computer Science 2012-02-15 Alexander Grubb , J. Andrew Bagnell

We consider function optimization as a sequential decision making problem under budget constraint. This constraint limits the number of objective function evaluations allowed during the optimization. We consider an algorithm inspired by a…

Machine Learning · Computer Science 2026-05-06 Philippe Preux , Rémi Munos , Michal Valko

Recent advances in convex optimization have leveraged computer-assisted proofs to develop optimized first-order methods that improve over classical algorithms. However, each optimized method is specially tailored for a particular problem…

Optimization and Control · Mathematics 2025-07-01 Jinho Bok , Jason M. Altschuler

This paper studies a bandit optimization problem where the goal is to maximize a function $f(x)$ over $T$ periods for some unknown strongly concave function $f$. We consider a new pairwise comparison oracle, where the decision-maker chooses…

Machine Learning · Computer Science 2025-05-29 Xiangyu Chang , Xi Chen , Yining Wang , Zhiyi Zeng

We propose a new framework for black-box convex optimization which is well-suited for situations where gradient computations are expensive. We derive a new method for this framework which leverages several concepts from convex optimization,…

Optimization and Control · Mathematics 2016-02-17 Sébastien Bubeck , Yin-Tat Lee