English
Related papers

Related papers: Efficient Lipschitzian Global Optimization of H\"o…

200 papers

In this paper, we broaden the horizon of online convex optimization (OCO), and consider multi-objective OCO, where there are $K$ distinct loss function sequences, and an algorithm has to choose its action at time $t$, before the $K$ loss…

Machine Learning · Computer Science 2026-02-11 Rahul Vaze , Sumiran Mishra

In this paper, we investigate the online non-convex optimization problem which generalizes the classic {online convex optimization problem by relaxing the convexity assumption on the cost function. For this type of problem, the classic…

Machine Learning · Computer Science 2017-09-14 Lin Yang , Cheng Tan , Wing Shing Wong

This paper addresses Online Convex Optimization (OCO) problems where the constraints have additive perturbations that (i) vary over time and (ii) are not known at the time to make a decision. Perturbations may not be i.i.d. generated and…

Optimization and Control · Mathematics 2019-06-04 Víctor Valls , George Iosifidis , Douglas J. Leith , Leandros Tassiulas

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

Optimising queries in real-world situations under imperfect conditions is still a problem that has not been fully solved. We consider finding the optimal order in which to execute a given set of selection operators under partial ignorance…

Databases · Computer Science 2015-07-30 Khaled H. Alyoubi , Sven Helmer , Peter T. Wood

In this paper, we consider the time-varying Bayesian optimization problem. The unknown function at each time is assumed to lie in an RKHS (reproducing kernel Hilbert space) with a bounded norm. We adopt the general variation budget model to…

Machine Learning · Computer Science 2021-05-04 Xingyu Zhou , Ness Shroff

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

We study finite-time horizon continuous-time linear-quadratic reinforcement learning problems in an episodic setting, where both the state and control coefficients are unknown to the controller. We first propose a least-squares algorithm…

Optimization and Control · Mathematics 2022-06-22 Matteo Basei , Xin Guo , Anran Hu , Yufei Zhang

Multi-objective optimization studies the process of seeking multiple competing desiderata in some operation. Solution techniques highlight marginal tradeoffs associated with weighing one objective over others. In this paper, we consider…

Optimization and Control · Mathematics 2026-01-05 Allahkaram Shafiei , Jakub Marecek

The paper proposes a new algorithm for solving global univariate optimization problems. The algorithm does not require convexity of the target function. For a broad variety of target functions after performing (if necessary) several…

Optimization and Control · Mathematics 2016-01-26 Sergey Nikitin

We study an online linear optimization (OLO) problem in which the learner is provided access to $K$ "hint" vectors in each round prior to making a decision. In this setting, we devise an algorithm that obtains logarithmic regret whenever…

Machine Learning · Computer Science 2020-10-08 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit

First-order optimization methods are crucial for solving large-scale data processing problems, particularly those involving convex non-smooth composite objectives. For such problems with convex non-smooth composite objectives, we introduce…

Optimization and Control · Mathematics 2025-10-06 Endrit Dosti , Sergiy A. Vorobyov , Themistoklis Charalambous

We study online Riemannian optimization on Hadamard manifolds under the framework of horospherical convexity (h-convexity). Prior work mostly relies on the geodesic convexity (g-convexity), leading to regret bounds scaling poorly with the…

Machine Learning · Computer Science 2025-09-16 Emre Sahinoglu , Shahin Shahrampour

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations and establishes an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted…

Machine Learning · Statistics 2025-11-20 Gábor Balázs

Bayesian optimization is a principled optimization strategy for a black-box objective function. It shows its effectiveness in a wide variety of real-world applications such as scientific discovery and experimental design. In general, the…

Machine Learning · Computer Science 2024-11-11 Jungtaek Kim

We consider the setting of stochastic bandit problems with a continuum of arms. We first point out that the strategies considered so far in the literature only provided theoretical guarantees of the form: given some tuning parameters, the…

Statistics Theory · Mathematics 2011-07-18 Sébastien Bubeck , Gilles Stoltz , Jia Yuan Yu

We consider optimization of composite objective functions, i.e., of the form $f(x)=g(h(x))$, where $h$ is a black-box derivative-free expensive-to-evaluate function with vector-valued outputs, and $g$ is a cheap-to-evaluate real-valued…

Machine Learning · Statistics 2019-06-05 Raul Astudillo , Peter I. Frazier

This paper studies a natural generalization of the problem of minimizing a univariate convex function $f$ by querying its values sequentially. At each time-step $t$, the optimizer can invest a budget $b_t$ in a query point $X_t$ of their…

Optimization and Control · Mathematics 2022-09-27 François Bachoc , Tommaso Cesari , Roberto Colomboni , Andrea Paudice

We consider the problem of online combinatorial optimization under semi-bandit feedback, where a learner has to repeatedly pick actions from a combinatorial decision set in order to minimize the total losses associated with its decisions.…

Machine Learning · Computer Science 2015-06-11 Gergely Neu

Efficient global optimization is a widely used method for optimizing expensive black-box functions such as tuning hyperparameter, and designing new material, etc. Despite its popularity, less attention has been paid to analyzing the…

Optimization and Control · Mathematics 2022-09-21 Wenjie Xu , Yuning Jiang , Emilio T. Maddalena , Colin N. Jones
‹ Prev 1 8 9 10 Next ›