English
Related papers

Related papers: Instance-Dependent Bounds for Zeroth-order Lipschi…

200 papers

We consider integer programming problems in standard form $\max \{c^Tx : Ax = b, \, x\geq 0, \, x \in Z^n\}$ where $A \in Z^{m \times n}$, $b \in Z^m$ and $c \in Z^n$. We show that such an integer program can be solved in time $(m…

Discrete Mathematics · Computer Science 2019-06-10 Friedrich Eisenbrand , Robert Weismantel

We propose a first order algorithm, a modified version of FISTA, to solve an optimization problem with an objective function that is a sum of a possibly nonconvex function, with Lipschitz continuous gradient, and a convex function which can…

Optimization and Control · Mathematics 2025-08-20 Chee-Khian Sim

We consider the optimization problem for a shape cost functional $F(\Omega,f)$ which depends on a domain $\Omega$ varying in a suitable admissible class and on a "right-hand side" $f$. More precisely, the cost functional $F$ is given by an…

Optimization and Control · Mathematics 2016-05-18 José Carlos Bellido , Giuseppe Buttazzo , Bozhidar Velichkov

In this paper, Lipschitz univariate constrained global optimization problems where both the objective function and constraints can be multiextremal are considered. The constrained problem is reduced to a discontinuous unconstrained problem…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Domenico Famularo , Paolo Pugliese

This paper studies a natural generalization of the problem of minimizing a univariate convex function $f$ by querying its values sequentially. At each time-step $t$, the optimizer can invest a budget $b_t$ in a query point $X_t$ of their…

Optimization and Control · Mathematics 2022-09-27 François Bachoc , Tommaso Cesari , Roberto Colomboni , Andrea Paudice

We study the problem of differentially private stochastic convex optimization (DP-SCO) with heavy-tailed gradients, where we assume a $k^{\text{th}}$-moment bound on the Lipschitz constants of sample functions rather than a uniform bound.…

Data Structures and Algorithms · Computer Science 2024-06-06 Hilal Asi , Daogao Liu , Kevin Tian

Stochastic zeroth-order (SZO), or gradient-free, optimization allows to optimize arbitrary functions by relying only on function evaluations under parameter perturbations, however, the iteration complexity of SZO methods suffers a factor…

Machine Learning · Statistics 2020-11-11 Artem Sokolov , Julian Hitschler , Mayumi Ohta , Stefan Riezler

The Lipschitz bandit is a key variant of stochastic bandit problems where the expected reward function satisfies a Lipschitz condition with respect to an arm metric space. With its wide-ranging practical applications, various Lipschitz…

Machine Learning · Computer Science 2025-11-25 Bongsoo Yi , Yue Kang , Yao Li

We formulate an affine invariant implementation of the accelerated first-order algorithm in Nesterov (1983). Its complexity bound is proportional to an affine invariant regularity constant defined with respect to the Minkowski gauge of the…

Optimization and Control · Mathematics 2016-11-29 Alexandre d'Aspremont , Cristóbal Guzmán , Martin Jaggi

Despite its important applications in Machine Learning, min-max optimization of nonconvex-nonconcave objectives remains elusive. Not only are there no known first-order methods converging even to approximate local min-max points, but the…

Computational Complexity · Computer Science 2020-09-22 Constantinos Daskalakis , Stratis Skoulakis , Manolis Zampetakis

We consider the variational discretization of a linear-quadratic optimal control problem with pointwise control and state constraints. In order to allow for a Fr\'echet smooth norm, the problem is reformulated by means of a reflexive…

Optimization and Control · Mathematics 2010-08-24 Morten Vierling

Several recent works have proposed instance-dependent upper bounds on the number of episodes needed to identify, with probability $1-\delta$, an $\varepsilon$-optimal policy in finite-horizon tabular Markov Decision Processes (MDPs). These…

Machine Learning · Statistics 2023-11-13 Aymen Al-Marjani , Andrea Tirinzoni , Emilie Kaufmann

We study the kernelized bandit problem, that involves designing an adaptive strategy for querying a noisy zeroth-order-oracle to efficiently learn about the optimizer of an unknown function $f$ with a norm bounded by $M<\infty$ in a…

Machine Learning · Computer Science 2022-03-15 Shubhanshu Shekhar , Tara Javidi

We show that convex-concave Lipschitz stochastic saddle point problems (also known as stochastic minimax optimization) can be solved under the constraint of $(\epsilon,\delta)$-differential privacy with \emph{strong (primal-dual) gap} rate…

Machine Learning · Computer Science 2023-06-30 Raef Bassily , Cristóbal Guzmán , Michael Menart

We consider the stability of Robust Optimization problems with respect to perturbations in their uncertainty sets. We focus on Linear Optimization problems, including those with a possibly infinite number of constraints, also known as…

Optimization and Control · Mathematics 2015-09-23 Timothy C. Y. Chan , Philip Allen Mar

We study risk-aware offline policy learning, aiming to learn a decision rule from logged data that is optimal under general risk criteria. This problem is crucial in high-stakes domains where online interaction is infeasible and adverse…

Machine Learning · Statistics 2026-05-18 Yilong Wan , Yuqiang Li , Xianyi Wu

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

Best-Fit is one of the most prominent and practically used algorithms for the bin packing problem, where a set of items with associated sizes needs to be packed in the minimum number of unit-capacity bins. Kenyon [SODA '96] studied online…

Data Structures and Algorithms · Computer Science 2024-01-10 Anish Hebbar , Arindam Khan , K. V. N. Sreenivas

Lipschitz decomposition is a useful tool in the design of efficient algorithms involving metric spaces. While many bounds are known for different families of finite metrics, the optimal parameters for $n$-point subsets of $\ell_p$, for $p >…

Computational Geometry · Computer Science 2026-02-23 Robert Krauthgamer , Nir Petruschka

We consider a version of the continuum armed bandit where an action induces a filtered realisation of a non-homogeneous Poisson process. Point data in the filtered sample are then revealed to the decision-maker, whose reward is the total…

Machine Learning · Computer Science 2020-07-21 James A. Grant , Roberto Szechtman
‹ Prev 1 4 5 6 7 8 10 Next ›