English
Related papers

Related papers: Dimension-Free Bounds on Chasing Convex Functions

200 papers

We study the complexity of optimizing nonsmooth nonconvex Lipschitz functions by producing $(\delta,\epsilon)$-stationary points. Several recent works have presented randomized algorithms that produce such points using $\tilde…

Machine Learning · Computer Science 2025-05-05 Michael I. Jordan , Guy Kornowski , Tianyi Lin , Ohad Shamir , Manolis Zampetakis

The aim of this paper is to study a wide class of non-convex sweeping processes with moving constraint whose translation and deformation are represented by regulated functions, i.e., functions of not necessarily bounded variation admitting…

Dynamical Systems · Mathematics 2021-01-08 Pavel Krejci , Giselle Antunes Monteiro , Vincenzo Recupero

This paper considers a class of convex optimization problems where both, the objective function and the constraints, have a continuously varying dependence on time. Our goal is to develop an algorithm to track the optimal solution as it…

Optimization and Control · Mathematics 2015-10-07 Mahyar Fazlyab , Santiago Paternain , Victor M. Preciado , Alejandro Ribeiro

The era of Big Data has spawned unprecedented interests in developing hashing algorithms for efficient storage and fast nearest neighbor search. Most existing work learn hash functions that are numeric quantizations of feature values in…

Machine Learning · Computer Science 2015-03-23 Kai Li , Guojun Qi , Jun Ye , Kien A. Hua

Linear bandit algorithms yield $\tilde{\mathcal{O}}(n\sqrt{T})$ pseudo-regret bounds on compact convex action sets $\mathcal{K}\subset\mathbb{R}^n$ and two types of structural assumptions lead to better pseudo-regret bounds. When…

Machine Learning · Computer Science 2021-03-11 Thomas Kerdreux , Christophe Roux , Alexandre d'Aspremont , Sebastian Pokutta

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

We consider the stochastic contextual bandit problem under the high dimensional linear model. We focus on the case where the action space is finite and random, with each action associated with a randomly generated contextual covariate. This…

Machine Learning · Statistics 2020-09-07 Yining Wang , Yi Chen , Ethan X. Fang , Zhaoran Wang , Runze Li

We theoretically explore the relationship between sample-efficiency and adaptivity in reinforcement learning. An algorithm is sample-efficient if it uses a number of queries $n$ to the environment that is polynomial in the dimension $d$ of…

Machine Learning · Computer Science 2024-05-29 Emmeran Johnson , Ciara Pike-Burke , Patrick Rebeschini

Bayesian Optimisation (BO) is a technique used in optimising a $D$-dimensional function which is typically expensive to evaluate. While there have been many successes for BO in low dimensions, scaling it to high dimensions has been…

Machine Learning · Statistics 2016-05-16 Kirthevasan Kandasamy , Jeff Schneider , Barnabas Poczos

We consider the problems of \emph{learning} and \emph{testing} real-valued convex functions over Gaussian space. Despite the extensive study of function convexity across mathematics, statistics, and computer science, its learnability and…

Data Structures and Algorithms · Computer Science 2025-11-17 Renato Ferreira Pinto , Cassandra Marcussen , Elchanan Mossel , Shivam Nadimpalli

Optimization of convex functions subject to eigenvalue constraints is intriguing because of peculiar analytical properties of eigenvalues, and is of practical interest because of wide range of applications in fields such as structural…

Numerical Analysis · Mathematics 2013-10-08 Emre Mengi

Recently classes of conic and discrete conic functions were introduced. In this paper we use the term convic instead conic. The class of convic functions properly includes the classes of convex functions, strictly quasiconvex functions and…

Optimization and Control · Mathematics 2020-11-03 S. I. Veselov , D. V. Gribanov , N. Yu. Zolotykh , A. Yu. Chirkov

We consider mesh functions which are discrete convex in the sense that their central second order directional derivatives are positive. Analogous to the case of a uniformly bounded sequence of convex functions, we prove that the uniform…

Numerical Analysis · Mathematics 2019-11-01 Gerard Awanou

In the setup of i.i.d.~observations and a real valued differentiable functional~$T$, locally asymptotic upper bounds are derived for the power of one-sided tests (simple, versus large values of~$T$)and for the confidence probability of…

Statistics Theory · Mathematics 2014-12-05 Helmut Rieder

Deep learning methods are known to generalize well from training to future data, even in an overparametrized regime, where they could easily overfit. One explanation for this phenomenon is that even when their *ambient dimensionality*,…

Machine Learning · Computer Science 2025-05-22 Hossein Zakerinia , Dorsa Ghobadi , Christoph H. Lampert

To study the question under which circumstances small solutions can be found faster than by exhaustive search (and by how much), we study the fine-grained complexity of Boolean constraint satisfaction with size constraint exactly $k$. More…

Computational Complexity · Computer Science 2020-05-26 Marvin Künnemann , Dániel Marx

The aim of this paper is to present an original approach that takes advantage from the geometric features of strictly convex functions to tackle the problem of finding the minimum from another perspective. The general idea is that near the…

Optimization and Control · Mathematics 2023-07-21 E. Conti

In this work, we extend the convex bodies chasing problem (CBC) to an adversarial setting, where an agent (the Player) is tasked with chasing a sequence of convex bodies generated adversarially by another agent (the Opponent). The Player…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Yue Guan , Longxu Pan , Daigo Shishika , Panagiotis Tsiotras

The Work Function Algorithm is the most effective deterministic on-line algorithm for the k-server problem. Koutsoupias and Papadimitriou proved WFA is (2k-1) competitive. However the best known implementation of WFA requires time O(i^2) to…

Data Structures and Algorithms · Computer Science 2012-03-23 Livio Colussi

We study the min-max optimization problem where each function contributing to the max operation is strongly-convex and smooth with bounded gradient in the search domain. By smoothing the max operator, we show the ability to achieve an…

Optimization and Control · Mathematics 2019-05-31 Hakan Gokcesu , Kaan Gokcesu , Suleyman Serdar Kozat
‹ Prev 1 4 5 6 7 8 10 Next ›