English
Related papers

Related papers: Online Covering with Convex Objectives and Applica…

200 papers

In Part I of this paper, we proposed and analyzed a novel algorithmic framework for the minimization of a nonconvex (smooth) objective function, subject to nonconvex constraints, based on inner convex approximations. This Part II is devoted…

Information Theory · Computer Science 2017-04-05 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song , Stefania Sardellitti

We study the task of $(\epsilon, \delta)$-differentially private online convex optimization (OCO). In the online setting, the release of each distinct decision or iterate carries with it the potential for privacy loss. This problem has a…

Cryptography and Security · Computer Science 2023-12-21 Naman Agarwal , Satyen Kale , Karan Singh , Abhradeep Guha Thakurta

Online allocation is a broad class of problems where items arriving online have to be allocated to agents who have a fixed utility/cost for each assigned item so to maximize/minimize some objective. This framework captures a broad range of…

Computer Science and Game Theory · Computer Science 2023-05-31 Ilan Reuven Cohen , Debmalya Panigrahi

This paper introduces a dual-based algorithm framework for solving the regularized online resource allocation problems, which have potentially non-concave cumulative rewards, hard resource constraints, and a non-separable regularizer. Under…

Machine Learning · Computer Science 2023-07-18 Wanteng Ma , Ying Cao , Danny H. K. Tsang , Dong Xia

We introduce a simple but general online learning framework in which a learner plays against an adversary in a vector-valued game that changes every round. Even though the learner's objective is not convex-concave (and so the minimax…

Machine Learning · Computer Science 2022-10-14 Daniel Lee , Georgy Noarov , Mallesh Pai , Aaron Roth

We propose an online convex optimization algorithm (RescaledExp) that achieves optimal regret in the unconstrained setting without prior knowledge of any bounds on the loss functions. We prove a lower bound showing an exponential separation…

Machine Learning · Computer Science 2017-03-09 Ashok Cutkosky , Kwabena Boahen

We study a robust online convex optimization framework, where an adversary can introduce outliers by corrupting loss functions in an arbitrary number of rounds k, unknown to the learner. Our focus is on a novel setting allowing unbounded…

Machine Learning · Computer Science 2024-08-13 Adarsh Barik , Anand Krishna , Vincent Y. F. Tan

Decision problems encountered in practice often possess a highly dynamic and uncertain nature. In particular fast changing forecasts for parameters (e.g., photovoltaic generation forecasts in the context of energy management) pose large…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Jens Hönen , Johann L. Hurink , Bert Zwart

We study multi-product inventory control problems where a manager makes sequential replenishment decisions based on partial historical information in order to minimize its cumulative losses. Our motivation is to consider general demands,…

Optimization and Control · Mathematics 2026-02-27 Massil Hihat , Stéphane Gaïffas , Guillaume Garrigos , Simon Bussy

Majorization-minimization schemes are a broad class of iterative methods targeting general optimization problems, including nonconvex, nonsmooth and stochastic. These algorithms minimize successively a sequence of upper bounds of the…

Optimization and Control · Mathematics 2024-01-11 Daniela Lupu , Ion Necoara

We study Constrained Online Convex Optimization with Memory (COCO-M), where both the loss and the constraints depend on a finite window of past decisions made by the learner. This setting extends the previously studied unconstrained online…

Machine Learning · Computer Science 2026-03-24 Mohammed Abdullah , George Iosifidis , Salah Eddine Elayoubi , Tijani Chahed

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

Machine Learning · Computer Science 2019-04-05 Gautam Goel , Adam Wierman

Current online learning methods suffer issues such as lower convergence rates and limited capability to select important features compared to their offline counterparts. In this paper, a novel framework for online learning based on running…

Machine Learning · Statistics 2024-10-15 Lizhe Sun , Mingyuan Wang , Siquan Zhu , Adrian Barbu

The $\ell_p$-norm objectives for correlation clustering present a fundamental trade-off between minimizing total disagreements (the $\ell_1$-norm) and ensuring fairness to individual nodes (the $\ell_\infty$-norm). Surprisingly, in the…

Machine Learning · Computer Science 2025-10-20 Sami Davies , Benjamin Moseley , Heather Newman

Semi-online algorithms that are allowed to perform a bounded amount of repacking achieve guaranteed good worst-case behaviour in a more realistic setting. Most of the previous works focused on minimization problems that aim to minimize some…

Data Structures and Algorithms · Computer Science 2021-04-21 Sebastian Berndt , Kilian Grage , Klaus Jansen , Lukas Johannsen , Maria Kosche

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

Machine Learning · Computer Science 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

Lagrangian relaxation and approximate optimization algorithms have received much attention in the last two decades. Typically, the running time of these methods to obtain a $\epsilon$ approximate solution is proportional to…

Data Structures and Algorithms · Computer Science 2007-05-23 Elad Hazan

This research concerns a type of configuration optimization problems frequently encountered in engineering design and manufacturing, where the envelope volume in space occupied by a number of components needs to be minimized along with…

Computational Engineering, Finance, and Science · Computer Science 2017-06-13 Pei Cao , Zhaoyan Fan , Robert X. Gao , Jiong Tang

Max-norm regularizer has been extensively studied in the last decade as it promotes an effective low-rank estimation for the underlying data. However, such max-norm regularized problems are typically formulated and solved in a batch manner,…

Machine Learning · Statistics 2016-05-17 Jie Shen , Huan Xu , Ping Li

We consider online optimization in the 1-lookahead setting, where the objective does not decompose additively over the rounds of the online game. The resulting formulation enables us to deal with non-stationary and/or long-term constraints…

Machine Learning · Statistics 2016-06-09 Rodolphe Jenatton , Jim Huang , Dominik Csiba , Cedric Archambeau