English
Related papers

Related papers: Integral Online Algorithms for Set Cover and Load …

200 papers

We study Online Convex Optimization (OCO) with adversarial constraints, where an online algorithm must make sequential decisions to minimize both convex loss functions and cumulative constraint violations. We focus on a setting where the…

Machine Learning · Statistics 2025-03-14 Jordan Lekeufack , Michael I. Jordan

Motivated primarily by applications in cloud computing, we study a simple, yet powerful, online allocation problem in which jobs of varying durations arrive over continuous time and must be assigned immediately and irrevocably to one of the…

Data Structures and Algorithms · Computer Science 2025-06-10 Farbod Ekbatani , Yiding Feng , Ian Kash , Rad Niazadeh

Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings have catered to a rich source of research…

Quantum Physics · Physics 2026-03-16 Debbie Lim , Joao F. Doriguello , Patrick Rebentrost

We study Online Convex Optimization in the unbounded setting where neither predictions nor gradient are constrained. The goal is to simultaneously adapt to both the sequence of gradients and the comparator. We first develop parameter-free…

Machine Learning · Computer Science 2020-08-11 Zakaria Mhammedi , Wouter M. Koolen

The state-of-the-art online learning models generally conduct a single online gradient descent when a new sample arrives and thus suffer from suboptimal model weights. To this end, we introduce an online broad learning system framework with…

Machine Learning · Computer Science 2025-12-09 Chunyu Lei , Guang-Ze Chen , C. L. Philip Chen , Tong Zhang

In this paper, we analyze the problem of online convex optimization in different settings, including different feedback types (full-information/semi-bandit/bandit/etc) in either stochastic or non-stochastic setting and different notions of…

Machine Learning · Computer Science 2026-02-23 Mohammad Pedramfar , Vaneet Aggarwal

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

Though competitive analysis is often a very good tool for the analysis of online algorithms, sometimes it does not give any insight and sometimes it gives counter-intuitive results. Much work has gone into exploring other performance…

Data Structures and Algorithms · Computer Science 2017-06-14 Joan Boyar , Leah Epstein , Lene M. Favrholdt , Kim S. Larsen , Asaf Levin

In this paper, we develop an online optimization algorithm for solving a class of nonconvex optimization problems with a linearly varying optimal point. The global convergence of the algorithm is guaranteed using the circle criterion for…

Optimization and Control · Mathematics 2024-12-02 Alex Xinting Wu , Ian R. Petersen , Valery Ugrinovskii , Iman Shames

Optimization methods are at the core of many problems in signal/image processing, computer vision, and machine learning. For a long time, it has been recognized that looking at the dual of an optimization problem may drastically simplify…

Numerical Analysis · Computer Science 2014-12-04 Nikos Komodakis , Jean-Christophe Pesquet

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Cooperation between mobile robots and wireless sensor networks is a line of research that is currently attracting a lot of attention. In this context, we study the following problem of barrier coverage by stationary wireless sensors that…

Data Structures and Algorithms · Computer Science 2014-10-27 J. Czyzowicz , E. Kranakis , D. Krizanc , L. Narayanan , J. Opatrny

In this paper, we investigate the online non-convex optimization problem which generalizes the classic {online convex optimization problem by relaxing the convexity assumption on the cost function. For this type of problem, the classic…

Machine Learning · Computer Science 2017-09-14 Lin Yang , Cheng Tan , Wing Shing Wong

We study the problem of conformal prediction in a novel online framework that directly optimizes efficiency. In our problem, we are given a target miscoverage rate $\alpha > 0$, and a time horizon $T$. On each day $t \le T$ an algorithm…

Machine Learning · Computer Science 2025-10-23 Vaidehi Srinivas

Online learning algorithms are fast, memory-efficient, easy to implement, and applicable to many prediction problems, including classification, regression, and ranking. Several online algorithms were proposed in the past few decades, some…

Machine Learning · Computer Science 2015-07-03 Francesco Orabona , Koby Crammer , Nicolò Cesa-Bianchi

In the online hitting set problem, sets arrive over time, and the algorithm has to maintain a subset of elements that hit all the sets seen so far. Alon, Awerbuch, Azar, Buchbinder, and Naor (SICOMP 2009) gave an algorithm with competitive…

Data Structures and Algorithms · Computer Science 2026-03-17 Sujoy Bhore , Anupam Gupta , Amit Kumar

Motivated by display advertising on the internet, the online stochastic matching problem is proposed by Feldman, Mehta, Mirrokni, and Muthukrishnan (FOCS 2009). Consider a stochastic bipartite graph with offline vertices on one side and…

Data Structures and Algorithms · Computer Science 2022-04-15 Zhihao Gavin Tang , Hongxun Wu , Jinzhao Wu

This article provides convergence analysis of online stochastic gradient descent algorithms for functional linear models. Adopting the characterizations of the slope function regularity, the kernel space capacity, and the capacity of the…

Machine Learning · Statistics 2022-09-27 Xin Guo , Zheng-Chu Guo , Lei Shi

Online optimisation facilitates the solution of dynamic inverse problems, such as image stabilisation, fluid flow monitoring, and dynamic medical imaging. In this paper, we improve upon previous work on predictive online primal-dual methods…

Optimization and Control · Mathematics 2025-02-28 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen