English
Related papers

Related papers: Online Convex Optimization with Switching Cost and…

200 papers

Gradient-based minimax optimal algorithms have greatly promoted the development of continuous optimization and machine learning. One seminal work due to Yurii Nesterov [Nes83a] established $\tilde{\mathcal{O}}(\sqrt{L/\mu})$ gradient…

Machine Learning · Computer Science 2023-12-07 Yuanshi Liu , Hanzhen Zhao , Yang Xu , Pengyun Yue , Cong Fang

This paper considers online optimal control with affine constraints on the states and actions under linear dynamics with bounded random disturbances. The system dynamics and constraints are assumed to be known and time-invariant but the…

Systems and Control · Electrical Eng. & Systems 2021-07-14 Yingying Li , Subhro Das , Na Li

The online assignment problem plays an important role in operational research and computer science which is why immense attention has been given to improving its solution quality. Due to the incomplete information about the input, it is…

Computational Complexity · Computer Science 2022-08-09 Clarence Gabriel R. Kasilag , Pollux M. Rey , Jhoirene B. Clemente

We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the output of $\pred_t$ is…

Machine Learning · Computer Science 2021-02-16 Aadirupa Saha , Nagarajan Natarajan , Praneeth Netrapalli , Prateek Jain

In Online Learning to Rank (OLTR) the aim is to find an optimal ranking model by interacting with users. When learning from user behavior, systems must interact with users while simultaneously learning from those interactions. Unlike other…

Information Retrieval · Computer Science 2017-11-28 Harrie Oosterhuis , Maarten de Rijke

In many dynamic systems, decisions on system operation are updated over time, and the decision maker requires an online learning approach to optimize its strategy in response to the changing environment. When the loss and constraint…

Information Theory · Computer Science 2021-07-13 Juncheng Wang , Min Dong , Ben Liang , Gary Boudreau

This paper considers an online proximal-gradient method to track the minimizers of a composite convex function that may continuously evolve over time. The online proximal-gradient method is inexact, in the sense that: (i) it relies on an…

Optimization and Control · Mathematics 2020-04-24 Amirhossein Ajalloeian , Andrea Simonetto , Emiliano Dall'Anese

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

In the model of online caching with machine learned advice, introduced by Lykouris and Vassilvitskii, the goal is to solve the caching problem with an online algorithm that has access to next-arrival predictions: when each input element…

Data Structures and Algorithms · Computer Science 2019-10-31 Dhruv Rohatgi

Multi-objective optimization (MOO) is a well-studied problem for several important recommendation problems. While multiple approaches have been proposed, in this work, we focus on using constrained optimization formulations (e.g., quadratic…

Applications · Statistics 2016-02-16 Kinjal Basu , Ankan Saha , Shaunak Chatterjee

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

Machine Learning · Computer Science 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

In this paper, we treat linear quadratic team decision problems, where a team of agents minimizes a convex quadratic cost function over $T$ time steps subject to possibly distinct linear measurements of the state of nature. We assume that…

Optimization and Control · Mathematics 2022-12-23 Olle Kjellqvist , Ather Gattami

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

We consider Online Facility Location in the framework of learning-augmented online algorithms. In Online Facility Location (OFL), demands arrive one-by-one in a metric space and must be (irrevocably) assigned to an open facility upon…

Data Structures and Algorithms · Computer Science 2024-08-20 Dimitris Fotakis , Evangelia Gergatsouli , Themis Gouleakis , Nikolas Patris , Thanos Tolias

We consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained…

Machine Learning · Computer Science 2019-12-23 Deming Yuan , Alexandre Proutiere , Guodong Shi

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

We consider a decentralized convex unconstrained optimization problem, where the cost function can be decomposed into a sum of strongly convex and smooth functions, associated with individual agents, interacting over a static or…

Optimization and Control · Mathematics 2023-12-12 Dmitry Metelev , Aleksandr Beznosikov , Alexander Rogozin , Alexander Gasnikov , Anton Proskurnikov

We establish the O($\frac{1}{k}$) convergence rate for distributed stochastic gradient methods that operate over strongly convex costs and random networks. The considered class of methods is standard each node performs a weighted average of…

Optimization and Control · Mathematics 2018-03-22 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar

Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first-order methods possess a low per-iteration cost, their…

Statistics Theory · Mathematics 2026-02-06 Antoine Godichon-Baggioni , Bruno Portier , Guillaume Sallé
‹ Prev 1 8 9 10 Next ›