English
Related papers

Related papers: Smoothed Online Optimization for Regression and Co…

200 papers

Motivated by the stringent safety requirements that are often present in real-world applications, we study a safe online convex optimization setting where the player needs to simultaneously achieve sublinear regret and zero constraint…

Machine Learning · Computer Science 2024-07-17 Spencer Hutchinson , Mahnoosh Alizadeh

The regret bound of dynamic online learning algorithms is often expressed in terms of the variation in the function sequence ($V_T$) and/or the path-length of the minimizer sequence after $T$ rounds. For strongly convex and smooth…

Machine Learning · Computer Science 2020-08-17 Ting-Jui Chang , Shahin Shahrampour

We consider online convex optimization (OCO) over a heterogeneous network with communication delay, where multiple workers together with a master execute a sequence of decisions to minimize the accumulation of time-varying global costs. The…

Information Theory · Computer Science 2021-07-15 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

In the field of online sequential decision-making, we address the problem with delays utilizing the framework of online convex optimization (OCO), where the feedback of a decision can arrive with an unknown delay. Unlike previous research…

Machine Learning · Computer Science 2024-02-26 Ping Wu , Heyan Huang , Zhengyang Liu

Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Joyce Lai , Peter Seiler

The dynamic competition against intelligent jammer systems presents a significant challenge to modern radar. Traditional active anti-jamming strategy learning methods often suffer from low sample efficiency and fail to fully exploit the…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Liangqi Liu , Wenqiang Pu , Yingru Li , Zhi-Quan Luo

We investigate the problem of online convex optimization with unknown delays, in which the feedback of a decision arrives with an arbitrary delay. Previous studies have presented a delayed variant of online gradient descent (OGD), and…

Machine Learning · Computer Science 2021-03-23 Yuanyu Wan , Wei-Wei Tu , Lijun Zhang

In this paper, we consider two paradigms that are developed to account for uncertainty in optimization models: robust optimization (RO) and joint estimation-optimization (JEO). We examine recent developments on efficient and scalable…

Optimization and Control · Mathematics 2018-04-16 Nam Ho-Nguyen , Fatma Kilinc-Karzan

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

We study an online learning problem on dynamic pricing and resource allocation, where we make joint pricing and inventory decisions to maximize the overall net profit. We consider the stochastic dependence of demands on the price, which…

Machine Learning · Computer Science 2025-05-23 Jianyu Xu , Xuan Wang , Yu-Xiang Wang , Jiashuo Jiang

We study Constrained Online Convex Optimization with Memory (COCO-M), where both the loss and the constraints depend on a finite window of past decisions made by the learner. This setting extends the previously studied unconstrained online…

Machine Learning · Computer Science 2026-03-24 Mohammed Abdullah , George Iosifidis , Salah Eddine Elayoubi , Tijani Chahed

To deal with complicated constraints via locally light computations in distributed online learning, a recent study has presented a projection-free algorithm called distributed online conditional gradient (D-OCG), and achieved an…

Machine Learning · Computer Science 2022-06-15 Yuanyu Wan , Guanghui Wang , Wei-Wei Tu , Lijun Zhang

In this paper, we present an improved analysis for dynamic regret of strongly convex and smooth functions. Specifically, we investigate the Online Multiple Gradient Descent (OMGD) algorithm proposed by Zhang et al. (2017). The original…

Machine Learning · Computer Science 2021-04-15 Peng Zhao , Lijun Zhang

We consider online convex optimization (OCO) with multi-slot feedback delay, where an agent makes a sequence of online decisions to minimize the accumulation of time-varying convex loss functions, subject to short-term and long-term…

Information Theory · Computer Science 2021-08-17 Juncheng Wang , Ben Liang , Min Dong , Gary Boudreau , Hatem Abou-zeid

This paper considers the online nonstochastic control problem of a linear time-invariant system under convex state and input constraints that need to be satisfied at all times. We propose an algorithm called Online Gradient Descent with…

Optimization and Control · Mathematics 2025-01-31 Nanfei Jiang , Spencer Hutchinson , Mahnoosh Alizadeh

In the random-order online set cover problem, the instance with $m$ sets and $n$ elements is chosen in a worst-case fashion, but then the elements arrive in a uniformly random order. Can this random-order model allow us to circumvent the…

Data Structures and Algorithms · Computer Science 2025-11-11 Anupam Gupta , Marco Molinaro , Matteo Russo

We study the problem of networked online convex optimization, where each agent individually decides on an action at every time step and agents cooperatively seek to minimize the total global cost over a finite horizon. The global cost is…

Optimization and Control · Mathematics 2022-07-14 Yiheng Lin , Judy Gan , Guannan Qu , Yash Kanoria , Adam Wierman

We consider online convex optimization with time-varying constraints and conduct performance analysis using two stringent metrics: dynamic regret with respect to the online solution benchmark, and hard constraint violation that does not…

Machine Learning · Computer Science 2025-01-15 Juncheng Wang , Bingjie Yan , Yituo Liu

The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the…

Machine Learning · Computer Science 2022-02-28 Nima Eshraghi , Ben Liang

We introduce a new online convex optimization algorithm that adaptively chooses its regularization function based on the loss functions observed so far. This is in contrast to previous algorithms that use a fixed regularization function…

Machine Learning · Computer Science 2010-07-08 H. Brendan McMahan , Matthew Streeter