English
Related papers

Related papers: Predictive Online Convex Optimization

200 papers

Learning-augmented algorithms have received significant attention in recent years, particularly in the context of online optimization. Motivated by the high computational cost of generating predictions, a growing line of work studies the…

Data Structures and Algorithms · Computer Science 2026-05-27 Yongho Shin , Phanu Vajanopath

The travel demand forecasting model plays a crucial role in evaluating large-scale infrastructure projects, such as the construction of new roads or transit lines. While combined modeling approaches have been explored as a solution to…

Optimization and Control · Mathematics 2023-08-04 Youngseo Kim , Samitha Samaranayake , Damon Wischik

Online Feedback Optimization leverages properties of optimization algorithms to develop controllers for systems with limited model availability, which is often the case in process control. The interplay between the parameters of the chosen…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Marta Zagorowska , Lukas Ortmann , Giuseppe Belgioioso , Lars Imsland

In this paper, novel gradient-based online learning algorithms are developed to investigate an important environmental application: real-time river pollution source identification, which aims at estimating the released mass, location, and…

Machine Learning · Computer Science 2022-03-14 Wenjie Huang , Jing Jiang , Xiao Liu

In online convex optimization, some efficient algorithms have been designed for each of the individual classes of objective functions, e.g., convex, strongly convex, and exp-concave. However, existing regret analyses, including those of…

Optimization and Control · Mathematics 2024-12-13 Tomoya Kamijima , Shinji Ito

Pushing is a useful robotic capability for positioning and reorienting objects. The ability to accurately predict the effect of pushes can enable efficient trajectory planning and complicated object manipulation. Physical prediction models…

Robotics · Computer Science 2019-10-21 Huidong Gao , Yi Ouyang , Masayoshi Tomizuka

The goal of this work is to accelerate the identification of an unknown ARX system from trajectory data through online input design. Specifically, we present an active learning algorithm that sequentially selects the input to excite the…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Nicolas Chatzikiriakos , Bowen Song , Philipp Rank , Andrea Iannelli

Internet traffic continues to grow relentlessly, driven largely by increasingly high resolution video content. Although studies have shown that the majority of packets processed by Internet routers are pass-through traffic, they nonetheless…

Networking and Internet Architecture · Computer Science 2019-05-23 Ping Yin , Steven Diamond , Bill Lin , Stephen Boyd

Selecting the best hyperparameters for a particular optimization instance, such as the learning rate and momentum, is an important but nonconvex problem. As a result, iterative optimization methods such as hypergradient descent lack global…

Machine Learning · Computer Science 2023-12-05 Xinyi Chen , Elad Hazan

This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online…

Optimization and Control · Mathematics 2021-10-29 Killian Wood , Gianluca Bianchin , Emiliano Dall'Anese

Online and stochastic gradient methods have emerged as potent tools in large scale optimization with both smooth convex and nonsmooth convex problems from the classes $C^{1,1}(\reals^p)$ and $C^{1,0}(\reals^p)$ respectively. However to our…

Numerical Analysis · Mathematics 2014-10-30 Ziqiang Shi , Rujie Liu

Accurate uncertainty estimates are important in sequential model-based decision-making tasks such as Bayesian optimization. However, these estimates can be imperfect if the data violates assumptions made by the model (e.g., Gaussianity).…

Machine Learning · Computer Science 2024-06-27 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

We propose a new variant of AMSGrad, a popular adaptive gradient based optimization algorithm widely used for training deep neural networks. Our algorithm adds prior knowledge about the sequence of consecutive mini-batch gradients and…

Machine Learning · Statistics 2020-11-04 Jun-Kun Wang , Xiaoyun Li , Belhal Karimi , Ping Li

We introduce the online stochastic Convex Programming (CP) problem, a very general version of stochastic online problems which allows arbitrary concave objectives and convex feasibility constraints. Many well-studied problems like online…

Machine Learning · Computer Science 2014-10-29 Shipra Agrawal , Nikhil R. Devanur

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

Machine Learning · Computer Science 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

A constrained version of the online convex optimization (OCO) problem is considered. With slotted time, for each slot, first an action is chosen. Subsequently the loss function and the constraint violation penalty evaluated at the chosen…

Machine Learning · Computer Science 2023-01-25 Rahul Vaze

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

The high proportions of demand charges in electric bills motivate large-power customers to leverage energy storage for reducing the peak procurement from the outer grid. Given limited energy storage, we expect to maximize the peak-demand…

Systems and Control · Electrical Eng. & Systems 2021-08-25 Yanfang Mo , Qiulin Lin , Minghua Chen , Si-Zhao Joe Qin

The advancement of artificial intelligence has cast a new light on the development of optimization algorithm. This paper proposes to learn a two-phase (including a minimization phase and an escaping phase) global optimization algorithm for…

Machine Learning · Computer Science 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

We study distributed stochastic convex optimization under the delayed gradient model where the server nodes perform parameter updates, while the worker nodes compute stochastic gradients. We discuss, analyze, and experiment with a setup…

Machine Learning · Statistics 2015-08-21 Suvrit Sra , Adams Wei Yu , Mu Li , Alexander J. Smola