English
Related papers

Related papers: Projective Quadratic Regression for Online Learnin…

200 papers

This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Soroush Asri , Luis Rodrigues

The dynamic competition between radar and jammer systems presents a significant challenge for modern Electronic Warfare (EW), as current active learning approaches still lack sample efficiency and fail to exploit jammer's characteristics.…

Signal Processing · Electrical Eng. & Systems 2024-07-12 Liangqi Liu , Wenqiang Pu , Yingru Li , Bo Jiu , Zhi-Quan Luo

We investigate constrained online convex optimization, in which decisions must belong to a fixed and typically complicated domain, and are required to approximately satisfy additional time-varying constraints over the long term. In this…

Machine Learning · Computer Science 2025-01-28 Yibo Wang , Yuanyu Wan , Lijun Zhang

We introduce a novel online convex optimization (OCO) framework to estimate the user's signal-to-interference-plus-noise ratio (SINR) from ACK/NACK feedback, channel quality indicator (CQI) reports, and previously selected modulation and…

Information Theory · Computer Science 2026-03-16 Lorenzo Maggi , Boris Bonev , Reinhard Wiesmayr , Sebastian Cammerer , Alexander Keller

We address the challenge of zeroth-order online convex optimization where the objective function's gradient exhibits sparsity, indicating that only a small number of dimensions possess non-zero gradients. Our aim is to leverage this…

Collaborative Topic Regression (CTR) combines ideas of probabilistic matrix factorization (PMF) and topic modeling (e.g., LDA) for recommender systems, which has gained increasing successes in many applications. Despite enjoying many…

Machine Learning · Computer Science 2016-05-31 Chenghao Liu , Tao Jin , Steven C. H. Hoi , Peilin Zhao , Jianling Sun

We introduce the online stochastic Convex Programming (CP) problem, a very general version of stochastic online problems which allows arbitrary concave objectives and convex feasibility constraints. Many well-studied problems like online…

Machine Learning · Computer Science 2014-10-29 Shipra Agrawal , Nikhil R. Devanur

This work studies and develop projection-free algorithms for online learning with linear optimization oracles (a.k.a. Frank-Wolfe) for handling the constraint set. More precisely, this work (i) provides an improved (optimized) variant of an…

Optimization and Control · Mathematics 2026-05-20 Julien Weibel , Pierre Gaillard , Wouter M. Koolen , Adrien Taylor

We consider the setting of online convex optimization with adversarial time-varying constraints in which actions must be feasible w.r.t. a fixed constraint set, and are also required on average to approximately satisfy additional…

Machine Learning · Computer Science 2024-02-15 Dan Garber , Ben Kretzu

In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic regret when these functions are also strongly convex.…

Machine Learning · Computer Science 2021-01-01 Yihan Zhou , Victor S. Portella , Mark Schmidt , Nicholas J. A. Harvey

Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Joyce Lai , Peter Seiler

This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional online projection algorithm (Zinkevich, 2003) can be…

Optimization and Control · Mathematics 2020-05-19 Hao Yu , Michael J. Neely

Bandit convex optimization (BCO) is a general framework for online decision making under uncertainty. While tight regret bounds for general convex losses have been established, existing algorithms achieving these bounds have prohibitive…

Machine Learning · Computer Science 2024-10-04 Arun Suggala , Y. Jennifer Sun , Praneeth Netrapalli , Elad Hazan

In this paper, we introduce a new projection-free algorithm for Online Convex Optimization (OCO) with a state-of-the-art regret guarantee among separation-based algorithms. Existing projection-free methods based on the classical Frank-Wolfe…

Machine Learning · Computer Science 2024-10-08 Zakaria Mhammedi

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

Machine Learning · Computer Science 2019-10-09 Dan Garber , Ben Kretzu

This paper develops projection-free algorithms for online convex optimization with stochastic constraints. We design an online primal-dual projection-free framework that can take any projection-free algorithms developed for online convex…

Optimization and Control · Mathematics 2023-05-17 Duksang Lee , Nam Ho-Nguyen , Dabeen Lee

We study the task of $(\epsilon, \delta)$-differentially private online convex optimization (OCO). In the online setting, the release of each distinct decision or iterate carries with it the potential for privacy loss. This problem has a…

Cryptography and Security · Computer Science 2023-12-21 Naman Agarwal , Satyen Kale , Karan Singh , Abhradeep Guha Thakurta

In this paper, we study the problem of online tracking in linear control systems, where the objective is to follow a moving target. Unlike classical tracking control, the target is unknown, non-stationary, and its state is revealed…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Anastasios Tsiamis , Aren Karapetyan , Yueshan Li , Efe C. Balta , John Lygeros

The dynamic competition against intelligent jammer systems presents a significant challenge to modern radar. Traditional active anti-jamming strategy learning methods often suffer from low sample efficiency and fail to fully exploit the…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Liangqi Liu , Wenqiang Pu , Yingru Li , Zhi-Quan Luo

In this paper we propose a general framework to characterize and solve the stochastic optimization problems with multiple objectives underlying many real world learning applications. We first propose a projection based algorithm which…

Machine Learning · Computer Science 2013-07-16 Mehrdad Mahdavi , Tianbao Yang , Rong Jin