中文
相关论文

相关论文: Asymptotic Convergence in Online Learning with Unb…

200 篇论文

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

机器学习 · 计算机科学 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

In this paper, we consider online learning in generalized linear contextual bandits where rewards are not immediately observed. Instead, rewards are available to the decision-maker only after some delay, which is unknown and stochastic. We…

机器学习 · 计算机科学 2020-03-12 Jose Blanchet , Renyuan Xu , Zhengyuan Zhou

This paper considers a variant of the classical online learning problem with expert predictions. Our model's differences and challenges are due to lacking any direct feedback on the loss each expert incurs at each time step $t$. We propose…

机器学习 · 计算机科学 2020-01-07 Yang Liu , David P. Helmbold

This work focuses on the setting of dynamic regret in the context of online learning with full information. In particular, we analyze regret bounds with respect to the temporal variability of the loss functions. By assuming that the…

机器学习 · 计算机科学 2021-02-16 Nicolò Campolongo , Francesco Orabona

Uncertainty quantification is crucial in safety-critical systems, where decisions must be made under uncertainty. In particular, we consider the problem of online uncertainty quantification, where data points arrive sequentially. Online…

机器学习 · 计算机科学 2026-04-21 Junyoung Yang , Kyungmin Kim , Sangdon Park

In this paper, we study the problem of efficient online reinforcement learning in the infinite horizon setting when there is an offline dataset to start with. We assume that the offline dataset is generated by an expert but with unknown…

机器学习 · 计算机科学 2024-02-05 Dengwang Tang , Rahul Jain , Botao Hao , Zheng Wen

We analyze Decentralized Online Optimization algorithms using the Performance Estimation Problem approach which allows, to automatically compute exact worst-case performance of optimization algorithms. Our analysis shows that several…

最优化与控制 · 数学 2025-09-09 Erwan Meunier , Julien M. Hendrickx

Training deep learning neural networks often requires massive amounts of computational ressources. We propose to sequentially monitor network predictions to trigger retraining only if the predictions are no longer valid. This can reduce…

统计理论 · 数学 2026-01-30 Ansgar Steland

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

机器学习 · 计算机科学 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

Thompson sampling has been shown to be an effective policy across a variety of online learning tasks. Many works have analyzed the finite time performance of Thompson sampling, and proved that it achieves a sub-linear regret under a broad…

机器学习 · 计算机科学 2020-11-10 Cem Kalkanli , Ayfer Ozgur

This work establishes the first rigorous stability guarantees for approximate predictors in delay-adaptive control of nonlinear systems, addressing a key challenge in practical implementations where exact predictors are unavailable. We…

系统与控制 · 电气工程与系统科学 2025-10-01 Luke Bhan , Miroslav Krstic , Yuanyuan Shi

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

分布式、并行与集群计算 · 计算机科学 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

We propose an Online Learning with Local Permutations (OLLP) setting, in which the learner is allowed to slightly permute the \emph{order} of the loss functions generated by an adversary. On one hand, this models natural situations where…

机器学习 · 计算机科学 2017-03-14 Ohad Shamir , Liran Szlak

Online learning algorithms have impressive convergence properties when it comes to risk minimization and convex games on very large problems. However, they are inherently sequential in their design which prevents them from taking advantage…

最优化与控制 · 数学 2009-11-04 John Langford , Alexander Smola , Martin Zinkevich

Machine learning in asset pricing typically predicts expected returns as point estimates, ignoring uncertainty. We develop new methods to construct forecast confidence intervals for expected returns obtained from neural networks. We show…

计量经济学 · 经济学 2025-03-04 Yuan Liao , Xinjie Ma , Andreas Neuhierl , Linda Schilling

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

最优化与控制 · 数学 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

We consider a variant of the classical online linear optimization problem in which at every step, the online player receives a "hint" vector before choosing the action for that round. Rather surprisingly, it was shown that if the hint…

机器学习 · 计算机科学 2020-10-05 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit

We consider non-clairvoyant scheduling with online precedence constraints, where an algorithm is oblivious to any job dependencies and learns about a job only if all of its predecessors have been completed. Given strong impossibility…

数据结构与算法 · 计算机科学 2023-01-31 Alexandra Lassota , Alexander Lindermayr , Nicole Megow , Jens Schlöter

We study online learning with oblivious losses and delays under a novel ``capacity constraint'' that limits how many past rounds can be tracked simultaneously for delayed feedback. Under ``clairvoyance'' (i.e., delay durations are revealed…

机器学习 · 计算机科学 2025-06-27 Alexander Ryabchenko , Idan Attias , Daniel M. Roy