中文
相关论文

相关论文: Simultaneous Swap Regret Minimization via KL-Calib…

200 篇论文

We consider the problem of online multiclass U-calibration, where a forecaster aims to make sequential distributional predictions over $K$ classes with low U-calibration error, that is, low regret with respect to all bounded proper losses…

机器学习 · 统计学 2024-05-31 Haipeng Luo , Spandan Senapati , Vatsal Sharan

We derive an online learning algorithm with improved regret guarantees for `easy' loss sequences. We consider two types of `easiness': (a) stochastic loss sequences and (b) adversarial loss sequences with small effective range of the…

机器学习 · 计算机科学 2019-08-28 Tobias Sommer Thune , Yevgeny Seldin

Fueled by discussions around "trustworthiness" and algorithmic fairness, calibration of predictive systems has regained scholars attention. The vanilla definition and understanding of calibration is, simply put, on all days on which the…

机器学习 · 计算机科学 2025-04-28 Rabanus Derr , Jessie Finocchiaro , Robert C. Williamson

We consider the problem of online learning in Linear Quadratic Control systems whose state transition and state-action transition matrices $A$ and $B$ may be initially unknown. We devise an online learning algorithm and provide guarantees…

机器学习 · 计算机科学 2021-09-30 Yassir Jedra , Alexandre Proutiere

Confidence calibration for classification models is vital in safety-critical decision-making scenarios and has received extensive attention. General confidence calibration methods assume training and test data are independent and…

机器学习 · 计算机科学 2026-05-22 Jinzong Dong , Zhaohui Jiang , Bo Yang

The CFR framework has been a powerful tool for solving large-scale extensive-form games in practice. However, the theoretical rate at which past CFR-based algorithms converge to the Nash equilibrium is on the order of $O(T^{-1/2})$, where…

计算机科学与博弈论 · 计算机科学 2019-02-14 Gabriele Farina , Christian Kroer , Noam Brown , Tuomas Sandholm

This work introduces a general framework for calibeating based on regret minimization. As compared to Foster and Hart's seminal calibeating work which had specialized treatments of Brier score (squared loss) and log loss, we consider a…

机器学习 · 计算机科学 2026-05-19 Maximilian Fichtl , Cristóbal Guzmán , Nishant A. Mehta

We provide consistent random algorithms for sequential decision under partial monitoring, i.e. when the decision maker does not observe the outcomes but receives instead random feedback signals. Those algorithms have no internal regret in…

机器学习 · 计算机科学 2011-02-23 Vianney Perchet

Calibration ensures that predicted uncertainties align with observed uncertainties. While there is an extensive literature on recalibration methods for univariate probabilistic forecasts, work on calibration for multivariate forecasts is…

统计方法学 · 统计学 2026-04-02 Lucas Kock , G. S. Rodrigues , Scott A. Sisson , Nadja Klein , David J. Nott

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

机器学习 · 计算机科学 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

We study the framework of universal dynamic regret minimization with strongly convex losses. We answer an open problem in Baby and Wang 2021 by showing that in a proper learning setup, Strongly Adaptive algorithms can achieve the near…

机器学习 · 计算机科学 2022-01-25 Dheeraj Baby , Yu-Xiang Wang

We consider the online sparse linear regression problem, which is the problem of sequentially making predictions observing only a limited number of features in each round, to minimize regret with respect to the best sparse linear regressor,…

机器学习 · 计算机科学 2016-03-08 Dean Foster , Satyen Kale , Howard Karloff

We study the problem of adaptive control of the stochastic linear quadratic regulator (LQR) with constraints that must be satisfied at every time step. Prior work on the multidimensional problem has shown $\tilde{O}(T^{2/3})$ regret and…

最优化与控制 · 数学 2026-05-08 Spencer Hutchinson , Nanfei Jiang , Mahnoosh Alizadeh

We study an online forecasting setting in which, over $T$ rounds, $N$ strategic experts each report a forecast to a mechanism, the mechanism selects one forecast, and then the outcome is revealed. In any given round, each expert has a…

机器学习 · 计算机科学 2025-02-18 Junpei Komiyama , Nishant A. Mehta , Ali Mortazavi

We investigate the problem of cumulative regret minimization for individual sequence prediction with respect to the best expert in a finite family of size K under limited access to information. We assume that in each round, the learner can…

统计理论 · 数学 2022-10-06 El Mehdi Saad , G. Blanchard

Recently, Daskalakis, Fishelson, and Golowich (DFG) (NeurIPS`21) showed that if all agents in a multi-player general-sum normal-form game employ Optimistic Multiplicative Weights Update (OMWU), the external regret of every player is…

A set of probabilistic forecasts is calibrated if each prediction of the forecaster closely approximates the empirical distribution of outcomes on the subset of timesteps where that prediction was made. We study the fundamental problem of…

Recent breakthrough results by Dagan, Daskalakis, Fishelson and Golowich [2023] and Peng and Rubinstein [2023] established an efficient algorithm attaining at most $\epsilon$ swap regret over extensive-form strategy spaces of dimension $N$…

计算机科学与博弈论 · 计算机科学 2025-02-14 Brian Hu Zhang , Ioannis Anagnostides , Gabriele Farina , Tuomas Sandholm

Quantile (and, more generally, KL) regret bounds, such as those achieved by NormalHedge (Chaudhuri, Freund, and Hsu 2009) and its variants, relax the goal of competing against the best individual expert to only competing against a majority…

机器学习 · 统计学 2021-11-09 Jeffrey Negrea , Blair Bilodeau , Nicolò Campolongo , Francesco Orabona , Daniel M. Roy

Motivated by alternating learning dynamics in two-player games, a recent work by Cevher et al.(2024) shows that $o(\sqrt{T})$ alternating regret is possible for any $T$-round adversarial Online Linear Optimization (OLO) problem, and left as…

机器学习 · 计算机科学 2025-06-19 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang