English
Related papers

Related papers: Prior-Agnostic Robust Forecast Aggregation

200 papers

We study probabilistic prediction games when the underlying model is misspecified, investigating the consequences of predicting using an incorrect parametric model. We show that for a broad class of loss functions and parametric families of…

Machine Learning · Statistics 2021-02-02 Annie Marsden , John Duchi , Gregory Valiant

A rich line of recent work has studied distributionally robust learning approaches that seek to learn a hypothesis that performs well, in the worst-case, on many different distributions over a population. We argue that although the most…

Machine Learning · Computer Science 2024-05-10 Jabari Hastings , Christopher Jung , Charlotte Peale , Vasilis Syrgkanis

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

Stochastic and adversarial data are two widely studied settings in online learning. But many optimization tasks are neither i.i.d. nor fully adversarial, which makes it of fundamental interest to get a better theoretical understanding of…

Machine Learning · Computer Science 2022-06-09 Sarah Sachs , Hédi Hadiji , Tim van Erven , Cristóbal Guzmán

Regret has been widely adopted as the metric of choice for evaluating the performance of online optimization algorithms for distributed, multi-agent systems. However, data/model variations associated with agents can significantly impact…

Machine Learning · Computer Science 2022-09-22 Zhanhong Jiang , Aditya Balu , Xian Yeow Lee , Young M. Lee , Chinmay Hegde , Soumik Sarkar

In the classic expert problem, $\Phi$-regret measures the gap between the learner's total loss and that achieved by applying the best action transformation $\phi \in \Phi$. A recent work by Lu et al., [2025] introduces an adaptive algorithm…

Machine Learning · Computer Science 2025-12-16 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

We consider the setting of online logistic regression and consider the regret with respect to the 2-ball of radius B. It is known (see [Hazan et al., 2014]) that any proper algorithm which has logarithmic regret in the number of samples…

Machine Learning · Computer Science 2020-11-04 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We establish that an optimistic variant of Q-learning applied to a fixed-horizon episodic Markov decision process with an aggregated state representation incurs regret $\tilde{\mathcal{O}}(\sqrt{H^5 M K} + \epsilon HK)$, where $H$ is the…

Machine Learning · Statistics 2020-02-20 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

We study a class of adversarial bandit optimization problems in which the loss functions may be non-convex and non-smooth. In each round, the learner observes a loss that consists of an underlying linear component together with an…

Machine Learning · Computer Science 2026-03-30 Zhuoyu Cheng , Kohei Hatano , Eiji Takimoto

In many real-world applications, it is hard to provide a reward signal in each step of a Reinforcement Learning (RL) process and more natural to give feedback when an episode ends. To this end, we study the recently proposed model of RL…

Machine Learning · Computer Science 2024-05-15 Asaf Cassel , Haipeng Luo , Aviv Rosenberg , Dmitry Sotnikov

Recent advances in uncertainty quantification increasingly emphasise the distinction between aleatory and epistemic uncertainty in machine learning, motivating the need for more unified frameworks. However, despite much progress in…

Machine Learning · Computer Science 2026-05-26 Yu Chen , Scott Ferson

We study the problem of making predictions of an adversarially chosen high-dimensional state that are unbiased subject to an arbitrary collection of conditioning events, with the goal of tailoring these events to downstream decision makers.…

Machine Learning · Computer Science 2023-10-30 Georgy Noarov , Ramya Ramalingam , Aaron Roth , Stephan Xie

We develop a new approach to obtaining high probability regret bounds for online learning with bandit feedback against an adaptive adversary. While existing approaches all require carefully constructing optimistic and biased loss…

Machine Learning · Computer Science 2020-11-02 Chung-Wei Lee , Haipeng Luo , Chen-Yu Wei , Mengxiao Zhang

We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have…

Machine Learning · Computer Science 2013-04-02 Jean-Yves Audibert , Sébastien Bubeck , Gábor Lugosi

Recent advances, such as RegretNet, ALGnet, RegretFormer and CITransNet, use deep learning to approximate optimal multi item auctions by relaxing incentive compatibility (IC) and measuring its violation via ex post regret. However, the true…

Computer Science and Game Theory · Computer Science 2026-01-21 Shuyuan You , Zhiqiang Zhuang , Kewen Wang , Zhe Wang

In this paper, we focus on a theory-practice gap for Adam and its variants (AMSgrad, AdamNC, etc.). In practice, these algorithms are used with a constant first-order moment parameter $\beta_{1}$ (typically between $0.9$ and $0.99$). In…

Machine Learning · Statistics 2020-03-24 Ahmet Alacaoglu , Yura Malitsky , Panayotis Mertikopoulos , Volkan Cevher

This paper investigates the challenges of optimal online policy learning under missing data. State-of-the-art algorithms implicitly assume that rewards are always observable. I show that when rewards are missing at random, the Upper…

Econometrics · Economics 2025-07-29 Filippo Palomba

The ``prediction + optimal control'' scheme has shown good performance in many applications of automotive, traffic, robot, and building control. In practice, the prediction results are simply considered correct in the optimal control design…

Systems and Control · Electrical Eng. & Systems 2024-05-07 Xiangrui Zeng , Cheng Yin , Zhouping Yin

Which classes can be learned properly in the online model? -- that is, by an algorithm that at each round uses a predictor from the concept class. While there are simple and natural cases where improper learning is necessary, it is natural…

Machine Learning · Computer Science 2021-02-03 Steve Hanneke , Roi Livni , Shay Moran

This paper studies the safe reinforcement learning problem formulated as an episodic finite-horizon tabular constrained Markov decision process with an unknown transition kernel and stochastic reward and cost functions. We propose a…

Machine Learning · Computer Science 2024-10-15 Kihyun Yu , Duksang Lee , William Overman , Dabeen Lee
‹ Prev 1 4 5 6 7 8 10 Next ›