English
Related papers

Related papers: Adaptive Experimentation with Delayed Binary Feedb…

200 papers

Modern recommendation systems ought to benefit by probing for and learning from delayed feedback. Research has tended to focus on learning from a user's response to a single recommendation. Such work, which leverages methods of supervised…

Information Retrieval · Computer Science 2023-08-01 Zheqing Zhu , Benjamin Van Roy

The article is devoted to investigating the application of hedging strategies to online expert weight allocation under delayed feedback. As the main result, we develop the General Hedging algorithm $\mathcal{G}$ based on the exponential…

Machine Learning · Computer Science 2019-06-25 Alexander Korotin , Vladimir V'yugin , Evgeny Burnaev

The stochastic generalised linear bandit is a well-understood model for sequential decision-making problems, with many algorithms achieving near-optimal regret guarantees under immediate feedback. However, the stringent requirement for…

Machine Learning · Computer Science 2023-04-12 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

When the agent's observations or interactions are delayed, classic reinforcement learning tools usually fail. In this paper, we propose a simple yet new and efficient solution to this problem. We assume that, in the undelayed environment,…

Machine Learning · Computer Science 2022-05-12 Pierre Liotet , Davide Maran , Lorenzo Bisi , Marcello Restelli

This paper presents a new algorithm for neural contextual bandits (CBs) that addresses the challenge of delayed reward feedback, where the reward for a chosen action is revealed after a random, unknown delay. This scenario is common in…

Machine Learning · Computer Science 2025-04-17 Mohammadali Moghimi , Sharu Theresa Jose , Shana Moothedath

Reinforcement learning typically assumes that agents observe feedback for their actions immediately, but in many real-world applications (like recommendation systems) feedback is observed in delay. This paper studies online learning in…

Machine Learning · Computer Science 2021-12-16 Tal Lancewicki , Aviv Rosenberg , Yishay Mansour

Online structured prediction is a task of sequentially predicting outputs with complex structures based on inputs and past observations, encompassing online classification. Recent studies showed that in the full-information setting, we can…

Machine Learning · Computer Science 2026-01-06 Yuki Shibukawa , Taira Tsuchiya , Shinsaku Sakaue , Kenji Yamanishi

We study the stochastic Multi-Armed Bandit (MAB) problem with random delays in the feedback received by the algorithm. We consider two settings: the reward-dependent delay setting, where realized delays may depend on the stochastic rewards,…

Machine Learning · Computer Science 2021-06-07 Tal Lancewicki , Shahar Segal , Tomer Koren , Yishay Mansour

In this paper, we consider online learning in generalized linear contextual bandits where rewards are not immediately observed. Instead, rewards are available to the decision-maker only after some delay, which is unknown and stochastic. We…

Machine Learning · Computer Science 2020-03-12 Jose Blanchet , Renyuan Xu , Zhengyuan Zhou

Stochastic delays in feedback lead to unstable sequential learning using multi-armed bandits. Recently, empirical Bayesian shrinkage has been shown to improve reward estimation in bandit learning. Here, we propose a novel adaptation to…

Machine Learning · Computer Science 2021-06-23 Srivas Chennu , Jamie Martin , Puli Liyanagama , Phil Mohr

Human decision-making is strongly influenced by cognitive biases, particularly under conditions of uncertainty and risk. While prior work has examined bias in single-step decisions with immediate outcomes and in human interaction with a…

Human-Computer Interaction · Computer Science 2026-03-25 Teerthaa Parakh , Karen M. Feigh

There are many algorithms for regret minimisation in episodic reinforcement learning. This problem is well-understood from a theoretical perspective, providing that the sequences of states, actions and rewards associated with each episode…

Machine Learning · Computer Science 2023-04-07 Benjamin Howson , Ciara Pike-Burke , Sarah Filippi

Standard bandit algorithms that assume continual reallocation of measurement effort are challenging to implement due to delayed feedback and infrastructural/organizational difficulties. Motivated by practical instances involving a handful…

Machine Learning · Computer Science 2023-08-16 Ethan Che , Hongseok Namkoong

One of the difficulties of conversion rate (CVR) prediction is that the conversions can delay and take place long after the clicks. The delayed feedback poses a challenge: fresh data are beneficial to continuous training but may not have…

Machine Learning · Computer Science 2021-08-13 Siyu Gu , Xiang-Rong Sheng , Ying Fan , Guorui Zhou , Xiaoqiang Zhu

We study the stochastic combinatorial semi-bandit problem with unrestricted feedback delays under merit-based fairness constraints. This is motivated by applications such as crowdsourcing, and online advertising, where immediate feedback is…

Machine Learning · Computer Science 2024-07-30 Ziqun Chen , Kechao Cai , Zhuoyue Chen , Jinbei Zhang , John C. S. Lui

Decision-making problems of sequential nature, where decisions made in the past may have an impact on the future, are used to model many practically important applications. In some real-world applications, feedback about a decision is…

Machine Learning · Computer Science 2023-03-02 Ronald C. van den Broek , Rik Litjens , Tobias Sagis , Luc Siecker , Nina Verbeeke , Pratik Gajane

Contextual dueling bandits form a cornerstone of preference-based decision-making, with critical applications in recommender systems and large language model alignment. However, standard algorithms rely on the idealized assumption of…

Machine Learning · Computer Science 2026-05-27 Xiangyi Wang , Pingchen Lu , Jie Mao , Mingze Kong , Zhi Hong , Zhiyong Wang , Zhongxiang Dai

In many real-world sequential decision-making problems, an action does not immediately reflect on the feedback and spreads its effects over a long time frame. For instance, in online advertising, investing in a platform produces an…

Machine Learning · Computer Science 2023-05-31 Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Real-world experiments involve batched & delayed feedback, non-stationarity, multiple objectives & constraints, and (often some) personalization. Tailoring adaptive methods to address these challenges on a per-problem basis is infeasible,…

Machine Learning · Computer Science 2024-11-11 Ethan Che , Daniel R. Jiang , Hongseok Namkoong , Jimmy Wang

Scientific experimentation is largely driven by statistical hypothesis testing to determine significant differences in interventions. Traditionally, experimenters allocate samples uniformly between each intervention. However, such an…