English
Related papers

Related papers: Adaptive Experimentation When You Can't Experiment

200 papers

Despite their success in many domains, large language models (LLMs) remain under-studied in scenarios requiring optimal decision-making under uncertainty. This is crucial as many real-world applications, ranging from personalized…

Machine Learning · Computer Science 2025-07-15 Allen Nie , Yi Su , Bo Chang , Jonathan N. Lee , Ed H. Chi , Quoc V. Le , Minmin Chen

Consider a bandit algorithm that recommends actions to self-interested users in a recommendation system. The users are free to choose other actions and need to be incentivized to follow the algorithm's recommendations. While the users…

Machine Learning · Computer Science 2022-06-02 Xinyan Hu , Dung Daniel Ngo , Aleksandrs Slivkins , Zhiwei Steven Wu

In recent years, preference-based human feedback mechanisms have become essential for enhancing model performance across diverse applications, including conversational AI systems such as ChatGPT. However, existing approaches often neglect…

Artificial Intelligence · Computer Science 2025-02-14 Raihan Seraj , Lili Meng , Tristan Sylvain

This paper studies adaptive targeting under network interference in a bandit setting, where treatments applied to one individual may affect others through spillover effects. We consider a linear model in a sparse regime, where each…

Machine Learning · Statistics 2026-05-28 Xiaomeng Wang , Hamsa Bastani , Osbert Bastani , Zhimei Ren

Online learning algorithms, widely used to power search and content optimization on the web, must balance exploration and exploitation, potentially sacrificing the experience of current users in order to gain information that will lead to…

Machine Learning · Computer Science 2021-12-28 Manish Raghavan , Aleksandrs Slivkins , Jennifer Wortman Vaughan , Zhiwei Steven Wu

Personalized adaptive interventions offer the opportunity to increase patient benefits, however, there are challenges in their planning and implementation. Once implemented, it is an important question whether personalized adaptive…

Machine Learning · Computer Science 2023-11-27 Dominik Meier , Ipek Ensari , Stefan Konigorski

We study the problem of experiment planning with function approximation in contextual bandit problems. In settings where there is a significant overhead to deploying adaptive algorithms -- for example, when the execution of the data…

Machine Learning · Computer Science 2024-01-11 Aldo Pacchiano , Jonathan N. Lee , Emma Brunskill

We study the federated pure exploration problem of multi-armed bandits and linear bandits, where $M$ agents cooperatively identify the best arm via communicating with the central server. To enhance the robustness against latency and…

Machine Learning · Computer Science 2024-10-01 Zichen Wang , Chuanhao Li , Chenyu Song , Lianghui Wang , Quanquan Gu , Huazheng Wang

As the adoption of federated learning increases for learning from sensitive data local to user devices, it is natural to ask if the learning can be done using implicit signals generated as users interact with the applications of interest,…

Machine Learning · Computer Science 2023-03-21 Alekh Agarwal , H. Brendan McMahan , Zheng Xu

Excessively changing policies in many real world scenarios is difficult, unethical, or expensive. After all, doctor guidelines, tax codes, and price lists can only be reprinted so often. We may thus want to only change a policy when it is…

Machine Learning · Statistics 2019-10-16 Benjamin Lansdell , Sofia Triantafillou , Konrad Kording

Facing growing competition from online rivals, the retail industry is increasingly investing in their online shopping platforms to win the high-stake battle of customer' loyalty. User experience is playing an essential role in this…

Machine Learning · Computer Science 2020-06-23 Nader Bouacida , Amit Pande , Xin Liu

Contextual bandit is a general framework for online learning in sequential decision-making problems that has found application in a wide range of domains, including recommendation systems, online advertising, and clinical trials. A critical…

Machine Learning · Computer Science 2022-03-24 Evrard Garcelon , Vianney Perchet , Matteo Pirotta

Current endpointing (EP) solutions learn in a supervised framework, which does not allow the model to incorporate feedback and improve in an online setting. Also, it is a common practice to utilize costly grid-search to find the best…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Do June Min , Andreas Stolcke , Anirudh Raju , Colin Vaz , Di He , Venkatesh Ravichandran , Viet Anh Trinh

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user…

Machine Learning · Statistics 2022-08-23 Gi-Soo Kim , Hyun-Joon Yang , Jane P. Kim

We study social learning dynamics motivated by reviews on online platforms. The agents collectively follow a simple multi-armed bandit protocol, but each agent acts myopically, without regards to exploration. We allow the greedy…

Computer Science and Game Theory · Computer Science 2025-04-11 Kiarash Banihashem , MohammadTaghi Hajiaghayi , Suho Shin , Aleksandrs Slivkins

Standard bandit algorithms that assume continual reallocation of measurement effort are challenging to implement due to delayed feedback and infrastructural/organizational difficulties. Motivated by practical instances involving a handful…

Machine Learning · Computer Science 2023-08-16 Ethan Che , Hongseok Namkoong

Cascading bandit (CB) is a popular model for web search and online advertising, where an agent aims to learn the $K$ most attractive items out of a ground set of size $L$ during the interaction with a user. However, the stationary CB model…

Machine Learning · Computer Science 2020-02-18 Lingda Wang , Huozhi Zhou , Bingcong Li , Lav R. Varshney , Zhizhen Zhao

We introduce a novel approach for batch selection in Stochastic Gradient Descent (SGD) training, leveraging combinatorial bandit algorithms. Our methodology focuses on optimizing the learning process in the presence of label noise, a…

Machine Learning · Computer Science 2023-11-02 Michal Lisicki , Mihai Nica , Graham W. Taylor

In this paper, we analyze and extend an online learning framework known as Context-Attentive Bandit, motivated by various practical applications, from medical diagnosis to dialog systems, where due to observation costs only a small subset…

Machine Learning · Computer Science 2020-10-20 Djallel Bouneffouf , Raphaël Féraud , Sohini Upadhyay , Yasaman Khazaeni , Irina Rish

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai