English
Related papers

Related papers: Combining Difficulty Ranking with Multi-Armed Band…

200 papers

The usability of Reinforcement Learning is restricted by the large computation times it requires. Curriculum Reinforcement Learning speeds up learning by defining a helpful order in which an agent encounters tasks, i.e. from simple to hard.…

Machine Learning · Computer Science 2023-06-12 Tobias Niehues , Ulla Scheler , Pascal Klink

Continuously learning and leveraging the knowledge accumulated from prior tasks in order to improve future performance is a long standing machine learning problem. In this paper, we study the problem in the multi-armed bandit framework with…

Machine Learning · Computer Science 2020-12-29 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet

A general framework of personalized federated multi-armed bandits (PF-MAB) is proposed, which is a new bandit paradigm analogous to the federated learning (FL) framework in supervised learning and enjoys the features of FL with…

Machine Learning · Computer Science 2021-02-26 Chengshuai Shi , Cong Shen , Jing Yang

We study the problem of best-arm identification in a distributed variant of the multi-armed bandit setting, with a central learner and multiple agents. Each agent is associated with an arm of the bandit, generating stochastic rewards…

Machine Learning · Computer Science 2023-05-02 Fathima Zarin Faizal , Adway Girish , Manjesh Kumar Hanawal , Nikhil Karamchandani

Stable matching, a classical model for two-sided markets, has long been studied with little consideration for how each side's preferences are learned. With the advent of massive online markets powered by data-driven matching platforms, it…

Machine Learning · Computer Science 2020-07-14 Lydia T. Liu , Horia Mania , Michael I. Jordan

Student diversity, like academic background, learning styles, career and life goals, ethnicity, age, social and emotional characteristics, course load and work schedule, offers unique opportunities in education, like learning new skills,…

Computers and Society · Computer Science 2022-05-02 Alex Doboli , Simona Doboli , Ryan Duke , Sangjin Hong , Wendy Tang

This paper offers a comprehensive analysis of collaborative bandit algorithms and provides a thorough comparison of their performance. Collaborative bandits aim to improve the performance of contextual bandits by introducing relationships…

Machine Learning · Computer Science 2025-10-07 Eren Ozbay , Ashkan Golgoon

We consider the problem of how a teacher algorithm can enable an unknown Deep Reinforcement Learning (DRL) student to become good at a skill over a wide range of diverse environments. To do so, we study how a teacher algorithm can learn to…

Machine Learning · Computer Science 2019-10-17 Rémy Portelas , Cédric Colas , Katja Hofmann , Pierre-Yves Oudeyer

Recommendation in Personalised Peer Learning Environments (RiPPLE) is an adaptive, crowdsourced, web-based, student-facing, open-source platform that employs exemplary techniques from the fields of machine learning, crowdsourcing, learning…

Computers and Society · Computer Science 2018-01-15 Hassan Khosravi

Traditional curriculum learning proceeds from easy to hard samples, yet defining a reliable notion of difficulty remains elusive. Prior work has used submodular functions to induce difficulty scores in curriculum learning. We reinterpret…

Machine Learning · Computer Science 2025-12-01 Prateek Chanda , Prayas Agrawal , Saral Sureka , Lokesh Reddy Polu , Atharv Kshirsagar , Ganesh Ramakrishnan

This study proposes and evaluates the PAnoramic Learning Map (PALM), a learning analytics (LA) dashboard designed to address the scalability challenges of LA by integrating curriculum-level information. Traditional LA research has…

Human-Computer Interaction · Computer Science 2026-02-04 Mahiro Ozaki , Li Chen , Shotaro Naganuma , Valdemar Švábenský , Fumiya Okubo , Atsushi Shimada

We study online learning with bandit feedback across multiple tasks, with the goal of improving average performance across tasks if they are similar according to some natural task-similarity measure. As the first to target the adversarial…

Machine Learning · Computer Science 2022-05-30 Maria-Florina Balcan , Keegan Harris , Mikhail Khodak , Zhiwei Steven Wu

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

Computer Science and Game Theory · Computer Science 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

Policy gradients-based reinforcement learning has proven to be a promising approach for directly optimizing non-differentiable evaluation metrics for language generation tasks. However, optimizing for a specific metric reward leads to…

Computation and Language · Computer Science 2020-11-17 Ramakanth Pasunuru , Han Guo , Mohit Bansal

We introduce a new stochastic multi-armed bandit setting where arms are grouped inside ``ordered'' categories. The motivating example comes from e-commerce, where a customer typically has a greater appetence for items of a specific…

Machine Learning · Computer Science 2020-05-05 Matthieu Jedor , Jonathan Louedec , Vianney Perchet

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

Machine Learning · Computer Science 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

Interactive preference elicitation (IPE) aims to substantially reduce human effort while acquiring human preferences in wide personalization systems. Dueling bandit (DB) algorithms enable optimal decision-making in IPE building on pairwise…

Machine Learning · Computer Science 2025-11-13 Shengbo Wang , Hong Sun , Ke Li

In mixed-initiative co-creation tasks, wherein a human and a machine jointly create items, it is important to provide multiple relevant suggestions to the designer. Quality-diversity algorithms are commonly used for this purpose, as they…

Neural and Evolutionary Computing · Computer Science 2023-04-18 Roberto Gallotta , Kai Arulkumaran , L. B. Soros

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

Machine Learning · Statistics 2015-08-25 Yahel David , Nahum Shimkin

Many Information Retrieval (IR) models make use of offline statistical techniques to score documents for ranking over a single period, rather than use an online, dynamic system that is responsive to users over time. In this paper, we…

Information Retrieval · Computer Science 2013-03-22 Marc Sloan , Jun Wang