English
Related papers

Related papers: EduQate: Generating Adaptive Curricula through RMA…

200 papers

Contemporary real-time video communication systems, such as WebRTC, use an adaptive bitrate (ABR) algorithm to assure high-quality and low-delay services, e.g., promptly adjusting video bitrate according to the instantaneous network…

Multimedia · Computer Science 2023-08-08 Yueheng Li , Zicheng Zhang , Hao Chen , Zhan Ma

Document Question Answering (DQA) involves generating answers from a document based on a user's query, representing a key task in document understanding. This task requires interpreting visual layouts, which has prompted recent studies to…

Computation and Language · Computer Science 2026-04-17 Yixin Xiang , Yunshan Ma , Xiaoyu Du , Yibing Chen , Yanxin Zhang , Jinhui Tang

When a reinforcement learning (RL) method has to decide between several optional policies by solely looking at the received reward, it has to implicitly optimize a Multi-Armed-Bandit (MAB) problem. This arises the question: are current RL…

Machine Learning · Computer Science 2021-10-22 Refael Vivanti

In many online decision processes, the optimizing agent is called to choose between large numbers of alternatives with many inherent similarities; in turn, these similarities imply closely correlated losses that may confound standard…

Machine Learning · Computer Science 2022-06-22 Matthieu Martin , Panayotis Mertikopoulos , Thibaud Rahier , Houssam Zenati

Multi-Armed Bandit (MAB) algorithms are widely used in recommender systems that require continuous, incremental learning. A core aspect of MABs is the exploration-exploitation trade-off: choosing between exploiting items likely to be…

Machine Learning · Computer Science 2026-04-20 Pedro R. Pires , Gregorio F. Azevedo , Pietro L. Campos , Rafael T. Sereicikas , Tiago A. Almeida

Reinforcement learning agents are faced with two types of uncertainty. Epistemic uncertainty stems from limited data and is useful for exploration, whereas aleatoric uncertainty arises from stochastic environments and must be accounted for…

Machine Learning · Computer Science 2020-09-10 William R. Clements , Bastien Van Delft , Benoît-Marie Robaglia , Reda Bahi Slaoui , Sébastien Toth

Contextual multi-armed bandits (CMAB) have been widely used for learning to filter and prioritize information according to a user's interest. In this work, we analyze top-K ranking under the CMAB framework where the top-K arms are chosen…

Machine Learning · Computer Science 2022-01-31 Michael Rawson , Jade Freeman

Answering questions asked from instructional corpora such as E-manuals, recipe books, etc., has been far less studied than open-domain factoid context-based question answering. This can be primarily attributed to the absence of standard…

Computation and Language · Computer Science 2021-09-15 Abhilash Nandy , Soumya Sharma , Shubham Maddhashiya , Kapil Sachdeva , Pawan Goyal , Niloy Ganguly

In this paper, we propose and evaluate different learning strategies based on Multi-Arm Bandit (MAB) algorithms. They allow Internet of Things (IoT) devices to improve their access to the network and their autonomy, while taking into…

Networking and Internet Architecture · Computer Science 2019-02-28 Remi Bonnefoi , Lilian Besson , Julio Manco-Vasquez , Christophe Moy

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

Machine Learning · Computer Science 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

Automated algorithm selection and hyperparameter tuning facilitates the application of machine learning. Traditional multi-armed bandit strategies look to the history of observed rewards to identify the most promising arms for optimizing…

Machine Learning · Computer Science 2020-05-29 Mischa Schmidt , Julia Gastinger , Sébastien Nicolas , Anett Schülke

We use a novel modification of Multi-Armed Bandits to create a new model for recommendation systems. We model the recommendation system as a bandit seeking to maximize reward by pulling on arms with unknown rewards. The catch however is…

Machine Learning · Statistics 2024-09-05 Aditya Narayan Ravi , Pranav Poduval , Sharayu Moharir

Sequential decision-making algorithms such as multi-armed bandits can find optimal personalized decisions, but are notoriously sample-hungry. In personalized medicine, for example, training a bandit from scratch for every patient is…

Machine Learning · Computer Science 2026-05-12 Ahmet Zahid Balcıoğlu , Newton Mwai , Emil Carlsson , Fredrik D. Johansson

We present a novel machine learning framework for the optimal control of fluid restless multi-armed bandit problems (FRMABPs) with state equations that are either affine or quadratic in the state variables. By establishing fundamental…

Machine Learning · Computer Science 2026-05-08 Dimitris Bertsimas , Cheol Woo Kim , José Niño-Mora

Offline reinforcement learning (RL) enables training from fixed data without online interaction, but policies learned offline often struggle when deployed in dynamic environments due to distributional shift and unreliable value estimates on…

Machine Learning · Computer Science 2025-11-06 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

Multi-armed bandit (MAB) is a widely adopted framework for sequential decision-making under uncertainty. Traditional bandit algorithms rely solely on online data, which tends to be scarce as it must be gathered during the online phase when…

Statistics Theory · Mathematics 2026-04-23 Wenlong Ji , Yihan Pan , Ruihao Zhu , Lihua Lei

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

Reconfigurable manufacturing systems (RMS) are critical for future market adjustment given their rapid adaptation to fluctuations in consumer demands, the introduction of new technological advances, and disruptions in linked supply chain…

Multiagent Systems · Computer Science 2025-11-12 Manonmani Sekar , Nasim Nezamoddini

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than one player pulls the…

Machine Learning · Computer Science 2022-04-29 Xuchuang Wang , Hong Xie , John C. S. Lui

Recent advances in learning techniques have garnered attention for their applicability to a diverse range of real-world sequential decision-making problems. Yet, many practical applications have critical constraints for operation in real…

Machine Learning · Computer Science 2024-05-06 Jose A. Ayala-Romero , Andres Garcia-Saavedra , Xavier Costa-Perez