English
Related papers

Related papers: A Hybrid Meta-Learning and Multi-Armed Bandit Appr…

200 papers

Advances in reinforcement learning research have demonstrated the ways in which different agent-based models can learn how to optimally perform a task within a given environment. Reinforcement leaning solves unsupervised problems where…

Machine Learning · Computer Science 2022-11-03 Herkulaas Combrink , Vukosi Marivate , Benjamin Rosman

Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configurations that falter in dynamic settings. We propose MAT-Agent, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jusheng Zhang , Kaitong Cai , Yijia Fan , Ningyuan Liu , Keze Wang

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

Machine Learning · Computer Science 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Recommendation systems are a key modern application of machine learning, but they have the downside that they often draw upon sensitive user information in making their predictions. We show how to address this deficiency by basing a…

Machine Learning · Computer Science 2021-12-03 Naveen Durvasula , Franklyn Wang , Scott Duke Kominers

We study a strategic variant of the multi-armed bandit problem, which we coin the strategic click-bandit. This model is motivated by applications in online recommendation where the choice of recommended items depends on both the…

Machine Learning · Computer Science 2023-11-28 Thomas Kleine Buening , Aadirupa Saha , Christos Dimitrakakis , Haifeng Xu

A general framework of personalized federated multi-armed bandits (PF-MAB) is proposed, which is a new bandit paradigm analogous to the federated learning (FL) framework in supervised learning and enjoys the features of FL with…

Machine Learning · Computer Science 2021-02-26 Chengshuai Shi , Cong Shen , Jing Yang

We present an approach to Intelligent Tutoring Systems which adaptively personalizes sequences of learning activities to maximize skills acquired by students, taking into account the limited time and motivational resources. At a given point…

Artificial Intelligence · Computer Science 2019-07-17 Benjamin Clement , Didier Roy , Pierre-Yves Oudeyer , Manuel Lopes

As an extension of the classical multi-armed bandit problem, multi-fidelity multi-armed bandits (MF-MAB) enable individual arms to be evaluated using diverse feedback sources that vary in both cost and accuracy. Prior stochastic models…

Machine Learning · Computer Science 2026-05-12 Muyun Lu , Haoyang Hong , Huazheng Wang , Ying Lin

We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence…

Information Retrieval · Computer Science 2024-07-08 Shameem A Puthiya Parambath , Christos Anagnostopoulos , Roderick Murray-Smith

Current multi-armed bandit approaches in recommender systems (RS) have focused more on devising effective exploration techniques, while not adequately addressing common exploitation challenges related to distributional changes and item…

Information Retrieval · Computer Science 2023-10-04 Belhassen Bayar , Phanideep Gampa , Ainur Yessenalina , Zhen Wen

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

Machine Learning · Statistics 2018-12-14 Lai Wei , Vaibhav Srivastava

We consider the linear contextual multi-class multi-period packing problem (LMMP) where the goal is to pack items such that the total vector of consumption is below a given budget vector and the total value is as large as possible. We…

Machine Learning · Statistics 2023-06-02 Wonyoung Kim , Garud Iyengar , Assaf Zeevi

Meta-learning is characterized by its ability to learn how to learn, enabling the adaptation of learning strategies across different tasks. Recent research introduced the Meta-Thompson Sampling (Meta-TS), which meta-learns an unknown prior…

Machine Learning · Statistics 2024-09-12 Hao Li , Dong Liang , Zheng Xie

Online advertising platforms often face a common challenge: the cold start problem. Insufficient behavioral data (clicks) makes accurate click-through rate (CTR) forecasting of new ads challenging. CTR for "old" items can also be…

Machine Learning · Computer Science 2025-02-05 Anastasiia Soboleva , Andrey Pudovikov , Roman Snetkov , Alina Babenko , Egor Samosvat , Yuriy Dorn

Adam is a widely used optimizer in neural network training due to its adaptive learning rate. However, because different data samples influence model updates to varying degrees, treating them equally can lead to inefficient convergence. To…

Machine Learning · Statistics 2025-12-09 Gyu Yeol Kim , Min-hwan Oh

The multi-armed bandit (MAB) models have attracted significant research attention due to their applicability and effectiveness in various real-world scenarios such as resource allocation, online advertising, and dynamic pricing. As an…

Machine Learning · Computer Science 2024-02-13 Yandi Li , Jianxiong Guo , Yupeng Li , Tian Wang , Weijia Jia

Traditional multi-armed bandit (MAB) frameworks, predominantly examined under stochastic or adversarial settings, often overlook the temporal dynamics inherent in many real-world applications such as recommendation systems and online…

Machine Learning · Computer Science 2023-12-13 Qinyi Chen , Negin Golrezaei , Djallel Bouneffouf

We introduce a novel framework of combinatorial multi-armed bandits (CMAB) with multivariant and probabilistically triggering arms (CMAB-MT), where the outcome of each arm is a $d$-dimensional multivariant random variable and the feedback…

Machine Learning · Computer Science 2025-04-24 Xutong Liu , Siwei Wang , Jinhang Zuo , Han Zhong , Xuchuang Wang , Zhiyong Wang , Shuai Li , Mohammad Hajiesmaili , John C. S. Lui , Wei Chen

Multi armed bandit (MAB) algorithms have been increasingly used to complement or integrate with A/B tests and randomized clinical trials in e-commerce, healthcare, and policymaking. Recent developments incorporate possible delayed feedback.…

Methodology · Statistics 2023-07-04 Lei Shi , Jingshen Wang , Tianhao Wu

Aligning multimodal large language models (MLLMs) with human preferences often relies on single-signal, model-based reward methods. Such monolithic rewards often lack confidence calibration across domain-specific tasks, fail to capture…

Artificial Intelligence · Computer Science 2025-10-08 Radha Gulhane , Sathish Reddy Indurthi