English
Related papers

Related papers: Meta-learning with Stochastic Linear Bandits

200 papers

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying

In recent years, meta-learning, in which a model is trained on a family of tasks (i.e. a task distribution), has emerged as an approach to training neural networks to perform tasks that were previously assumed to require structured…

Machine Learning · Computer Science 2021-03-19 Sreejan Kumar , Ishita Dasgupta , Jonathan D. Cohen , Nathaniel D. Daw , Thomas L. Griffiths

The stochastic linear bandit problem proceeds in rounds where at each round the algorithm selects a vector from a decision set after which it receives a noisy linear loss parameterized by an unknown vector. The goal in such a problem is to…

Machine Learning · Statistics 2016-06-21 Nicholas Johnson , Vidyashankar Sivakumar , Arindam Banerjee

The statistical framework of Generalized Linear Models (GLM) can be applied to sequential problems involving categorical or ordinal rewards associated, for instance, with clicks, likes or ratings. In the example of binary rewards, logistic…

Machine Learning · Computer Science 2020-03-24 Yoan Russac , Olivier Cappé , Aurélien Garivier

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

We study a stochastic budget-allocation problem over $K$ tasks. At each round $t$, the learner chooses an allocation $X_t \in \Delta_K$. Task $k$ succeeds with probability $F_k(X_{t,k})$, where $F_1,\dots,F_K$ are nondecreasing…

Computer Science and Game Theory · Computer Science 2026-02-05 François Bachoc , Nicolò Cesa-Bianchi , Tommaso Cesari , Roberto Colomboni

In this paper, we study the problem of estimating uniformly well the mean values of several distributions given a finite budget of samples. If the variance of the distributions were known, one could design an optimal sampling strategy by…

Machine Learning · Computer Science 2015-07-17 Alexandra Carpentier , Alessandro Lazaric , Mohammad Ghavamzadeh , Rémi Munos , Peter Auer , András Antos

This paper is motivated by recent research in the $d$-dimensional stochastic linear bandit literature, which has revealed an unsettling discrepancy: algorithms like Thompson sampling and Greedy demonstrate promising empirical performance,…

Machine Learning · Computer Science 2025-05-20 Yuwei Luo , Mohsen Bayati

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

Machine Learning · Computer Science 2021-10-05 Chuanhao Li , Hongning Wang

This paper formalises the problem of online algorithm selection in the context of Reinforcement Learning. The setup is as follows: given an episodic task and a finite number of off-policy RL algorithms, a meta-algorithm has to decide which…

Machine Learning · Statistics 2017-11-16 Romain Laroche , Raphael Feraud

The linear bandit problem has been studied for many years in both stochastic and adversarial settings. Designing an algorithm that can optimize the environment without knowing the loss type attracts lots of interest. \citet{LeeLWZ021}…

Machine Learning · Computer Science 2023-07-19 Fang Kong , Canzhe Zhao , Shuai Li

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

Machine Learning · Computer Science 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

Bandit optimization is a difficult problem, especially if the reward model is high-dimensional. When rewards are modeled by neural networks, sublinear regret has only been shown under strong assumptions, usually when the network is…

Machine Learning · Computer Science 2025-01-14 Mikhail Terekhov

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

We study the Logistic Contextual Slate Bandit problem, where, at each round, an agent selects a slate of $N$ items from an exponentially large set (of size $2^{\Omega(N)}$) of candidate slates provided by the environment. A single binary…

Machine Learning · Computer Science 2026-05-13 Tanmay Goyal , Gaurav Sinha

We study the problem of representation learning in stochastic contextual linear bandits. While the primary concern in this domain is usually to find realizable representations (i.e., those that allow predicting the reward function at any…

Machine Learning · Computer Science 2022-10-25 Andrea Tirinzoni , Matteo Papini , Ahmed Touati , Alessandro Lazaric , Matteo Pirotta

We study a constrained contextual linear bandit setting, where the goal of the agent is to produce a sequence of policies, whose expected cumulative reward over the course of $T$ rounds is maximum, and each has an expected cost below a…

Machine Learning · Computer Science 2020-06-20 Aldo Pacchiano , Mohammad Ghavamzadeh , Peter Bartlett , Heinrich Jiang

Contextual bandit algorithms are sensitive to the estimation method of the outcome model as well as the exploration method used, particularly in the presence of rich heterogeneity or complex outcome models, which can lead to difficult…

Machine Learning · Computer Science 2018-12-18 Maria Dimakopoulou , Zhengyuan Zhou , Susan Athey , Guido Imbens

We investigate the non-stationary stochastic linear bandit problem where the reward distribution evolves each round. Existing algorithms characterize the non-stationarity by the total variation budget $B_K$, which is the summation of the…

Machine Learning · Computer Science 2024-03-19 Zhiyong Wang , Jize Xie , Yi Chen , John C. S. Lui , Dongruo Zhou