中文
相关论文

相关论文: Learning to Attack: A Bandit Approach to Adversari…

200 篇论文

We study a generalization of the problem of online learning in adversarial linear contextual bandits by incorporating loss functions that belong to a reproducing kernel Hilbert space, which allows for a more flexible modeling of complex…

机器学习 · 统计学 2023-10-04 Gergely Neu , Julia Olkhovskaya , Sattar Vakili

We study the problem of stochastic contextual bandits in the agnostic setting, where the goal is to compete with the best policy in a given class without assuming realizability or imposing model restrictions on losses or rewards. In this…

机器学习 · 统计学 2026-04-06 Samuel Girard , Aurelien Bibaut , Arthur Gretton , Nathan Kallus , Houssam Zenati

We consider the kernelized contextual bandit problem with a large feature space. This problem involves $K$ arms, and the goal of the forecaster is to maximize the cumulative rewards through learning the relationship between the contexts and…

机器学习 · 统计学 2025-05-21 Shogo Iwazaki , Junpei Komiyama , Masaaki Imaizumi

We study locally differentially private (LDP) bandits learning in this paper. First, we propose simple black-box reduction frameworks that can solve a large family of context-free bandits learning problems with LDP guarantee. Based on our…

机器学习 · 计算机科学 2021-01-18 Kai Zheng , Tianle Cai , Weiran Huang , Zhenguo Li , Liwei Wang

Motivated by practical needs such as large-scale learning, we study the impact of adaptivity constraints to linear contextual bandits, a central problem in online active learning. We consider two popular limited adaptivity models in…

机器学习 · 计算机科学 2021-04-26 Yufei Ruan , Jiaqi Yang , Yuan Zhou

We study an important task of attacking natural language processing models in a black box setting. We propose an attack strategy that crafts semantically similar adversarial examples on text classification and entailment tasks. Our proposed…

计算与语言 · 计算机科学 2020-12-25 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

This study investigates the problem of $K$-armed linear contextual bandits, an instance of the multi-armed bandit problem, under an adversarial corruption. At each round, a decision-maker observes an independent and identically distributed…

机器学习 · 计算机科学 2023-12-29 Masahiro Kato , Shinji Ito

We study nonparametric contextual bandits under batch constraints, where the expected reward for each action is modeled as a smooth function of covariates, and the policy updates are made at the end of each batch of observations. We…

统计理论 · 数学 2025-10-06 Rong Jiang , Cong Ma

Contextual bandits are widely-used in the study of learning-based control policies for finite action spaces. While the problem is well-studied for bandits with perfectly observed context vectors, little is known about the case of…

机器学习 · 统计学 2022-02-03 Hongju Park , Mohamad Kazem Shirani Faradonbeh

In this paper we adapt the nearest neighbour rule to the contextual bandit problem. Our algorithm handles the fully adversarial setting in which no assumptions at all are made about the data-generation process. When combined with a…

机器学习 · 计算机科学 2024-03-11 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

Recent advances in learning techniques have garnered attention for their applicability to a diverse range of real-world sequential decision-making problems. Yet, many practical applications have critical constraints for operation in real…

机器学习 · 计算机科学 2024-05-06 Jose A. Ayala-Romero , Andres Garcia-Saavedra , Xavier Costa-Perez

Clinical trials involving multiple treatments utilize randomization of the treatment assignments to enable the evaluation of treatment efficacies in an unbiased manner. Such evaluation is performed in post hoc studies that usually use…

人工智能 · 计算机科学 2018-09-10 Yogatheesan Varatharajah , Brent Berry , Sanmi Koyejo , Ravishankar Iyer

This work explores adaptations of successful multi-armed bandits policies to the online contextual bandits scenario with binary rewards using binary classification algorithms such as logistic regression as black-box oracles. Some of these…

机器学习 · 计算机科学 2019-11-26 David Cortes

In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective…

机器学习 · 计算机科学 2023-11-06 Sanath Kumar Krishnamurthy , Ruohan Zhan , Susan Athey , Emma Brunskill

A standard assumption in contextual multi-arm bandit is that the true context is perfectly known before arm selection. Nonetheless, in many practical applications (e.g., cloud resource management), prior to arm selection, the context…

机器学习 · 计算机科学 2021-04-06 Jianyi Yang , Shaolei Ren

Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing…

机器学习 · 计算机科学 2022-02-03 Praneet Dutta , Joe Cheuk , Jonathan S Kim , Massimo Mascaro

Stochastic multi-armed bandits form a class of online learning problems that have important applications in online recommendation systems, adaptive medical treatment, and many others. Even though potential attacks against these learning…

机器学习 · 计算机科学 2019-05-17 Fang Liu , Ness Shroff

Large language models (LLMs) have transformed the development of embodied intelligence. By providing a few contextual demonstrations, developers can utilize the extensive internal knowledge of LLMs to effortlessly translate complex tasks…

We study the contextual multi-armed bandit problem with a finite context space (a.k.a. subpopulations), where the learner recommends a best action for each context and is evaluated by context-weighted simple regret. Our guarantees are…

机器学习 · 计算机科学 2026-05-20 Mohammad Shahverdikondori , Jalal Etesami , Negar Kiyavash

Contextual bandits have emerged as a cornerstone in reinforcement learning, enabling systems to make decisions with partial feedback. However, as contexts grow in complexity, traditional bandit algorithms can face challenges in adequately…

机器学习 · 计算机科学 2023-11-07 Ali Baheri , Cecilia O. Alm