中文
相关论文

相关论文: Robust and differentially private stochastic linea…

200 篇论文

Sequential learning in a multi-agent resource constrained matching market has received significant interest in the past few years. We study decentralized learning in two-sided matching markets where the demand side (aka players or agents)…

机器学习 · 计算机科学 2025-06-23 Satush Parikh , Soumya Basu , Avishek Ghosh , Abishek Sankararaman

We study two-sided matching markets in which one side of the market (the players) does not have a priori knowledge about its preferences for the other side (the arms) and is required to learn its preferences from experience. Also, we assume…

机器学习 · 计算机科学 2021-06-23 Lydia T. Liu , Feng Ruan , Horia Mania , Michael I. Jordan

Local differential privacy (LDP) is a model where users send privatized data to an untrusted central server whose goal it to solve some data analysis task. In the non-interactive version of this model the protocol consists of a single round…

机器学习 · 计算机科学 2020-09-24 Yuval Dagan , Vitaly Feldman

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

机器学习 · 计算机科学 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

We consider a multi-armed bandit setting in which each arm has a public and a private reward distribution. An observer expects an agent to follow Thompson Sampling according to the public rewards, however, the deceptive agent aims to…

We study regret minimization under privacy constraints in episodic inhomogeneous linear Markov Decision Processes (MDPs), motivated by the growing use of reinforcement learning (RL) in personalized decision-making systems that rely on…

机器学习 · 计算机科学 2025-04-29 Sharan Sahu

We study stochastic linear optimization problem with bandit feedback. The set of arms take values in an $N$-dimensional space and belong to a bounded polyhedron described by finitely many linear inequalities. We provide a lower bound for…

机器学习 · 计算机科学 2015-09-29 Manjesh K. Hanawal , Amir Leshem , Venkatesh Saligrama

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

We consider the bandit problem of selecting $K$ out of $N$ arms at each time step. The reward can be a non-linear function of the rewards of the selected individual arms. The direct use of a multi-armed bandit algorithm requires choosing…

机器学习 · 计算机科学 2026-02-16 Mridul Agarwal , Vaneet Aggarwal , Christopher J. Quinn , Abhishek Umrawal

We consider a sequential decision-making problem where an agent can take one action at a time and each action has a stochastic temporal extent, i.e., a new action cannot be taken until the previous one is finished. Upon completion, the…

机器学习 · 计算机科学 2020-03-26 P Sharoff , Nishant A. Mehta , Ravi Ganti

In this paper, we study the stochastic version of the one-sided full information bandit problem, where we have $K$ arms $[K] = \{1, 2, \ldots, K\}$, and playing arm $i$ would gain reward from an unknown distribution for arm $i$ while…

机器学习 · 计算机科学 2019-06-21 Haoyu Zhao , Wei Chen

This paper studies \emph{differential privacy (DP)} and \emph{local differential privacy (LDP)} in cascading bandits. Under DP, we propose an algorithm which guarantees $\epsilon$-indistinguishability and a regret of…

机器学习 · 计算机科学 2021-06-07 Kun Wang , Jing Dong , Baoxiang Wang , Shuai Li , Shuo Shao

We investigate two perturbation approaches to overcome conservatism that optimism based algorithms chronically suffer from in practice. The first approach replaces optimism with a simple randomization when using confidence sets. The second…

机器学习 · 统计学 2021-10-13 Baekjin Kim , Ambuj Tewari

We consider the problem of contextual kernel bandits with stochastic contexts, where the underlying reward function belongs to a known Reproducing Kernel Hilbert Space (RKHS). We study this problem under the additional constraint of joint…

机器学习 · 统计学 2025-01-14 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

In this paper, we study the problem of (finite horizon tabular) Markov decision processes (MDPs) with heavy-tailed rewards under the constraint of differential privacy (DP). Compared with the previous studies for private reinforcement…

机器学习 · 计算机科学 2023-06-06 Yulian Wu , Xingyu Zhou , Sayak Ray Chowdhury , Di Wang

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal $\tilde{O}(\sqrt{T})$ regret bounds. In the full-information setting, our results demonstrate…

机器学习 · 计算机科学 2017-06-15 Naman Agarwal , Karan Singh

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

机器学习 · 计算机科学 2015-07-20 Aleksandr Vorobev , Gleb Gusev

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We investigate the high-dimensional sparse linear bandits problem in a data-poor regime where the time horizon is much smaller than the ambient dimension and number of arms. We study the setting under the additional blocking constraint…