English
Related papers

Related papers: Differential Privacy in the Extensive-Form Bandit …

200 papers

We study a strategic version of the multi-armed bandit problem, where each arm is an individual strategic agent and we, the principal, pull one arm each round. When pulled, the arm receives some private reward $v_a$ and can choose an amount…

Computer Science and Game Theory · Computer Science 2017-07-03 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

Most differentially private mechanisms are designed for the use of a single analyst. In reality, however, there are often multiple stakeholders with different and possibly conflicting priorities that must share the same privacy loss budget.…

Computers and Society · Computer Science 2022-12-21 David Pujol , Albert Sun , Brandon Fain , Ashwin Machanavajjhala

Research on the multi-armed bandit problem has studied the trade-off of exploration and exploitation in depth. However, there are numerous applications where the cardinal absolute-valued feedback model (e.g. ratings from one to five) is not…

Machine Learning · Computer Science 2018-12-12 Lennard Hilgendorf

Differential privacy is a strong mathematical notion of privacy. Still, a prominent challenge when using differential privacy in real data collection is understanding and counteracting the accuracy loss that differential privacy imposes. As…

Cryptography and Security · Computer Science 2021-08-24 Boel Nelson

We study the problem of multi-task learning under user-level differential privacy, in which $n$ users contribute data to $m$ tasks, each involving a subset of users. One important aspect of the problem, that can significantly impact…

Machine Learning · Computer Science 2023-02-17 Walid Krichene , Prateek Jain , Shuang Song , Mukund Sundararajan , Abhradeep Thakurta , Li Zhang

Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data…

Cryptography and Security · Computer Science 2021-12-06 Honglu Jiang , Yifeng Gao , S M Sarwar , Luis GarzaPerez , Mahmudul Robin

Learning in multi-player games can model a large variety of practical scenarios, where each player seeks to optimize its own local objective function, which at the same time relies on the actions taken by others. Motivated by the frequent…

Optimization and Control · Mathematics 2023-09-08 Yuanhanqing Huang , Jianghai Hu

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

We introduce the "inverse bandit" problem of estimating the rewards of a multi-armed bandit instance from observing the learning process of a low-regret demonstrator. Existing approaches to the related problem of inverse reinforcement…

Machine Learning · Statistics 2022-02-23 Wenshuo Guo , Kumar Krishna Agrawal , Aditya Grover , Vidya Muthukumar , Ashwin Pananjady

We give an $(\varepsilon,\delta)$-differentially private algorithm for the multi-armed bandit (MAB) problem in the shuffle model with a distribution-dependent regret of $O\left(\left(\sum_{a\in [k]:\Delta_a>0}\frac{\log…

Machine Learning · Computer Science 2021-10-29 Jay Tenenbaum , Haim Kaplan , Yishay Mansour , Uri Stemmer

In this work, we consider a federated learning model in a wireless system with multiple base stations and inter-cell interference. We apply a differential private scheme to transmit information from users to their corresponding base station…

Cryptography and Security · Computer Science 2022-08-26 Nima Tavangaran , Mingzhe Chen , Zhaohui Yang , José Mairton B. Da Silva , H. Vincent Poor

Differential privacy is often studied in one of two models. In the central model, a single analyzer has the responsibility of performing a privacy-preserving computation on data. But in the local model, each data owner ensures their own…

Cryptography and Security · Computer Science 2022-05-26 Albert Cheu

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

Contextual bandit is a general framework for online learning in sequential decision-making problems that has found application in a wide range of domains, including recommendation systems, online advertising, and clinical trials. A critical…

Machine Learning · Computer Science 2022-03-24 Evrard Garcelon , Vianney Perchet , Matteo Pirotta

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

We consider the adversarial multi-armed bandit problem under delayed feedback. We analyze variants of the Exp3 algorithm that tune their step-size using only information (about the losses and delays) available at the time of the decisions,…

Machine Learning · Computer Science 2020-10-14 András György , Pooria Joulani

A basic problem in the design of privacy-preserving algorithms is the private maximization problem: the goal is to pick an item from a universe that (approximately) maximizes a data-dependent function, all under the constraint of…

Machine Learning · Computer Science 2014-09-09 Kamalika Chaudhuri , Daniel Hsu , Shuang Song

Concerns on location privacy frequently arise with the rapid development of GPS enabled devices and location-based applications. While spatial transformation techniques such as location perturbation or generalization have been studied…

Databases · Computer Science 2015-11-05 Yonghui Xiao , Li Xiong

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

Machine Learning · Computer Science 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

Local differential privacy (LDP) gives a strong privacy guarantee to be used in a distributed setting like federated learning (FL). LDP mechanisms in FL protect a client's gradient by randomizing it on the client; however, how can we…

Cryptography and Security · Computer Science 2022-06-22 Marin Matsumoto , Tsubasa Takahashi , Seng Pei Liew , Masato Oguchi