English
Related papers

Related papers: Differentially Private Reinforcement Learning with…

200 papers

It is common practice to use data containing personal information to build predictive models in the framework of empirical risk minimization (ERM). While these models can be highly accurate in prediction, sharing the results from these…

Machine Learning · Statistics 2024-09-30 Spencer Giddens , Yiwang Zhou , Kevin R. Krull , Tara M. Brinkman , Peter X. K. Song , Fang Liu

This paper presents LDP-Fed, a novel federated learning system with a formal privacy guarantee using local differential privacy (LDP). Existing LDP protocols are developed primarily to ensure data privacy in the collection of single…

Machine Learning · Computer Science 2020-06-09 Stacey Truex , Ling Liu , Ka-Ho Chow , Mehmet Emre Gursoy , Wenqi Wei

We consider an online learning problem where the learner interacts with a Markov decision process in a sequence of episodes, where the reward function is allowed to change between episodes in an adversarial manner and the learner only gets…

Machine Learning · Computer Science 2021-06-15 Gergely Neu , Julia Olkhovskaya

This paper proposes a computationally tractable algorithm for learning infinite-horizon average-reward linear Markov decision processes (MDPs) and linear mixture MDPs under the Bellman optimality condition. While guaranteeing computational…

Machine Learning · Computer Science 2024-09-25 Woojin Chae , Dabeen Lee

Safe Reinforcement Learning (RL) plays an important role in applying RL algorithms to safety-critical real-world applications, addressing the trade-off between maximizing rewards and adhering to safety constraints. This work introduces a…

Robotics · Computer Science 2024-07-16 Fan Yang , Wenxuan Zhou , Zuxin Liu , Ding Zhao , David Held

Metric Differential Privacy (mDP) builds upon the core principles of Differential Privacy (DP) by incorporating various distance metrics, which offer adaptable and context-sensitive privacy guarantees for a wide range of applications, such…

Cryptography and Security · Computer Science 2025-09-17 Xinpeng Xie , Chenyang Yu , Yan Huang , Yang Cao , Chenxi Qiu

Collecting and training over sensitive personal data raise severe privacy concerns in personalized recommendation systems, and federated learning can potentially alleviate the problem by training models over decentralized user data.However,…

Information Retrieval · Computer Science 2022-12-15 Ruixuan Liu , Yanlin Wang , Yang Cao , Lingjuan Lyu , Weike Pan , Yun Chen , Hong Chen

Federated Learning enables collaborative learning among clients via a coordinating server while avoiding direct data sharing, offering a perceived solution to preserve privacy. However, recent studies on Membership Inference Attacks (MIAs)…

Cryptography and Security · Computer Science 2025-08-04 Quan Nguyen , Minh N. Vu , Truc Nguyen , My T. Thai

Metric Differential Privacy (mDP) extends the local differential privacy (LDP) framework to metric spaces, enabling more nuanced privacy protection for data such as geo-locations. However, existing mDP optimization methods, particularly…

Cryptography and Security · Computer Science 2025-09-11 Ruiyao Liu , Chenxi Qiu

Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data…

Cryptography and Security · Computer Science 2021-12-06 Honglu Jiang , Yifeng Gao , S M Sarwar , Luis GarzaPerez , Mahmudul Robin

User-level differential privacy (DP) provides certifiable privacy guarantees to the information that is specific to any user's data in federated learning. Existing methods that ensure user-level DP come at the cost of severe accuracy…

Machine Learning · Computer Science 2022-03-22 Anda Cheng , Peisong Wang , Xi Sheryl Zhang , Jian Cheng

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

The powerful cooperation of federated learning (FL) and differential privacy~(DP) provides a promising paradigm for the large-scale private clients. However, existing analyses in FL-DP mostly rely on the composition theorem and cannot…

Machine Learning · Computer Science 2026-05-14 Yan Sun , Qixin Zhang , Li Shen , Dacheng Tao

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been…

Machine Learning · Computer Science 2023-05-30 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan

We study the problem of infinite-horizon average-reward reinforcement learning with linear Markov decision processes (MDPs). The associated Bellman operator of the problem not being a contraction makes the algorithm design challenging.…

Machine Learning · Statistics 2025-03-12 Kihyuk Hong , Woojin Chae , Yufan Zhang , Dabeen Lee , Ambuj Tewari

The growing use of machine learning (ML) has raised concerns that an ML model may reveal private information about an individual who has contributed to the training dataset. To prevent leakage of sensitive data, we consider using…

Machine Learning · Computer Science 2024-07-22 Yvonne Zhou , Mingyu Liang , Ivan Brugere , Dana Dachman-Soled , Danial Dervovic , Antigoni Polychroniadou , Min Wu

Online reinforcement learning (RL) has been widely applied in information processing scenarios, which usually exhibit much uncertainty due to the intrinsic randomness of channels and service demands. In this paper, we consider an…

Machine Learning · Computer Science 2021-06-17 Rongpeng Li

In the evolving landscape of human-centric systems, personalized privacy solutions are becoming increasingly crucial due to the dynamic nature of human interactions. Traditional static privacy models often fail to meet the diverse and…

Machine Learning · Computer Science 2024-11-14 Mojtaba Taherisadr , Salma Elmalaki

The widespread collection and sharing of location data, even in aggregated form, raises major privacy concerns. Previous studies used meta-classifier-based membership inference attacks~(MIAs) with multi-layer perceptrons~(MLPs) to estimate…

Cryptography and Security · Computer Science 2024-12-31 Yuhan Liu , Florent Guepin , Igor Shilov , Yves-Alexandre De Montjoye

In this paper, we aim to develop a scalable algorithm to preserve differential privacy (DP) in adversarial learning for deep neural networks (DNNs), with certified robustness to adversarial examples. By leveraging the sequential composition…

Cryptography and Security · Computer Science 2020-09-16 NhatHai Phan , My T. Thai , Han Hu , Ruoming Jin , Tong Sun , Dejing Dou