English
Related papers

Related papers: Private Reinforcement Learning with PAC and Regret…

200 papers

Differential privacy (DP) is a formal notion that restricts the privacy leakage of an algorithm when running on sensitive data, in which privacy-utility trade-off is one of the central problems in private data analysis. In this work, we…

Machine Learning · Computer Science 2025-03-18 Bo Li , Wei Wang , Peng Ye

An algorithm is developed to gradually relax the Differential Privacy (DP) guarantee of a randomized response. The output from each relaxation maintains the same probability distribution as a standard randomized response with the equivalent…

Cryptography and Security · Computer Science 2024-01-26 Mingen Pan

The theory of reinforcement learning has focused on two fundamental problems: achieving low regret, and identifying $\epsilon$-optimal policies. While a simple reduction allows one to apply a low-regret algorithm to obtain an…

Machine Learning · Computer Science 2022-06-23 Andrew Wagenmaker , Max Simchowitz , Kevin Jamieson

Differential Privacy (DP) provides a rigorous framework for releasing statistics while protecting individual information present in a dataset. Although substantial progress has been made on differentially private linear regression, existing…

Statistics Theory · Mathematics 2026-01-16 Getoar Sopa , Marco Avella Medina , Cynthia Rush

This paper studies the relationship between generalization and privacy preservation in iterative learning algorithms by two sequential steps. We first establish an alignment between generalization and privacy preservation for any learning…

Machine Learning · Computer Science 2020-08-10 Fengxiang He , Bohan Wang , Dacheng Tao

Machine learning systems can produce personalized outputs that allow an adversary to infer sensitive input attributes at inference time. We introduce Robust Privacy (RP), an inference-time privacy notion inspired by certified robustness: if…

Machine Learning · Computer Science 2026-01-27 Jiankai Jin , Xiangzheng Zhang , Zhao Liu , Deyue Zhang , Quanchen Zou

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Most known regret bounds for reinforcement learning are either episodic or assume an environment without traps. We derive a regret bound without making either assumption, by allowing the algorithm to occasionally delegate an action to an…

Machine Learning · Computer Science 2019-07-22 Vanessa Kosoy

Differential Privacy (DP) provides strong guarantees on the risk of compromising a user's data in statistical learning applications, though these strong protections make learning challenging and may be too stringent for some use cases. To…

Machine Learning · Computer Science 2019-12-10 Hilal Asi , John Duchi , Omid Javidbakht

The rise of reinforcement learning (RL) in critical real-world applications demands a fundamental rethinking of privacy in AI systems. Traditional privacy frameworks, designed to protect isolated data points, fall short for sequential…

Machine Learning · Computer Science 2025-06-19 Flint Xiaofeng Fan , Cheston Tan , Roger Wattenhofer , Yew-Soon Ong

We study reinforcement learning (RL) for decision processes with non-Markovian reward, in which high-level knowledge of the task in the form of reward machines is available to the learner. We consider probabilistic reward machines with…

Machine Learning · Computer Science 2024-12-30 Hippolyte Bourel , Anders Jonsson , Odalric-Ambrym Maillard , Chenxiao Ma , Mohammad Sadegh Talebi

Collaborative machine learning involves training models on data from multiple parties but must incentivize their participation. Existing data valuation methods fairly value and reward each party based on shared data or model parameters but…

Machine Learning · Computer Science 2024-04-03 Rachael Hwee Ling Sim , Yehong Zhang , Trong Nghia Hoang , Xinyi Xu , Bryan Kian Hsiang Low , Patrick Jaillet

Online reinforcement learning (RL) has been widely applied in information processing scenarios, which usually exhibit much uncertainty due to the intrinsic randomness of channels and service demands. In this paper, we consider an…

Machine Learning · Computer Science 2021-06-17 Rongpeng Li

Motivated by the emerging needs of personalized preventative intervention in many healthcare applications, we consider a multi-stage, dynamic decision-making problem in the online setting with unknown model parameters. To deal with the…

Machine Learning · Computer Science 2022-11-17 Xinyun Chen , Pengyi Shi , Shanwen Pu

Learning from preference-based feedback has recently gained considerable traction as a promising approach to align generative models with human interests. Instead of relying on numerical rewards, the generative models are trained using…

Machine Learning · Computer Science 2023-10-31 Sayak Ray Chowdhury , Xingyu Zhou , Nagarajan Natarajan

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

Reinforcement Learning (RL) enables agents to learn how to perform various tasks from scratch. In domains like autonomous driving, recommendation systems, and more, optimal RL policies learned could cause a privacy breach if the policies…

Machine Learning · Computer Science 2021-12-13 Kritika Prakash , Fiza Husain , Praveen Paruchuri , Sujit P. Gujar

In this paper, we consider the problem of preserving privacy in the online learning setting. We study the problem in the online convex programming (OCP) framework---a popular online learning setting with several interesting theoretical and…

Machine Learning · Computer Science 2015-03-19 Prateek Jain , Pravesh Kothari , Abhradeep Thakurta

Local differential privacy (LDP) gives a strong privacy guarantee to be used in a distributed setting like federated learning (FL). LDP mechanisms in FL protect a client's gradient by randomizing it on the client; however, how can we…

Cryptography and Security · Computer Science 2022-06-22 Marin Matsumoto , Tsubasa Takahashi , Seng Pei Liew , Masato Oguchi