English
Related papers

Related papers: PrivORL: Differentially Private Synthetic Dataset …

200 papers

Reinforcement learning (RL) presents numerous benefits compared to rule-based approaches in various applications. Privacy concerns have grown with the widespread use of RL trained with privacy-sensitive data in IoT devices, especially for…

Machine Learning · Computer Science 2023-03-09 Mojtaba Taherisadr , Stelios Andrew Stavroulakis , Salma Elmalaki

Differentially private synthetic data generation offers a recent solution to release analytically useful data while preserving the privacy of individuals in the data. In order to utilize these algorithms for public policy decisions,…

Applications · Statistics 2020-10-13 Claire McKay Bowen , Joshua Snoke

Trajectory data collection is a common task with many applications in our daily lives. Analyzing trajectory data enables service providers to enhance their services, which ultimately benefits users. However, directly collecting trajectory…

Databases · Computer Science 2023-07-25 Yuemin Zhang , Qingqing Ye , Rui Chen , Haibo Hu , Qilong Han

When individuals are subject to adverse outcomes from machine learning models, providing a recourse path to help achieve a positive outcome is desirable. Recent work has shown that counterfactual explanations - which can be used as a means…

Machine Learning · Computer Science 2023-11-27 Sikha Pentyala , Shubham Sharma , Sanjay Kariyappa , Freddy Lecue , Daniele Magazzeni

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

High quality data is needed to unlock the full potential of AI for end users. However finding new sources of such data is getting harder: most publicly-available human generated data will soon have been used. Additionally, publicly…

Preserving the privacy of preferences (or rewards) of a sequential decision-making agent when decisions are observable is crucial in many physical and cybersecurity domains. For instance, in wildlife monitoring, agents must allocate…

Artificial Intelligence · Computer Science 2024-07-16 Shashank Reddy Chirra , Pradeep Varakantham , Praveen Paruchuri

Model-based offline reinforcement learning (MORL) aims to learn a policy by exploiting a dynamics model derived from an existing dataset. Applying conservative quantification to the dynamics model, most existing works on MORL generate…

Machine Learning · Computer Science 2025-05-06 Shenghong He

Generating differentially private (DP) synthetic data that closely resembles the original private data is a scalable way to mitigate privacy concerns in the current data-driven world. In contrast to current practices that train customized…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zinan Lin , Sivakanth Gopi , Janardhan Kulkarni , Harsha Nori , Sergey Yekhanin

This paper presents a comprehensive benchmarking suite tailored to offline safe reinforcement learning (RL) challenges, aiming to foster progress in the development and evaluation of safe learning algorithms in both the training and…

Machine Learning · Computer Science 2023-06-19 Zuxin Liu , Zijian Guo , Haohong Lin , Yihang Yao , Jiacheng Zhu , Zhepeng Cen , Hanjiang Hu , Wenhao Yu , Tingnan Zhang , Jie Tan , Ding Zhao

Randomized controlled trials (RCTs) have become powerful tools for assessing the impact of interventions and policies in many contexts. They are considered the gold standard for causal inference in the biomedical fields and many social…

When synthetic data is released, some individuals are harder to protect than others. A patient with a rare disease combination or a transaction with unusual characteristics stands out from the crowd. Differential privacy provides worst-case…

Machine Learning · Computer Science 2026-02-12 Amir Asiaee , Chao Yan , Zachary B. Abrams , Bradley A. Malin

Offline reinforcement learning (RL) learns effective policies from pre-collected datasets, offering a practical solution for applications where online interactions are risky or costly. Model-based approaches are particularly advantageous…

Machine Learning · Computer Science 2026-05-14 Xuyang Chen , Keyu Yan , Guojian Wang , Lin Zhao

Recent advances in offline Reinforcement Learning (RL) have proven that effective policy learning can benefit from imposing conservative constraints on pre-collected datasets. However, such static datasets often exhibit distribution bias,…

Machine Learning · Computer Science 2026-05-15 Yunpeng Qing , Yixiao Chi , Shuo Chen , Shunyu Liu , Kexuan Zhou , Sixu Lin , Litao Liu , Changqing Zou

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

Machine Learning · Computer Science 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

Machine Learning · Computer Science 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

Differential privacy (DP) has been accepted as a rigorous criterion for measuring the privacy protection offered by random mechanisms used to obtain statistics or, as we will study here, synthetic datasets from confidential data. Methods to…

Methodology · Statistics 2024-05-09 Leila Nombo , Anne-Sophie Charest

The difficulty of anonymizing text data hinders the development and deployment of NLP in high-stakes domains that involve private data, such as healthcare and social services. Poorly anonymized sensitive data cannot be easily shared with…

Computation and Language · Computer Science 2024-10-14 Krithika Ramesh , Nupoor Gandhi , Pulkit Madaan , Lisa Bauer , Charith Peris , Anjalie Field

Training autonomous agents with sparse rewards is a long-standing problem in online reinforcement learning (RL), due to low data efficiency. Prior work overcomes this challenge by extracting useful knowledge from offline data, often…

Machine Learning · Computer Science 2024-06-07 Qianlan Yang , Yu-Xiong Wang