English
Related papers

Related papers: Designing Incentive Schemes For Privacy-Sensitive …

200 papers

Measuring states in reinforcement learning (RL) can be costly in real-world settings and may negatively influence future outcomes. We introduce the Actively Observable Markov Decision Process (AOMDP), where an agent not only selects control…

Machine Learning · Computer Science 2025-10-17 Daiqi Gao , Ziping Xu , Aseel Rawashdeh , Predrag Klasnja , Susan A. Murphy

In today's economy, it becomes important for Internet platforms to consider the sequential information design problem to align its long term interest with incentives of the gig service providers. This paper proposes a novel model of…

Artificial Intelligence · Computer Science 2022-02-23 Jibang Wu , Zixuan Zhang , Zhe Feng , Zhaoran Wang , Zhuoran Yang , Michael I. Jordan , Haifeng Xu

In industrial applications, the presence of moving machinery, vehicles, and personnel, contributes to the dynamic nature of the wireless channel. This time variability induces channel fading, which can be effectively modeled using a Markov…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Jie Huang , Fanlin Jia , Xiao He

We consider Incentive Decision Processes, where a principal seeks to reduce its costs due to another agent's behavior, by offering incentives to the agent for alternate behavior. We focus on the case where a principal interacts with a…

Computer Science and Game Theory · Computer Science 2012-10-19 Sashank J. Reddi , Emma Brunskill

Differential privacy is a popular privacy-enhancing technology that has been deployed both in industry and government agencies. Unfortunately, existing explanations of differential privacy fail to set accurate privacy expectations for data…

Cryptography and Security · Computer Science 2025-09-29 Mary Anne Smart , Priyanka Nanayakkara , Rachel Cummings , Gabriel Kaptchuk , Elissa Redmiles

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Metric Differential Privacy (mDP) generalizes differential privacy by allowing privacy guarantees to be expressed with respect to an arbitrary distance metric over secrets. While mDP has been adopted in geo-location protection, most…

Cryptography and Security · Computer Science 2026-05-27 Gaoyi Chen , Yan Huang , Chenxi Qiu

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

Statistics Theory · Mathematics 2021-11-11 Zhengling Qi , Peng Liao

Safety in stochastic control systems, which are subject to random noise with a known probability distribution, aims to compute policies that satisfy predefined operational constraints with high confidence throughout the uncertain evolution…

Systems and Control · Electrical Eng. & Systems 2025-11-12 Saber Omidi , Marek Petrik , Se Young Yoon , Momotaz Begum

We consider the problem of constrained Markov Decision Process (CMDP) where an agent interacts with a unichain Markov Decision Process. At every interaction, the agent obtains a reward. Further, there are $K$ cost functions. The agent aims…

Machine Learning · Computer Science 2022-06-22 Mridul Agarwal , Qinbo Bai , Vaneet Aggarwal

In this paper authors are going to present a Markov Decision Process (MDP) based algorithm in Industrial Internet of Things (IIoT) as a safety compliance layer for human in loop system. Though some industries are moving towards Industry 4.0…

Computers and Society · Computer Science 2018-11-30 Abhisek Das , Satanik Panda , Suman Datta , Soumitra Naskar , Pratep Misra , Tanushyam Chattopadhyay

In applications involving sensitive data, such as finance and healthcare, the necessity for preserving data privacy can be a significant barrier to machine learning model development. Differential privacy (DP) has emerged as one canonical…

Machine Learning · Computer Science 2022-11-15 Zachary Izzo , Jinsung Yoon , Sercan O. Arik , James Zou

This paper is devoted to studying constrained continuous-time Markov decision processes (MDPs) in the class of randomized policies depending on state histories. The transition rates may be unbounded, the reward and costs are admitted to be…

Probability · Mathematics 2012-01-04 Xianping Guo , Xinyuan Song

On-line firms deploy suites of software platforms, where each platform is designed to interact with users during a certain activity, such as browsing, chatting, socializing, emailing, driving, etc. The economic and incentive structure of…

Computer Science and Game Theory · Computer Science 2021-07-14 Christos Papadimitriou , Kiran Vodrahalli , Mihalis Yannakakis

In this paper, we study Markov Decision Processes (MDPs) with self-triggered strategies, where the idea of self-triggered control is extended to more generic MDP models. This extension broadens the application of self-triggering policies to…

Systems and Control · Electrical Eng. & Systems 2021-02-18 Yunhan Huang , Quanyan Zhu

Often we consider machine learning models or statistical analysis methods which we endeavour to alter, by introducing a randomized mechanism, to make the model conform to a differential privacy constraint. However, certain models can often…

Machine Learning · Computer Science 2024-05-24 Jack Fitzsimons , Agustín Freitas Pasqualini , Robert Pisarczyk , Dmitrii Usynin

When multiple parties that deal with private data aim for a collaborative prediction task such as medical image classification, they are often constrained by data protection regulations and lack of trust among collaborating parties. If done…

Cryptography and Security · Computer Science 2021-02-22 Ismat Jarin , Birhanu Eshete

This paper aims to provide differential privacy (DP) guarantees for Markov chain Monte Carlo (MCMC) algorithms. In a first part, we establish DP guarantees on samples output by MCMC algorithms as well as Monte Carlo estimators associated…

Machine Learning · Statistics 2025-11-04 Andrea Bertazzi , Tim Johnston , Gareth O. Roberts , Alain Durmus

Machine learning (ML) algorithms rely primarily on the availability of training data, and, depending on the domain, these data may include sensitive information about the data providers, thus leading to significant privacy issues.…

Machine Learning · Computer Science 2024-05-24 Karima Makhlouf , Tamara Stefanovic , Heber H. Arcolezi , Catuscia Palamidessi

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie