English
Related papers

Related papers: Differential Privacy in Generative AI Agents: Anal…

200 papers

Collecting and analyzing massive data generated from smart devices have become increasingly pervasive in crowdsensing, which are the building blocks for data-driven decision-making. However, extensive statistics and analysis of such data…

Cryptography and Security · Computer Science 2021-01-29 Teng Wang , Xuefeng Zhang , Jingyu Feng , Xinyu Yang

Local differential privacy (LDP) has emerged as a promising paradigm for privacy-preserving data collection in distributed systems, where users contribute multi-dimensional records with potentially correlated attributes. Recent work has…

Cryptography and Security · Computer Science 2025-08-20 Sandaru Jayawardana , Sennur Ulukus , Ming Ding , Kanchana Thilakarathna

Differential privacy is a privacy measure based on the difficulty of discriminating between similar input data. In differential privacy analysis, similar data usually implies that their distance does not exceed a predetermined threshold.…

Optimization and Control · Mathematics 2021-06-25 Genki Sugiura , Kaito Ito , Kenji Kashima

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Privacy policies help inform people about organisations' personal data processing practices, covering different aspects such as data collection, data storage, and sharing of personal data with third parties. Privacy policies are often…

Artificial Intelligence · Computer Science 2026-01-16 Haiyue Yuan , Nikolay Matyunin , Ali Raza , Shujun Li

Differential privacy is a popular privacy-enhancing technology that has been deployed both in industry and government agencies. Unfortunately, existing explanations of differential privacy fail to set accurate privacy expectations for data…

Cryptography and Security · Computer Science 2025-09-29 Mary Anne Smart , Priyanka Nanayakkara , Rachel Cummings , Gabriel Kaptchuk , Elissa Redmiles

The rise of reinforcement learning (RL) in critical real-world applications demands a fundamental rethinking of privacy in AI systems. Traditional privacy frameworks, designed to protect isolated data points, fall short for sequential…

Machine Learning · Computer Science 2025-06-19 Flint Xiaofeng Fan , Cheston Tan , Roger Wattenhofer , Yew-Soon Ong

Large Language Models (LLMs) are increasingly being used for automated evaluations and explaining them. However, concerns about explanation quality, consistency, and hallucinations remain open research challenges, particularly in…

Human-Computer Interaction · Computer Science 2025-04-18 Vincent Freiberger , Arthur Fleig , Erik Buchmann

We present an optimization framework for solving multi-agent nonlinear programs subject to inequality constraints while keeping the agents' state trajectories private. Each agent has an objective function depending only upon its own state…

Optimization and Control · Mathematics 2016-08-03 Matthew Hale , Magnus Egerstedt

With the rapid advancement of large models (LMs), the development of general-purpose intelligent agents powered by LMs has become a reality. It is foreseeable that in the near future, LM-driven general AI agents will serve as essential…

Artificial Intelligence · Computer Science 2025-06-03 Yuntao Wang , Yanghe Pan , Zhou Su , Yi Deng , Quan Zhao , Linkang Du , Tom H. Luan , Jiawen Kang , Dusit Niyato

The potential risk of privacy leakage prevents users from sharing their honest opinions on social platforms. This paper addresses the problem of privacy preservation if the query returns the histogram of rankings. The framework of…

Artificial Intelligence · Computer Science 2014-09-25 Shang Shang , Tiance Wang , Paul Cuff , Sanjeev Kulkarni

AI-based systems, including Large Language Models (LLM), impact millions by supporting diverse tasks but face issues like misinformation, bias, and misuse. AI ethics is crucial as new technologies and concerns emerge, but objective,…

Computers and Society · Computer Science 2025-05-19 José Antonio Siqueira de Cerqueira , Mamia Agbese , Rebekah Rousi , Nannan Xi , Juho Hamari , Pekka Abrahamsson

Alternating Direction Method of Multipliers (ADMM) is a widely used tool for machine learning in distributed settings, where a machine learning model is trained over distributed data sources through an interactive process of local…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Rui Hu , Yuanxiong Guo , Eric Chan-Tin , Yanmin Gong

Large Language Models (LLMs) have become integral to numerous domains, significantly advancing applications in data management, mining, and analysis. Their profound capabilities in processing and interpreting complex language data, however,…

Cryptography and Security · Computer Science 2024-09-09 Qinbin Li , Junyuan Hong , Chulin Xie , Jeffrey Tan , Rachel Xin , Junyi Hou , Xavier Yin , Zhun Wang , Dan Hendrycks , Zhangyang Wang , Bo Li , Bingsheng He , Dawn Song

With the development of Big Data and cloud data sharing, privacy preserving data publishing becomes one of the most important topics in the past decade. As one of the most influential privacy definitions, differential privacy provides a…

Cryptography and Security · Computer Science 2017-10-17 Tianqing Zhu , Ping Xiong , Gang Li , Wanlei Zhou , Philip S. Yu

The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines. On the one hand, powerful language models, trained on…

Computation and Language · Computer Science 2024-10-01 Haoran Li , Yulin Chen , Jinglong Luo , Jiecong Wang , Hao Peng , Yan Kang , Xiaojin Zhang , Qi Hu , Chunkit Chan , Zenglin Xu , Bryan Hooi , Yangqiu Song

Privacy-preserving machine learning (PPML) is critical to ensure data privacy in AI. Over the past few years, the community has proposed a wide range of provably secure PPML schemes that rely on various cryptography primitives. However,…

Cryptography and Security · Computer Science 2025-08-06 Mengyu Zhang , Zhuotao Liu , Jingwen Huang , Xuanqi Liu

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

In this paper, we introduce a novel concept of user-entity differential privacy (UeDP) to provide formal privacy protection simultaneously to both sensitive entities in textual data and data owners in learning natural language models…

Cryptography and Security · Computer Science 2022-11-10 Phung Lai , NhatHai Phan , Tong Sun , Rajiv Jain , Franck Dernoncourt , Jiuxiang Gu , Nikolaos Barmpalios

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili