English
Related papers

Related papers: Reasoning over Public and Private Data in Retrieva…

200 papers

Personalized health analytics increasingly rely on population benchmarks to provide contextual insights such as ''How do I compare to others like me?'' However, cohort-based aggregation of health data introduces nontrivial privacy risks,…

Cryptography and Security · Computer Science 2026-01-21 Richik Chakraborty , Lawrence Liu , Syed Hasnain

An accountable algorithmic transparency report (ATR) should ideally investigate the (a) transparency of the underlying algorithm, and (b) fairness of the algorithmic decisions, and at the same time preserve data subjects' privacy. However,…

Machine Learning · Computer Science 2021-04-19 Chien-Lun Chen , Leana Golubchik , Ranjan Pal

Retrieval based open-domain QA systems use retrieved documents and answer-span selection over retrieved documents to find best-answer candidates. We hypothesize that multilingual Question Answering (QA) systems are prone to information…

Computation and Language · Computer Science 2022-05-26 Shramay Palta , Haozhe An , Yifan Yang , Shuaiyi Huang , Maharshi Gor

With the development of Big Data and cloud data sharing, privacy preserving data publishing becomes one of the most important topics in the past decade. As one of the most influential privacy definitions, differential privacy provides a…

Cryptography and Security · Computer Science 2017-10-17 Tianqing Zhu , Ping Xiong , Gang Li , Wanlei Zhou , Philip S. Yu

In a Public Safety (PS) situation, agents may require critical and personally identifiable information. Therefore, not only does context and location-aware information need to be available, but also the privacy of such information should be…

Cryptography and Security · Computer Science 2016-11-18 Hamidreza Ghafghazi , Amr ElMougy , Hussein T. Mouftah , Carlisle Adams

The literature on differential privacy almost invariably assumes that the data to be analyzed are fully observed. In most practical applications this is an unrealistic assumption. A popular strategy to address this problem is imputation, in…

Databases · Computer Science 2022-07-15 Soumojit Das , Jorg Drechsler , Keith Merrill , Shawn Merrill

Users worldwide access massive amounts of curated data in the form of rankings on a daily basis. The societal impact of this ease of access has been studied and work has been done to propose and enforce various notions of fairness in…

Information Retrieval · Computer Science 2023-03-07 Jia Ao Sun , Sikha Pentyala , Martine De Cock , Golnoosh Farnadi

In the privacy-utility tradeoff of a model trained on benchmark language and vision tasks, remarkable improvements have been widely reported with the use of pretraining on publicly available data. This is in part due to the benefits of…

Machine Learning · Computer Science 2023-02-21 Arun Ganesh , Mahdi Haghifam , Milad Nasr , Sewoong Oh , Thomas Steinke , Om Thakkar , Abhradeep Thakurta , Lun Wang

Personalized AI agents rely on access to a user's digital footprint, which often includes sensitive data from private emails, chats and purchase histories. Yet this access creates a fundamental societal and privacy risk: systems lacking…

Computation and Language · Computer Science 2026-01-01 Srija Mukhopadhyay , Sathwik Reddy , Shruthi Muthukumar , Jisun An , Ponnurangam Kumaraguru

Machine learning is increasingly used in the most diverse applications and domains, whether in healthcare, to predict pathologies, or in the financial sector to detect fraud. One of the linchpins for efficiency and accuracy in machine…

Machine Learning · Computer Science 2022-01-17 Tânia Carvalho , Nuno Moniz , Pedro Faria , Luís Antunes

Ensuring privacy during inference stage is crucial to prevent malicious third parties from reconstructing users' private inputs from outputs of public models. Despite a large body of literature on privacy preserving learning (which ensures…

Cryptography and Security · Computer Science 2024-12-02 Fengwei Tian , Ravi Tandon

Differential privacy formalises privacy-preserving mechanisms that provide access to a database. We pose the question of whether Bayesian inference itself can be used directly to provide private access to data, with no modification. The…

Suppose we would like to know all answers to a set of statistical queries C on a data set up to small error, but we can only access the data itself using statistical queries. A trivial solution is to exhaustively ask all queries in C. Can…

Data Structures and Algorithms · Computer Science 2011-10-28 Anupam Gupta , Moritz Hardt , Aaron Roth , Jonathan Ullman

Post-processing immunity is a fundamental property of differential privacy: it enables arbitrary data-independent transformations to differentially private outputs without affecting their privacy guarantees. Post-processing is routinely…

Cryptography and Security · Computer Science 2022-01-25 Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

Considering the limited internal parametric knowledge, retrieval-augmented generation (RAG) has been widely used to extend the knowledge scope of large language models (LLMs). Despite the extensive efforts on RAG research, in existing…

Computation and Language · Computer Science 2024-11-22 Yuhao Wang , Ruiyang Ren , Junyi Li , Wayne Xin Zhao , Jing Liu , Ji-Rong Wen

A large number of services for research data management strive to adhere to the FAIR guiding principles for scientific data management and stewardship. To evaluate these services and to indicate possible improvements, use-case-centric…

Computers and Society · Computer Science 2019-02-01 Tobias Weber , Dieter Kranzlmüller

Retrieval-Augmented Generation (RAG) is a promising technique for applying LLMs to proprietary domains. However, retrieved documents may contain sensitive knowledge, posing risks of privacy leakage in generative results. Thus, effectively…

Computation and Language · Computer Science 2025-04-15 Yujing Wang , Hainan Zhang , Liang Pang , Yongxin Tong , Binghui Guo , Hongwei Zheng , Zhiming Zheng

Modern machine learning systems use models trained on ever-growing corpora. Typically, metadata such as ownership, access control, or licensing information is ignored during training. Instead, to mitigate privacy risks, we rely on generic…