English
Related papers

Related papers: Leveraging Public Data for Practical Private Query…

200 papers

Pre-training on public data is an effective method to improve the performance for federated learning (FL) with differential privacy (DP). This paper investigates how large language models (LLMs) trained on public data can improve the…

Machine Learning · Computer Science 2024-08-08 Shanshan Wu , Zheng Xu , Yanxiang Zhang , Yuanbo Zhang , Daniel Ramage

Populations of interest are often hidden from data for a variety of reasons, though their magnitude remains important in determining resource allocation and appropriate policy. One popular approach to population size estimation, the…

Methodology · Statistics 2025-06-27 Mallory J Flynn , Paul Gustafson

We consider the problem of the private release of statistics (like aggregate payrolls) where it is critical to preserve the contribution made by a small number of outlying large entities. We propose a privacy formalism, per-record zero…

Databases · Computer Science 2024-12-19 Jeremy Seeman , William Sexton , David Pujol , Ashwin Machanavajjhala

Public data has been frequently used to improve the privacy-accuracy trade-off of differentially private machine learning, but prior work largely assumes that this data come from the same distribution as the private. In this work, we look…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ruihan Wu , Chuan Guo , Kamalika Chaudhuri

Simulation studies are commonly used to evaluate the performance of newly developed meta-analysis methods. For methodology that is developed for an aggregated data meta-analysis, researchers often resort to simulation of the aggregated data…

Applications · Statistics 2022-01-19 Edwin R. van den Heuvel , Osama Almalik , Zhuozhao Zhan

Dataset distillation aims to synthesize compact yet informative datasets from large ones. A significant challenge in this field is achieving a trifecta of diversity, generalization, and representativeness in a single distilled dataset.…

Machine Learning · Computer Science 2026-04-06 Duo Su , Huyu Wu , Huanran Chen , Yiming Shi , Yuzhu Wang , Xi Ye , Jun Zhu

Public sentiment is a direct public-centric indicator for the success of effective action planning. Despite its importance, systematic modeling of public sentiment remains untapped in previous studies. This research aims to develop a…

Social and Information Networks · Computer Science 2020-04-07 Yudi Chen , Qi Wang , Wenying Ji

As the U.S. Census Bureau implements its controversial new disclosure avoidance system, researchers and policymakers debate the necessity of new privacy protections for public statistics. With experiments on both public statistics and…

Computers and Society · Computer Science 2025-08-22 Ryan Steed , Diana Qing , Zhiwei Steven Wu

When complex Bayesian models exhibit implausible behaviour, one solution is to assemble available information into an informative prior. Challenges arise as prior information is often only available for the observable quantity, or some…

Methodology · Statistics 2026-03-18 Andrew A. Manderson , Robert J. B. Goudie

Suppose we would like to know all answers to a set of statistical queries C on a data set up to small error, but we can only access the data itself using statistical queries. A trivial solution is to exhaustively ask all queries in C. Can…

Data Structures and Algorithms · Computer Science 2011-10-28 Anupam Gupta , Moritz Hardt , Aaron Roth , Jonathan Ullman

Group based anonymization is the most widely studied approach for privacy preserving data publishing. This includes k-anonymity, l-diversity, and t-closeness, to name a few. The goal of this paper is to raise a fundamental issue on the…

Databases · Computer Science 2009-05-13 Raymond Chi-Wing Wong , Ada Wai-Chee Fu , Ke Wang , Yabo Xu , Philip S. Yu

The popularity of the online media-driven social network relation is proven in today's digital era. The many challenges that these emergence has created include a huge growing network of social relations, and the large amount of data which…

Social and Information Networks · Computer Science 2021-05-25 Shahab Saquib Sohail , Mohammad Muzammil Khan , Mohd Arsalan , Aslam Khan , Jamshed Siddiqui , Syed Hamid Hasan , M. Afshar Alam

Differential privacy allows quantifying privacy loss resulting from accessing sensitive personal data. Repeated accesses to underlying data incur increasing loss. Releasing data as privacy-preserving synthetic data would avoid this…

Machine Learning · Statistics 2021-06-10 Joonas Jälkö , Eemil Lagerspetz , Jari Haukka , Sasu Tarkoma , Antti Honkela , Samuel Kaski

This paper develops Bayesian sample size formulae for experiments comparing two groups. We assume the experimental data will be analysed in the Bayesian framework, where pre-experimental information from multiple sources can be represented…

Methodology · Statistics 2022-03-09 Haiyan Zheng , Thomas Jaki , James M. S. Wason

Data publishing under privacy constraints can be achieved with mechanisms that add randomness to data points when released to an untrusted party, thereby decreasing the data's utility. In this paper, we analyze this privacy-utility tradeoff…

Information Theory · Computer Science 2024-08-28 Leonhard Grosse , Sara Saeidian , Tobias Oechtering

We identify fundamental tradeoffs between statistical utility and privacy under local models of privacy in which data is kept private even from the statistician, providing instance-specific bounds for private estimation and learning…

Statistics Theory · Mathematics 2020-10-01 John C. Duchi , Feng Ruan

This paper develops a framework to study the statistical power of revealed-preference tests. With randomly sampled budgets and mild smoothness of demand, statistical learning implies that any model consistent with the data must approximate…

Theoretical Economics · Economics 2026-02-12 Charles Gauthier , Raghav Malhotra , Agustin Troccoli Moretti

Several official statistics agencies release synthetic data as public use microdata files. In practice, synthetic data do not admit accurate results for every analysis. Thus, it is beneficial for agencies to provide users with feedback on…

Cryptography and Security · Computer Science 2024-04-04 Tong Lin , Jerome P. Reiter

Sharing sensitive time series data in domains such as finance, healthcare, and energy consumption, such as patient records or investment accounts, is often restricted due to privacy concerns. Privacy-aware synthetic time series generation…

Machine Learning · Computer Science 2025-11-04 Penghang Liu , Haibei Zhu , Eleonora Kreacic , Svitlana Vyetrenko

We study (differentially) private federated learning (FL) of language models. The language models in cross-device FL are relatively small, which can be trained with meaningful formal user-level differential privacy (DP) guarantees when…

Machine Learning · Computer Science 2024-04-16 Boxin Wang , Yibo Jacky Zhang , Yuan Cao , Bo Li , H. Brendan McMahan , Sewoong Oh , Zheng Xu , Manzil Zaheer