English
Related papers

Related papers: Efficient and Model-Agnostic Parameter Estimation …

200 papers

Statistical model checking is a class of sequential algorithms that can verify specifications of interest on an ensemble of cyber-physical systems (e.g., whether 99% of cars from a batch meet a requirement on their energy efficiency). These…

Machine Learning · Computer Science 2022-06-29 Yu Wang , Hussein Sibai , Mark Yen , Sayan Mitra , Geir E. Dullerud

Optimum parameter estimation methods require knowledge of a parametric probability density that statistically describes the available observations. In this work we examine Bayesian and non-Bayesian parameter estimation problems under a…

Applications · Statistics 2022-02-01 George V. Moustakides

We develop a theory of asymptotic efficiency in regular parametric models when data confidentiality is ensured by local differential privacy (LDP). Even though efficient parameter estimation is a classical and well-studied problem in…

Statistics Theory · Mathematics 2024-03-08 Lukas Steinberger

In this paper we focus on the dynamic state estimation which harnesses a vast amount of sensing data harvested by multiple parties and recognize that in many applications, to improve collaborations between parties, the estimation procedure…

Systems and Control · Electrical Eng. & Systems 2021-01-05 Yuqing Ni , Junfeng Wu , Li Li , Ling Shi

Bootstrap is a common tool for quantifying uncertainty in data analysis. However, besides additional computational costs in the application of the bootstrap on massive data, a challenging problem in bootstrap based inference under…

Machine Learning · Statistics 2025-05-05 Holger Dette , Carina Graw

For the general parametric regression models with covariates contaminated with normal measurement errors, this paper proposes an accelerated version of the classical simulation extrapolation algorithm to estimate the unknown parameters in…

Methodology · Statistics 2021-07-13 Kanwal Ayub , Weixing Song

In statistical learning and analysis from shared data, which is increasingly widely adopted in platforms such as federated learning and meta-learning, there are two major concerns: privacy and robustness. Each participating individual…

Machine Learning · Computer Science 2021-11-25 Xiyang Liu , Weihao Kong , Sham Kakade , Sewoong Oh

Distributed control/optimization is a promising approach for network systems due to its advantages over centralized schemes, such as robustness, cost-effectiveness, and improved privacy. However, distributed methods can have drawbacks, such…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Chin-Yao Chang

We consider the problem of estimating a regression function from anonymized data in the framework of local differential privacy. We propose a novel partitioning estimate of the regression function, derive a rate of convergence for the…

Statistics Theory · Mathematics 2023-04-12 László Györfi , Martin Kroll

In this paper, we focus our attention on private Empirical Risk Minimization (ERM), which is one of the most commonly used data analysis method. We take the first step towards solving the above problem by theoretically exploring the effect…

Cryptography and Security · Computer Science 2022-06-09 Yuzhe Li , Yong Liu , Bo Li , Weiping Wang , Nan Liu

This work considers computationally efficient privacy-preserving data release. We study the task of analyzing a database containing sensitive information about individual participants. Given a set of statistical queries on the data, we want…

Computational Complexity · Computer Science 2011-07-14 Moritz Hardt , Guy N. Rothblum , Rocco A. Servedio

This paper deals with parameter estimation from extreme measurements. While being a special case of parameter estimation from partial data, in scenarios where only one sample from a given set of K measurements can be extracted, choosing…

Signal Processing · Electrical Eng. & Systems 2018-09-25 Jonatan Ostrometzky , Hagit Messer

How to properly set the privacy parameter in differential privacy (DP) has been an open question in DP research since it was first proposed in 2006. In this work, we demonstrate the ability of influence functions to offer insight into how a…

Machine Learning · Computer Science 2023-09-19 Alycia N. Carey , Minh-Hao Van , Xintao Wu

It is difficult to continually update private machine learning models with new data while maintaining privacy. Data incur increasing privacy loss -- as measured by differential privacy -- when they are used in repeated computations. In this…

Machine Learning · Computer Science 2022-03-08 Lauren Watson , Abhirup Ghosh , Benedek Rozemberczki , Rik Sarkar

In Semi-Supervised Semi-Private (SP) learning, the learner has access to both public unlabelled and private labelled data. We propose a computationally efficient algorithm that, under mild assumptions on the data, provably achieves…

Machine Learning · Computer Science 2023-06-08 Francesco Pinto , Yaxi Hu , Fanny Yang , Amartya Sanyal

In this paper, we develop an information-theoretic framework for the optimal privacy-aware estimation of the states of a (linear or nonlinear) system. In our setup, a private process, modeled as a first-order Markov chain, derives the…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Chuanghong Weng , Ehsan Nekouei , Karl H. Johansson

Amplification by subsampling is one of the main primitives in machine learning with differential privacy (DP): Training a model on random batches instead of complete datasets results in stronger privacy. This is traditionally formalized via…

Cryptography and Security · Computer Science 2024-11-04 Jan Schuchardt , Mihail Stoian , Arthur Kosmala , Stephan Günnemann

The Gaussian mechanism is an essential building block used in multitude of differentially private data analysis algorithms. In this paper we revisit the Gaussian mechanism and show that the original analysis has several important…

Machine Learning · Computer Science 2018-06-08 Borja Balle , Yu-Xiang Wang

Differential privacy is widely adopted to provide provable privacy guarantees in data analysis. We consider the problem of combining public and private data (and, more generally, data with heterogeneous privacy needs) for estimating…

Machine Learning · Computer Science 2021-11-02 Cecilia Ferrando , Jennifer Gillenwater , Alex Kulesza

In sensitive applications involving relational datasets, protecting information about individual links from adversarial queries is of paramount importance. In many such settings, the available data are summarized solely through the degrees…

Machine Learning · Statistics 2026-02-05 Bibhabasu Mandal , Sagnik Nandy