English
Related papers

Related papers: Hypothesis Testing for Differentially Private Line…

200 papers

Federated learning has attracted significant recent attention due to its applicability across a wide range of settings where data is collected and analyzed across disparate locations. In this paper, we study federated nonparametric…

Statistics Theory · Mathematics 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

The paper concerns inference in the ill-conditioned functional response model, which is a part of functional data analysis. In this regression model, the functional response is modeled using several independent scalar variables. To verify…

Methodology · Statistics 2024-10-07 Łukasz Smaga , Natalia Stefańska

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

Experiments often yield non-identically distributed data for statistical analysis. Tests of hypothesis under such set-ups are generally performed using the likelihood ratio test, which is non-robust with respect to outliers and model…

Statistics Theory · Mathematics 2017-07-25 Abhik Ghosh , Ayanendranath Basu

This paper considers the problem of robust hypothesis testing under non-identically distributed data. We propose Wald-type tests for both simple and composite hypothesis for independent but non-homogeneous observations based on the robust…

Methodology · Statistics 2019-05-09 Ayanendranath Basu , Abhik Ghosh , Nirian Martin , Leandro Pardo

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

Distance-based regression model, as a nonparametric multivariate method, has been widely used to detect the association between variations in a distance or dissimilarity matrix for outcomes and predictor variables of interest in genetic…

Statistics Theory · Mathematics 2022-03-14 Yuke Shi , Wei Zhang , Aiyi Liu , Qizhai Li

Deep learning methods have proved highly effective for classification and image recognition problems. In this paper, we ask whether this success can be transferred to hypothesis testing: if a neural network can distinguish, for example, an…

Machine Learning · Statistics 2026-04-30 Gery Geenens , Pierre Lafaye de Micheaux , Ivan Muyun Zou

Differentially private federated learning is crucial for maintaining privacy in distributed environments. This paper investigates the challenges of high-dimensional estimation and inference under the constraints of differential privacy.…

Machine Learning · Statistics 2024-04-26 Zhe Zhang , Ryumei Nakada , Linjun Zhang

Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals…

Machine Learning · Computer Science 2019-10-30 Garrett Bernstein , Daniel Sheldon

We initiate the study of differentially private learning in the proportional dimensionality regime, in which the number of data samples $n$ and problem dimension $d$ approach infinity at rates proportional to one another, meaning that…

Machine Learning · Computer Science 2025-02-20 Cynthia Dwork , Pranay Tankala , Linjun Zhang

Linear regression is frequently applied in a variety of domains, some of which might contain sensitive information. This necessitates that the application of these methods does not reveal private information. Differentially private (DP)…

Machine Learning · Computer Science 2025-12-01 Shrutimoy Das , Debanuj Nayak , Anirban Dasgupta

Large pretrained models can be privately fine-tuned to achieve performance approaching that of non-private models. A common theme in these results is the surprising observation that high-dimensional models can achieve favorable…

We provide computationally efficient, differentially private algorithms for the classical regression settings of Least Squares Fitting, Binary Regression and Linear Regression with unbounded covariates. Prior to our work, privacy…

Cryptography and Security · Computer Science 2022-02-24 Jason Milionis , Alkis Kalavasis , Dimitris Fotakis , Stratis Ioannidis

This paper presents a hypothesis testing method given independent samples from a number of connected populations. The method is motivated by a forestry project for monitoring change in the strength of lumber. Traditional practice has been…

Statistics Theory · Mathematics 2015-05-15 Song Cai , Jiahua Chen , James V. Zidek

Privacy protection methods, such as differentially private mechanisms, introduce noise into resulting statistics which often produces complex and intractable sampling distributions. In this paper, we propose a simulation-based "repro…

Statistics Theory · Mathematics 2024-11-07 Jordan Awan , Zhanyu Wang

Recently, several authors have re-examined the power of the classical F-test in linear regression in a `large-p, large-n' framework (cf. Zhong and Chen (2011), Wang and Cui (2013)). They highlight the loss of power as the number of…

Statistics Theory · Mathematics 2016-11-08 Lukas Steinberger

Hypothesis testing in singular statistical models is often regarded as inherently problematic due to non-identifiability and degeneracy of the Fisher information. We show that the fundamental obstruction to testing in such models is not…

Statistics Theory · Mathematics 2026-03-02 Sean Plummer

In the social sciences, small- to medium-scale datasets are common, and linear regression is canonical. In privacy-aware settings, much work has focused on differentially private (DP) linear regression, but mostly on point estimation with…

Machine Learning · Computer Science 2026-03-31 Shurong Lin , Aleksandra Slavković , Deekshith Reddy Bhoomireddy

Linear $L_1$-regularized models have remained one of the simplest and most effective tools in data analysis, especially in information retrieval problems where n-grams over text with TF-IDF or Okapi feature values are a strong and easy…

Machine Learning · Computer Science 2023-03-21 Amol Khanna , Fred Lu , Edward Raff