English
Related papers

Related papers: Truthful High Dimensional Sparse Linear Regression

200 papers

We study truthful mechanisms for matching and related problems in a partial information setting, where the agents' true utilities are hidden, and the algorithm only has access to ordinal preference information. Our model is motivated by the…

Computer Science and Game Theory · Computer Science 2016-10-20 Elliot Anshelevich , Shreyas Sekar

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

We study mean estimation for Gaussian distributions under \textit{personalized differential privacy} (PDP), where each record has its own privacy budget. PDP is commonly considered in two variants: \textit{bounded} and \textit{unbounded}…

Data Structures and Algorithms · Computer Science 2026-01-23 Wei Dong , Li Ge

We study resource allocation problems in which a central planner allocates resources among strategic agents with private cost functions in order to minimize a social cost, defined as an aggregate of the agents' costs. This setting poses two…

Computer Science and Game Theory · Computer Science 2026-03-19 Leo Landolt , Anna Maddux , Andreas Schlaginhaufen , Saurabh Vaishampayan , Maryam Kamgarpour

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

A game-theoretic model for analysing the effects of privacy on strategic communication between agents is devised. In the model, a sender wishes to provide an accurate measurement of the state to a receiver while also protecting its private…

Optimization and Control · Mathematics 2016-11-15 Farhad Farokhi , Henrik Sandberg , Iman Shames , Michael Cantoni

We study instrumental variable regression (IVaR) under differential privacy constraints. Classical IVaR methods (like two-stage least squares regression) rely on solving moment equations that directly use sensitive covariates and…

Machine Learning · Statistics 2026-02-17 Haodong Liang , Yanhao Jin , Krishnakumar Balasubramanian , Lifeng Lai

We consider the privacy problem of statistical estimation from distributed data, where users communicate to a central processor over a Gaussian multiple-access channel(MAC). To avoid the inevitable sacrifice of data utility for privacy in…

Information Theory · Computer Science 2020-11-03 Wenhao Zhan

We present a novel approach to address the multi-agent sparse contextual linear bandit problem, in which the feature vectors have a high dimension $d$ whereas the reward function depends on only a limited set of features - precisely $s_0…

Machine Learning · Computer Science 2023-05-31 Haniyeh Barghi , Xiaotong Cheng , Setareh Maghsudi

We propose a novel mechanism for answering sets of count- ing queries under differential privacy. Given a workload of counting queries, the mechanism automatically selects a different set of "strategy" queries to answer privately, using…

Databases · Computer Science 2012-02-20 Chao Li , Gerome Miklau

We study private matrix analysis in the sliding window model where only the last $W$ updates to matrices are considered useful for analysis. We give first efficient $o(W)$ space differentially private algorithms for spectral approximation,…

Machine Learning · Computer Science 2020-09-08 Jalaj Upadhyay , Sarvagya Upadhyay

In this paper, we study a stochastic disclosure control problem using information-theoretic methods. The useful data to be disclosed depend on private data that should be protected. Thus, we design a privacy mechanism to produce new data…

Information Theory · Computer Science 2021-03-24 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

In this paper we revisit the classical problem of nonparametric regression, but impose local differential privacy constraints. Under such constraints, the raw data $(X_1,Y_1),\ldots,(X_n,Y_n)$, taking values in $\mathbb{R}^d \times…

Statistics Theory · Mathematics 2020-11-03 Thomas Berrett , László Györfi , Harro Walk

To reduce the communication cost of differential privacy mechanisms, we introduce a novel construction, called Poisson private representation (PPR), designed to compress and simulate any local randomizer while ensuring local differential…

Cryptography and Security · Computer Science 2024-11-12 Yanxiao Liu , Wei-Ning Chen , Ayfer Özgür , Cheuk Ting Li

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan

Differential Privacy (DP) provides a rigorous framework for releasing statistics while protecting individual information present in a dataset. Although substantial progress has been made on differentially private linear regression, existing…

Statistics Theory · Mathematics 2026-01-16 Getoar Sopa , Marco Avella Medina , Cynthia Rush

We study the value of data privacy in a game-theoretic model of trading private data, where a data collector purchases private data from strategic data subjects (individuals) through an incentive mechanism. The private data of each…

Computer Science and Game Theory · Computer Science 2016-03-23 Weina Wang , Lei Ying , Junshan Zhang

While the SLIM approach obtained high ranking-accuracy in many experiments in the literature, it is also known for its high computational cost of learning its parameters from data. For this reason, we focus in this paper on variants of…

Information Retrieval · Computer Science 2019-05-01 Harald Steck