English
Related papers

Related papers: A note on privacy preserving iteratively reweighte…

200 papers

In this paper, we initiate a systematic investigation of differentially private algorithms for convex empirical risk minimization. Various instantiations of this problem have been studied before. We provide new algorithms and matching lower…

Machine Learning · Computer Science 2014-10-21 Raef Bassily , Adam Smith , Abhradeep Thakurta

Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small.…

Numerical Analysis · Mathematics 2022-10-11 Yizhou Chen , Xiaoyun Gong , Xiang Ji

Distributed machine learning is an approach allowing different parties to learn a model over all data sets without disclosing their own data. In this paper, we propose a weighted distributed differential privacy (WD-DP) empirical risk…

Machine Learning · Computer Science 2021-10-22 Yilin Kang , Yong Liu , Weiping Wang

In this paper, we present a new method for the multiview registration of point cloud. Previous multiview registration methods rely on exhaustive pairwise registration to construct a densely-connected pose graph and apply Iteratively…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Haiping Wang , Yuan Liu , Zhen Dong , Yulan Guo , Yu-Shen Liu , Wenping Wang , Bisheng Yang

Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the…

Machine Learning · Computer Science 2019-10-16 Frederik Harder , Jonas Köhler , Max Welling , Mijung Park

Privacy-preserving distributed processing has recently attracted considerable attention. It aims to design solutions for conducting signal processing tasks over networks in a decentralized fashion without violating privacy. Many algorithms…

Cryptography and Security · Computer Science 2020-09-03 Qiongxiu Li , Jaron Skovsted Gundersen , Richard Heusdens , Mads Græsbøll Christensen

Various approaches to iterative refinement (IR) for least-squares problems have been proposed in the literature and it may not be clear which approach is suitable for a given problem. We consider three approaches to IR for least-squares…

Numerical Analysis · Mathematics 2025-01-20 Erin Carson , Ieva Daužickaitė

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Internet of Things devices are expanding rapidly and generating huge amount of data. There is an increasing need to explore data collected from these devices. Collaborative learning provides a strategic solution for the Internet of Things…

Cryptography and Security · Computer Science 2022-07-21 Guanhong Miao

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan

Iterative algorithms for differential privacy run for a fixed number of iterations, where each iteration learns some information from data and produces an intermediate output. However, the algorithm only releases the output of the last…

Data Structures and Algorithms · Computer Science 2016-09-13 Jaewoo Lee , Daniel Kifer

To conduct regression analysis for data contaminated with outliers, many approaches have been proposed for simultaneous outlier detection and robust regression, so is the approach proposed in this manuscript. This new approach is called…

Methodology · Statistics 2016-03-25 Xiaoli Gao , Yixin Fang

The 2D phase unwrapping problem seeks to recover a phase image from its observation modulo 2$\pi$, and is a crucial step in a variety of imaging applications. In particular, it is one of the most time-consuming steps in the interferometric…

Optimization and Control · Mathematics 2024-01-19 Benjamin Dubois-Taine , Roland Akiki , Alexandre d'Aspremont

Solving linear discrete ill-posed problems for third order tensor equations based on a tensor t-product has attracted much attention. But when the data tensor is produced continuously, current algorithms are not time-saving. Here, we…

Numerical Analysis · Mathematics 2021-11-30 Zhengbang Cao , Pengpeng Xie

The least-mean-squares (LMS) algorithm is the most popular algorithm in adaptive filtering. Several variable step-size strategies have been suggested to improve the performance of the LMS algorithm. These strategies enhance the performance…

Data Structures and Algorithms · Computer Science 2017-03-22 Muhammad Omer Bin Saeed

An interference-normalised least mean square (INLMS) algorithm for robust adaptive filtering is proposed. The INLMS algorithm extends the gradient-adaptive learning rate approach to the case where the signals are non-stationary. In…

Systems and Control · Computer Science 2016-02-29 Jean-Marc Valin , Iain B. Collings

In this paper, we initiate the systematic study of solving linear programs under differential privacy. The first step is simply to define the problem: to this end, we introduce several natural classes of private linear programs that capture…

Data Structures and Algorithms · Computer Science 2018-03-16 Justin Hsu , Aaron Roth , Tim Roughgarden , Jonathan Ullman

Recent large-scale natural language processing (NLP) systems use a pre-trained Large Language Model (LLM) on massive and diverse corpora as a headstart. In practice, the pre-trained model is adapted to a wide array of tasks via fine-tuning…

Computation and Language · Computer Science 2022-09-12 Jimit Majmudar , Christophe Dupuy , Charith Peris , Sami Smaili , Rahul Gupta , Richard Zemel

One-shot federated learning enables multi-site inference with minimal communication. However, sharing summary statistics can still leak sensitive individual-level information when sites have only a small number of patients. In particular,…

Methodology · Statistics 2026-04-02 Keisuke Hanada , Toshio Shimokawa , Kazushi Maruo

We study the statistical complexity of private linear regression under an unknown, potentially ill-conditioned covariate distribution. Somewhat surprisingly, under privacy constraints the intrinsic complexity is \emph{not} captured by the…

Machine Learning · Computer Science 2025-11-06 Fan Chen , Jiachun Li , Alexander Rakhlin , David Simchi-Levi