English
Related papers

Related papers: Training Data Reconstruction: Privacy due to Uncer…

200 papers

We study what provable privacy attacks can be shown on trained, 2-layer ReLU neural networks. We explore two types of attacks; data reconstruction attacks, and membership inference attacks. We prove that theoretical results on the implicit…

Machine Learning · Computer Science 2025-02-11 Guy Smorodinsky , Gal Vardi , Itay Safran

Machine Learning models are often trained on proprietary and private data that cannot be shared, though the trained models themselves are distributed openly assuming that sharing model weights is privacy preserving, as training data is not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Pirzada Suhail , Amit Sethi

Training data reconstruction from KKT conditions has shown striking empirical success, yet it remains unclear when the resulting KKT equations have unique solutions and, even in identifiable regimes, how to reliably recover solutions by…

Machine Learning · Computer Science 2026-02-10 Yujie Shen , Zihan Wang , Jian Qian , Qi Lei

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in…

Machine Learning · Statistics 2019-06-04 Abhishek Bhowmick , John Duchi , Julien Freudiger , Gaurav Kapoor , Ryan Rogers

We explore artificial neural networks as a tool for the reconstruction of spectral functions from imaginary time Green's functions, a classic ill-conditioned inverse problem. Our ansatz is based on a supervised learning framework in which…

Neural networks pose a privacy risk due to their propensity to memorise and leak training data. We show that unique features occurring only once in training data are memorised by discriminative multi-layer perceptrons and convolutional…

Machine Learning · Computer Science 2022-05-23 John Hartley , Sotirios A. Tsaftaris

Memorization of training data is an active research area, yet our understanding of the inner workings of neural networks is still in its infancy. Recently, Haim et al. (2022) proposed a scheme to reconstruct training samples from multilayer…

Machine Learning · Computer Science 2023-11-06 Gon Buzaglo , Niv Haim , Gilad Yehudai , Gal Vardi , Yakir Oz , Yaniv Nikankin , Michal Irani

When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels…

Machine Learning · Computer Science 2025-02-17 Alexander Capstick , Francesca Palermo , Tianyu Cui , Payam Barnaghi

Privacy becomes a crucial issue when outsourcing the training of machine learning (ML) models to cloud-based platforms offering machine-learning services. While solutions based on cryptographic primitives have been developed, they incur a…

Cryptography and Security · Computer Science 2020-10-21 Mathilde Raynal , Radhakrishna Achanta , Mathias Humbert

Federated learning (FL) is a privacy-preserving machine learning framework that enables multiple nodes to train models on their local data and periodically average weight updates to benefit from other nodes' training. Each node's goal is to…

Machine Learning · Computer Science 2025-06-16 Ethan Wilson , Kai Yue , Chau-Wai Wong , Huaiyu Dai

Privacy protection has always been an ongoing topic, especially for AI. Currently, a low-cost scheme called Machine Unlearning forgets the private data remembered in the model. Specifically, given a private dataset and a trained neural…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xin Su , Zhuoran Zheng

The idea of federated learning is to collaboratively train a neural network on a server. Each user receives the current weights of the network and in turns sends parameter updates (gradients) based on local data. This protocol has been…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jonas Geiping , Hartmut Bauermeister , Hannah Dröge , Michael Moeller

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Many imaging inverse problems$\unicode{x2014}$such as image-dependent in-painting and dehazing$\unicode{x2014}$are challenging because their forward models are unknown or depend on unknown latent parameters. While one can solve such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Matthew A. Chan , Sean I. Young , Christopher A. Metzler

In the privacy-utility tradeoff of a model trained on benchmark language and vision tasks, remarkable improvements have been widely reported with the use of pretraining on publicly available data. This is in part due to the benefits of…

Machine Learning · Computer Science 2023-02-21 Arun Ganesh , Mahdi Haghifam , Milad Nasr , Sewoong Oh , Thomas Steinke , Om Thakkar , Abhradeep Thakurta , Lun Wang

Transfer learning through the use of pre-trained models has become a growing trend for the machine learning community. Consequently, numerous pre-trained models are released online to facilitate further research. However, it raises…

Machine Learning · Computer Science 2022-07-26 Zhuowen Yuan , Fan Wu , Yunhui Long , Chaowei Xiao , Bo Li

Good training data is a prerequisite to develop useful ML applications. However, in many domains existing data sets cannot be shared due to privacy regulations (e.g., from medical studies). This work investigates a simple yet unconventional…

Convolutional Neural Networks are a well-known staple of modern image classification. However, it can be difficult to assess the quality and robustness of such models. Deep models are known to perform well on a given training and estimation…

Machine Learning · Statistics 2018-02-06 Alexey Chaplygin , Joshua Chacksfield

The idea of federated learning is to train deep neural network models collaboratively and share them with multiple participants without exposing their private training data to each other. This is highly attractive in the medical domain due…

Image and Video Processing · Electrical Eng. & Systems 2022-05-02 Mads Emil Dahlgaard , Morten Wehlast Jørgensen , Niels Asp Fuglsang , Hiba Nassar

Data privacy has emerged as an important issue as data-driven deep learning has been an essential component of modern machine learning systems. For instance, there could be a potential privacy risk of machine learning systems via the model…

Machine Learning · Computer Science 2019-11-25 Taihong Xiao , Yi-Hsuan Tsai , Kihyuk Sohn , Manmohan Chandraker , Ming-Hsuan Yang