English
Related papers

Related papers: Training Data Reconstruction: Privacy due to Uncer…

200 papers

Recent studies have shown that distributed machine learning is vulnerable to gradient inversion attacks, where private training data can be reconstructed by analyzing the gradients of the models shared in training. Previous attacks…

Machine Learning · Computer Science 2024-10-07 Weijun Li , Qiongkai Xu , Mark Dras

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Deep neural networks have become a primary tool for solving problems in many fields. They are also used for addressing information retrieval problems and show strong performance in several tasks. Training these models requires large,…

Information Retrieval · Computer Science 2017-07-25 Mostafa Dehghani , Hosein Azarbonyad , Jaap Kamps , Maarten de Rijke

Federated learning has emerged as a promising paradigm for collaborative model training while preserving data privacy. However, recent studies have shown that it is vulnerable to various privacy attacks, such as data reconstruction attacks.…

Cryptography and Security · Computer Science 2024-07-25 Xiaojin Zhang , Wei Chen

Training machine learning models based on neural networks requires large datasets, which may contain sensitive information. The models, however, should not expose private information from these datasets. Differentially private SGD [DP-SGD]…

Machine Learning · Computer Science 2024-09-26 Francisco Aguilera-Martínez , Fernando Berzal

One of the key limitations in conventional deep learning based image reconstruction is the need for registered pairs of training images containing a set of high-quality groundtruth images. This paper addresses this limitation by proposing a…

Image and Video Processing · Electrical Eng. & Systems 2020-09-30 Weijie Gan , Yu Sun , Cihat Eldeniz , Jiaming Liu , Hongyu An , Ulugbek S. Kamilov

In this paper, we revisit the long-standing problem of automatic reconstruction of 3D objects from single line drawings. Previous optimization-based methods can generate compact and accurate 3D models, but their success rates depend heavily…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jia Zheng , Yifan Zhu , Kehan Wang , Qiang Zou , Zihan Zhou

Historically, machine learning methods have not been designed with security in mind. In turn, this has given rise to adversarial examples, carefully perturbed input samples aimed to mislead detection at test time, which have been applied to…

Machine Learning · Computer Science 2022-01-11 Jamie Hayes

The performance of a model trained with noisy labels is often improved by simply \textit{retraining} the model with its \textit{own predicted hard labels} (i.e., 1/0 labels). Yet, a detailed theoretical characterization of this phenomenon…

Data augmentation is a key practice in machine learning for improving generalization performance. However, finding the best data augmentation hyperparameters requires domain knowledge or a computationally demanding search. We address this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Saypraseuth Mounsaveng , Issam Laradji , Ismail Ben Ayed , David Vazquez , Marco Pedersoli

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

Collaborative training of a machine learning model comes with a risk of sharing sensitive or private data. Federated learning offers a way of collectively training a single global model without the need to share client data, by sharing only…

Cryptography and Security · Computer Science 2026-01-09 Damian Harenčák , Lukáš Gajdošech , Martin Madaras

The widespread availability of pre-trained vision models has enabled numerous deep learning applications through their transferable representations. However, their computational and storage costs often limit practical deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Leonardo Iurada , Beatrice Occhiena , Tatiana Tommasi

Model Inversion (MI), in which an adversary abuses access to a trained Machine Learning (ML) model attempting to infer sensitive information about its original training data, has attracted increasing research attention. During MI, the…

Machine Learning · Computer Science 2021-11-09 Qian Wang , Daniel Kurz

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not…

Image and Video Processing · Electrical Eng. & Systems 2022-09-21 Riccardo Barbano , Zeljko Kereta , Andreas Hauptmann , Simon R. Arridge , Bangti Jin

Self-training algorithms, which train a model to fit pseudolabels predicted by another previously-learned model, have been very successful for learning with unlabeled data using neural networks. However, the current theoretical…

Machine Learning · Computer Science 2022-04-22 Colin Wei , Kendrick Shen , Yining Chen , Tengyu Ma

Though deep neural networks (DNNs) have shown superiority over other techniques in major fields like computer vision, natural language processing, robotics, recently, it has been proven that they are vulnerable to adversarial attacks. The…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Nupur Thakur , Yuzhen Ding , Baoxin Li

Training machine learning models from data with weak supervision and dataset shifts is still challenging. Designing algorithms when these two situations arise has not been explored much, and existing algorithms cannot always handle the most…

Machine Learning · Computer Science 2023-08-30 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

Recent works have cast some light on the mystery of why deep nets fit any data and generalize despite being very overparametrized. This paper analyzes training and generalization for a simple 2-layer ReLU net with random initialization, and…

Machine Learning · Computer Science 2019-05-28 Sanjeev Arora , Simon S. Du , Wei Hu , Zhiyuan Li , Ruosong Wang

Consider the task of locating an unknown target point using approximate distance queries: in each round, a reconstructor selects a query point and receives a noisy version of its distance to the target. This problem arises naturally in…

Machine Learning · Computer Science 2025-11-11 Shay Moran , Elizaveta Nesterova