English
Related papers

Related papers: Spoofing Generalization: When Can't You Trust Prop…

200 papers

Audio anti-spoofing for automatic speaker verification aims to safeguard users' identities from spoofing attacks. Although state-of-the-art spoofing countermeasure(CM) models perform well on specific datasets, they lack generalization when…

Sound · Computer Science 2023-06-02 Hye-jin Shim , Jee-weon Jung , Tomi Kinnunen

Publicly releasing the specification of a model with its trained parameters means an adversary can attempt to reconstruct information about the training data via training data reconstruction attacks, a major vulnerability of modern machine…

Machine Learning · Statistics 2025-07-25 George Wynne

There is a known tension between the need to analyze personal data to drive business and privacy concerns. Many data protection regulations, including the EU General Data Protection Regulation (GDPR) and the California Consumer Protection…

Cryptography and Security · Computer Science 2022-02-02 Abigail Goldsteen , Gilad Ezov , Ron Shmelkin , Micha Moffie , Ariel Farkash

Obtaining a well-trained model involves expensive data collection and training procedures, therefore the model is a valuable intellectual property. Recent studies revealed that adversaries can `steal' deployed models even when they have no…

Cryptography and Security · Computer Science 2021-12-08 Yiming Li , Linghui Zhu , Xiaojun Jia , Yong Jiang , Shu-Tao Xia , Xiaochun Cao

Machine learning models exhibit two seemingly contradictory phenomena: training data memorization, and various forms of forgetting. In memorization, models overfit specific training examples and become susceptible to privacy attacks. In…

Machine unlearning poses the challenge of ``how to eliminate the influence of specific data from a pretrained model'' in regard to privacy concerns. While prior research on approximated unlearning has demonstrated accuracy and efficiency in…

Machine Learning · Computer Science 2025-04-21 Khoa Tran , Simon S. Woo

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

Cryptography and Security · Computer Science 2020-12-10 Liwei Song , Prateek Mittal

Federated learning enables clients to collaboratively learn a shared global model without sharing their local training data with a cloud server. However, malicious clients can corrupt the global model to predict incorrect labels for testing…

Cryptography and Security · Computer Science 2021-10-28 Xiaoyu Cao , Jinyuan Jia , Neil Zhenqiang Gong

We investigate robust linear regression where data may be contaminated by an oblivious adversary, i.e., an adversary than may know the data distribution but is otherwise oblivious to the realizations of the data samples. This model has been…

Machine Learning · Computer Science 2022-02-07 Tom Norman , Nir Weinberger , Kfir Y. Levy

A MasterFace is a face image that can successfully match against a large portion of the population. Since their generation does not require access to the information of the enrolled subjects, MasterFace attacks represent a potential…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Philipp Terhörst , Florian Bierbaum , Marco Huber , Naser Damer , Florian Kirchbuchner , Kiran Raja , Arjan Kuijper

The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised…

Cryptography and Security · Computer Science 2024-03-11 Antonio Emanuele Cinà , Kathrin Grosse , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Supervised deep learning models require significant amount of labeled data to achieve an acceptable performance on a specific task. However, when tested on unseen data, the models may not perform well. Therefore, the models need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Akshit Achara , Ram Krishna Pandey

Deep learning models for semantics are generally evaluated using naturalistic corpora. Adversarial methods, in which models are evaluated on new examples with known semantic properties, have begun to reveal that good performance at these…

Computation and Language · Computer Science 2021-07-27 Atticus Geiger , Ignacio Cases , Lauri Karttunen , Chris Potts

An important component for generalization in machine learning is to uncover underlying latent factors of variation as well as the mechanism through which each factor acts in the world. In this paper, we test whether 17 unsupervised, weakly…

Deep learning models learn to fit training data while they are highly expected to generalize well to testing data. Most works aim at finding such models by creatively designing architectures and fine-tuning parameters. To adapt to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Tianyang Wang , Jun Huan , Bo Li

Generalization in generative modeling is defined as the ability to learn an underlying distribution from a finite dataset and produce novel samples, with evaluation largely driven by held-out performance and perceived sample quality. In…

Machine Learning · Computer Science 2026-03-05 Jerome Garnier-Brun , Luca Biggio , Davide Beltrame , Marc Mézard , Luca Saglietti

Bias in data can have unintended consequences that propagate to the design, development, and deployment of machine learning models. In the financial services sector, this can result in discrimination from certain financial instruments and…

Cryptography and Security · Computer Science 2019-11-12 Reginald Bryant , Celia Cintas , Isaac Wambugu , Andrew Kinai , Komminist Weldemariam

Very large deep learning models trained using gradient descent are remarkably resistant to memorization given their huge capacity, but are at the same time capable of fitting large datasets of pure noise. Here methods are introduced by…

Machine Learning · Computer Science 2022-12-22 Benjamin L. Badger

Given access to a machine learning model, can an adversary reconstruct the model's training data? This work studies this question from the lens of a powerful informed adversary who knows all the training data points except one. By…

Cryptography and Security · Computer Science 2022-04-26 Borja Balle , Giovanni Cherubin , Jamie Hayes