English
Related papers

Related papers: Trustless Audits without Revealing Data or Models

200 papers

Machine learning (ML) has become prominent in applications that directly affect people's quality of life, including in healthcare, justice, and finance. ML models have been found to exhibit discrimination based on sensitive attributes such…

Machine Learning · Computer Science 2022-05-25 Sikha Pentyala , David Melanson , Martine De Cock , Golnoosh Farnadi

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Imagine training a machine learning model with Differentially Private Stochastic Gradient Descent (DP-SGD), only to discover post-training that the noise level was either too high, crippling your model's utility, or too low, compromising…

Machine Learning · Computer Science 2025-01-22 David Zagardo

Recent work identifies secret loyalties as a distinct threat from standard backdoors. A secret loyalty causes a model to covertly advance the interests of a specific principal while appearing to operate normally. We construct the first…

Cryptography and Security · Computer Science 2026-05-13 Alfie Lamerton , Fabien Roger

The exceptional performance of diffusion models establishes them as high-value intellectual property but exposes them to unauthorized replication. Existing protection methods either modify the model to embed watermarks, which impairs…

Cryptography and Security · Computer Science 2026-01-30 Lingxiao Chen , Liqin Wang , Wei Lu , Xiangyang Luo

Privacy models were introduced in privacy-preserving data publishing and statistical disclosure control with the promise to end the need for costly empirical assessment of disclosure risk. We examine how well this promise is kept by the…

Cryptography and Security · Computer Science 2025-10-20 Josep Domingo-Ferrer , David Sánchez

Model-free power flow calculation, driven by the rise of smart meter (SM) data and the lack of network topology, often relies on artificial intelligence neural networks (ANNs). However, training ANNs require vast amounts of SM data, posing…

Systems and Control · Electrical Eng. & Systems 2025-02-28 Dong Liu , Juan S. Giraldo , Peter Palensky , Pedro P. Vergara

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

Zero-knowledge proof (ZKP) is a fundamental cryptographic primitive that allows a prover to convince a verifier of the validity of a statement without leaking any further information. As an efficient variant of ZKP, non-interactive…

Deep learning has become popular, and numerous cloud-based services are provided to help customers develop and deploy deep learning applications. Meanwhile, various attack techniques have also been discovered to stealthily compromise the…

Cryptography and Security · Computer Science 2018-08-21 Zecheng He , Tianwei Zhang , Ruby B. Lee

Data shift robustness has been primarily investigated from a fully supervised perspective, and robustness of zero-shot learning (ZSL) models have been largely neglected. In this paper, we present novel analyses on the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Auditing algorithms' privacy typically involves simulating a game-based protocol that guesses which of two adjacent datasets was the original input. Traditional approaches require thousands of such simulations, leading to significant…

Cryptography and Security · Computer Science 2025-01-30 Zihang Xiang , Tianhao Wang , Di Wang

The rise of deep learning (DL) has led to a surging demand for training data, which incentivizes the creators of DL models to trawl through the Internet for training materials. Meanwhile, users often have limited control over whether their…

Cryptography and Security · Computer Science 2025-05-23 Zitao Chen , Karthik Pattabiraman

Zero-knowledge succinct non-interactive argument of knowledge (zkSNARK) allows a party, known as the prover, to convince another party, known as the verifier, that he knows a private value $v$, without revealing it, such that $F(u,v)=y$ for…

Cryptography and Security · Computer Science 2021-03-03 Ali Rahimi , Mohammad Ali Maddah-Ali

The decentralized nature of federated learning, that often leverages the power of edge devices, makes it vulnerable to attacks against privacy and security. The privacy risk for a peer is that the model update she computes on her private…

Cryptography and Security · Computer Science 2021-08-05 Josep Domingo-Ferrer , Alberto Blanco-Justicia , Jesús Manjón , David Sánchez

LLM-powered coding and development assistants have become prevalent to programmers' workflows. However, concerns about the trustworthiness of LLMs for code persist despite their widespread use. Much of the existing research focused on…

Software Engineering · Computer Science 2024-12-17 Chong Wang , Zhenpeng Chen , Tianlin Li , Yilun Zhao , Yang Liu

Currently, when a security analyst discovers a vulnerability in critical software system, they must navigate a fraught dilemma: immediately disclosing the vulnerability to the public could harm the system's users; whereas disclosing the…

Cryptography and Security · Computer Science 2023-01-05 Santiago Cuéllar , Bill Harris , James Parker , Stuart Pernsteiner , Eran Tromer

Using blockchain technology, it is possible to create contracts that offer a reward in exchange for a trained machine learning model for a particular data set. This would allow users to train machine learning models for a reward in a…

Cryptography and Security · Computer Science 2018-03-01 A. Besir Kurtulmus , Kenny Daniel

Differential privacy (DP) auditing is essential for evaluating privacy guarantees in machine learning systems. Existing auditing methods, however, pose a significant challenge for large-scale systems since they require modifying the…

Machine Learning · Computer Science 2026-01-21 Iden Kalemaj , Luca Melis , Maxime Boucher , Ilya Mironov , Saeed Mahloujifar

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo