English
Related papers

Related papers: Verifiable evaluations of machine learning models …

200 papers

Zero-knowledge proofs (zk-Proofs) are communication protocols by which a prover can demonstrate to a verifier that it possesses a solution to a given public problem without revealing the content of the solution. Arbitrary computations can…

Cryptography and Security · Computer Science 2024-01-08 Armando Cruz

The quality and correct functioning of software components embedded in electronic systems are of utmost concern especially for safety and mission-critical systems. Model-based testing and formal verification techniques can be employed to…

Formal Languages and Automata Theory · Computer Science 2019-01-08 Shahbaz Ali , Hailong Sun , Yongwang Zhao

The application of zero-knowledge proofs (ZKPs) in autonomous systems is an emerging area of research, motivated by the growing need for regulatory compliance, transparent auditing, and trustworthy operation in decentralized environments.…

Cryptography and Security · Computer Science 2026-03-30 Munawar Hasan , Apostol Vassilev , Edward Griffor , Thoshitha Gamage

As image generation models grow increasingly powerful and accessible, concerns around authenticity, ownership, and misuse of synthetic media have become critical. The ability to generate lifelike images indistinguishable from real ones…

Cryptography and Security · Computer Science 2025-10-03 Aadarsh Anantha Ramakrishnan , Shubham Agarwal , Selvanayagam S , Kunwar Singh

Existing integrity verification approaches for deep models are designed for private verification (i.e., assuming the service provider is honest, with white-box access to model parameters). However, private verification approaches do not…

Cryptography and Security · Computer Science 2023-01-02 Shuo Wang , Sharif Abuadbba , Sidharth Agarwal , Kristen Moore , Ruoxi Sun , Minhui Xue , Surya Nepal , Seyit Camtepe , Salil Kanhere

Over recent decades, machine learning has significantly advanced network communication, enabling improved decision-making, user behavior analysis, and fault detection. Decentralized approaches, where participants exchange computation…

Machine Learning · Computer Science 2025-04-22 Zhibo Xing , Zijian Zhang , Ziang Zhang , Zhen Li , Meng Li , Jiamou Liu , Zongyang Zhang , Yi Zhao , Qi Sun , Liehuang Zhu , Giovanni Russello

As the demand for exercising the "right to be forgotten" grows, the need for verifiable machine unlearning has become increasingly evident to ensure both transparency and accountability. We present {\em zkUnlearner}, the first…

Cryptography and Security · Computer Science 2025-09-10 Nan Wang , Nan Wu , Xiangyu Hui , Jiafan Wang , Xin Yuan

Machine unlearning aims to remove the influence of specific data points from a trained model to satisfy privacy, copyright, and safety requirements. In real deployments, providers distribute a global model to many edge devices, where each…

Cryptography and Security · Computer Science 2026-04-16 Mohammad M Maheri , Sunil Cotterill , Alex Davidson , Hamed Haddadi

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

Machine Learning · Computer Science 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

As Artificial Intelligence (AI) systems, particularly those based on machine learning (ML), become integral to high-stakes applications, their probabilistic and opaque nature poses significant challenges to traditional verification and…

Software Engineering · Computer Science 2025-05-27 Filippo Scaramuzza , Giovanni Quattrocchi , Damian A. Tamburri

In this paper, we present VerifyML, the first secure inference framework to check the fairness degree of a given Machine learning (ML) model. VerifyML is generic and is immune to any obstruction by the malicious model holder during the…

Cryptography and Security · Computer Science 2022-10-18 Guowen Xu , Xingshuo Han , Gelei Deng , Tianwei Zhang , Shengmin Xu , Jianting Ning , Anjia Yang , Hongwei Li

Split learning is an approach to collaborative learning in which a deep neural network is divided into two parts: client-side and server-side at a cut layer. The client side executes its model using its raw input data and sends the…

Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly correlated with performance in real-world applications -- a…

Machine Learning · Computer Science 2024-06-18 Olivier Binette , Jerome P. Reiter

Benchmarks are important measures to evaluate safety and compliance of AI models at scale. However, they typically do not offer verifiable results and lack confidentiality for model IP and benchmark datasets. We propose Attestable Audits,…

Artificial Intelligence · Computer Science 2025-07-01 Christoph Schnabl , Daniel Hugenroth , Bill Marino , Alastair R. Beresford

Over the past few years, AI methods of generating images have been increasing in capabilities, with recent breakthroughs enabling high-resolution, photorealistic "deepfakes" (artificially generated images with the purpose of misinformation…

Cryptography and Security · Computer Science 2022-11-14 Daniel Kang , Tatsunori Hashimoto , Ion Stoica , Yi Sun

Trustworthy machine learning is of primary importance to the practical deployment of deep learning models. While state-of-the-art models achieve astonishingly good performance in terms of accuracy, recent literature reveals that their…

Machine Learning · Computer Science 2023-02-07 Ailin Deng , Shen Li , Miao Xiong , Zhirui Chen , Bryan Hooi

Zero-knowledge succinct non-interactive arguments of knowledge (zk-SNARKs) are a powerful tool for proving computation correctness, attracting significant interest from researchers, developers, and users. However, the complexity of…

Cryptography and Security · Computer Science 2025-02-06 Junkai Liang , Daqi Hu , Pengfei Wu , Yunbo Yang , Qingni Shen , Zhonghai Wu

Training contemporary AI models requires investment in procuring learning data and computing resources, making the models intellectual property of the owners. Popular model watermarking solutions rely on key input triggers for detection;…

Cryptography and Security · Computer Science 2023-09-14 Nojan Sheybani , Zahra Ghodsi , Ritvik Kapila , Farinaz Koushanfar

As AI models become ubiquitous in our daily lives, there has been an increasing demand for transparency in ML services. However, the model owner does not want to reveal the weights, as they are considered trade secrets. To solve this…

Cryptography and Security · Computer Science 2025-07-14 Bing-Jyue Chen , Lilia Tang , Daniel Kang

Many service systems rely on verifiable identity-related information of their users. Manipulation and unwanted exposure of this privacy-relevant information, however, must at the same time be prevented and avoided. Peer-to-peer…

Cryptography and Security · Computer Science 2022-09-21 Jonathan Heiss , Robert Muth , Frank Pallas , Stefan Tai