English
Related papers

Related papers: SecurityNet: Assessing Machine Learning Vulnerabil…

200 papers

Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research environments (TREs) provide safe and secure environments in which researchers can…

Cryptography and Security · Computer Science 2022-08-23 Esma Mansouri-Benssassi , Simon Rogers , Jim Smith , Felix Ritchie , Emily Jefferson

Machine learning (ML) models are applied in an increasing variety of domains. The availability of large amounts of data and computational resources encourages the development of ever more complex and valuable models. These models are…

Cryptography and Security · Computer Science 2021-12-09 Franziska Boenisch

While the literature on security attacks and defense of Machine Learning (ML) systems mostly focuses on unrealistic adversarial examples, recent research has raised concern about the under-explored field of realistic adversarial attacks and…

Machine Learning · Computer Science 2023-05-23 Salijona Dyrmishi , Salah Ghamizi , Thibault Simonetto , Yves Le Traon , Maxime Cordy

Though many deep learning-based models have made great progress in vulnerability detection, we have no good understanding of these models, which limits the further advancement of model capability, understanding of the mechanism of model…

Software Engineering · Computer Science 2024-08-15 Chao Ni , Liyu Shen , Xiaodan Xu , Xin Yin , Shaohua Wang

Machine learning (ML) and artificial intelligence (AI) techniques have now become commonplace in software products and services. When threat modelling a system, it is therefore important that we consider threats unique to ML and AI…

Cryptography and Security · Computer Science 2024-01-17 Vimal Kumar , Juliette Mayo , Khadija Bahiss

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

Machine Learning · Computer Science 2021-04-02 Micah Goldblum , Dimitris Tsipras , Chulin Xie , Xinyun Chen , Avi Schwarzschild , Dawn Song , Aleksander Madry , Bo Li , Tom Goldstein

Deep Neural Networks (DNNs) have revolutionized various domains with their exceptional performance across numerous applications. However, Model Inversion (MI) attacks, which disclose private information about the training dataset by abusing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Hao Fang , Yixiang Qiu , Hongyao Yu , Wenbo Yu , Jiawei Kong , Baoli Chong , Bin Chen , Xuan Wang , Shu-Tao Xia , Ke Xu

In this article, we propose the Artificial Intelligence Security Taxonomy to systematize the knowledge of threats, vulnerabilities, and security controls of machine-learning-based (ML-based) systems. We first classify the damage caused by…

Cryptography and Security · Computer Science 2023-01-20 Yusuke Kawamoto , Kazumasa Miyake , Koichi Konishi , Yutaka Oiwa

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Although ImageNet was initially proposed as a dataset for performance benchmarking in the domain of computer vision, it also enabled a variety of other research efforts. Adversarial machine learning is one such research effort, employing…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Utku Ozbulak , Maura Pintor , Arnout Van Messem , Wesley De Neve

Many domains now leverage the benefits of Machine Learning (ML), which promises solutions that can autonomously learn to solve complex tasks by training over some data. Unfortunately, in cyberthreat detection, high-quality data is hard to…

Cryptography and Security · Computer Science 2023-12-12 Tobias Braun , Irdin Pekaric , Giovanni Apruzzese

Machine learning models are increasingly used for software security tasks. These models are commonly trained and evaluated on large Internet-derived datasets, which often contain duplicated or highly similar samples. When such samples are…

Cryptography and Security · Computer Science 2026-02-02 Farnaz Soltaniani , Mohammad Ghafari

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

Computation and Language · Computer Science 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

Neural networks are powerful models that solve a variety of complex real-world problems. However, the stochastic nature of training and large number of parameters in a typical neural model makes them difficult to evaluate via inspection.…

Machine Learning · Computer Science 2021-04-22 John Clemens

Model Inversion attacks aim to reconstruct information from private training data by exploiting access to a target model. Nearly all recent MI studies evaluate attack success using a standard framework that computes attack accuracy through…

Machine Learning · Computer Science 2026-05-15 Sy-Tuyen Ho , Koh Jun Hao , Ngoc-Bao Nguyen , Alexander Binder , Ngai-Man Cheung

Machine learning is a field of artificial intelligence (AI) that is becoming essential for several critical systems, making it a good target for threat actors. Threat actors exploit different Tactics, Techniques, and Procedures (TTPs)…

Cryptography and Security · Computer Science 2022-07-04 Lionel Nganyewou Tidjon , Foutse Khomh

As machine learning expanding application, there are more and more unignorable privacy and safety issues. Especially inference attacks against Machine Learning models allow adversaries to infer sensitive information about the target model,…

Cryptography and Security · Computer Science 2022-12-22 Yang Yang

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Modern machine learning (ML) models are expensive IP and business competitiveness often depends on keeping this IP confidential. This in turn restricts how these models are deployed; for example, it is unclear how to deploy a model…

Cryptography and Security · Computer Science 2025-03-11 Eleanor Clifford , Adhithya Saravanan , Harry Langford , Cheng Zhang , Yiren Zhao , Robert Mullins , Ilia Shumailov , Jamie Hayes

Despite the large body of academic work on machine learning security, little is known about the occurrence of attacks on machine learning systems in the wild. In this paper, we report on a quantitative study with 139 industrial…

Machine Learning · Computer Science 2023-03-13 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Battista Biggio , Katharina Krombholz