English
Related papers

Related papers: Model Extraction Warning in MLaaS Paradigm

200 papers

Fine-tuning on open-source Large Language Models (LLMs) with proprietary data is now a standard practice for downstream developers to obtain task-specific LLMs. Surprisingly, we reveal a new and concerning risk along with the practice: the…

Computation and Language · Computer Science 2026-04-06 Zhexin Zhang , Yuhao Sun , Junxiao Yang , Shiyao Cui , Yuanchao Zhang , Hongning Wang , Minlie Huang

This paper investigates the susceptibility to model integrity attacks that overload virtual machines assigned by the k-means algorithm used for resource provisioning in fog networks. The considered k-means algorithm runs two phases…

Cryptography and Security · Computer Science 2026-03-27 Younes Salmi , Hanna Bogucka

We investigate whether model extraction can be used to "steal" the weights of sequential recommender systems, and the potential threats posed to victims of such attacks. This type of risk has attracted attention in image and text…

Cryptography and Security · Computer Science 2021-09-06 Zhenrui Yue , Zhankui He , Huimin Zeng , Julian McAuley

With the proliferation of edge devices, there is a significant increase in attack surface on these devices. The decentralized deployment of threat intelligence on edge devices, coupled with adaptive machine learning techniques such as the…

Cryptography and Security · Computer Science 2024-10-10 Syed Mhamudul Hasan , Alaa M. Alotaibi , Sajedul Talukder , Abdur R. Shahid

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Metaverse is trending to create a digital circumstance that can transfer the real world to an online platform supported by large quantities of real-time interactions. Pre-trained Artificial Intelligence (AI) models are demonstrating their…

Cryptography and Security · Computer Science 2024-01-05 Pengfei Li , Zhibo Zhang , Ameena S. Al-Sumaiti , Naoufel Werghi , Chan Yeob Yeun

Model stealing (MS) involves querying and observing the output of a machine learning model to steal its capabilities. The quality of queried data is crucial, yet obtaining a large amount of real data for MS is often challenging. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yunlong Zhao , Xiaoheng Deng , Yijing Liu , Xinjun Pei , Jiazhi Xia , Wei Chen

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

In privacy-preserving machine learning, it is common that the owner of the learned model does not have any physical access to the data. Instead, only a secured remote access to a data lake is granted to the model owner without any ability…

Cryptography and Security · Computer Science 2022-06-08 Huiyu Li , Nicholas Ayache , Hervé Delingette

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

Cyber attacks constitute a significant threat to organizations with implications ranging from economic, reputational, and legal consequences. As cybercriminals' techniques get sophisticated, information security professionals face a more…

Cryptography and Security · Computer Science 2021-04-01 Emrah Tufan , Cihangir Tezcan , Cengiz Acartürk

In the current world, the Internet is being used almost everywhere. With the rise of IoT technology, which is one of the most used technologies, billions of IoT devices are interconnected over the Internet. However, DoS/DDoS attacks are the…

Cryptography and Security · Computer Science 2021-10-29 Alireza Seifousadati , Saeid Ghasemshirazi , Mohammad Fathian

It is well known that the usefulness of a machine learning model is due to its ability to generalize to unseen data. This study uses three popular cyberbullying datasets to explore the effects of data, how it's collected, and how it's…

Machine Learning · Computer Science 2024-12-03 Andrew Root , Liam Jakubowski , Mounika Vanamala

Machine Learning as a Service (MLaaS) is a popular cloud-based solution for customers who aim to use an ML model but lack training data, computation resources, or expertise in ML. In this case, the training datasets are typically a private…

Machine Learning · Computer Science 2023-05-17 Mingxue Xu , Tongtong Xu , Po-Yu Chen

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Predictive process monitoring is a subfield of process mining that aims to estimate case or event features for running process instances. Such predictions are of significant interest to the process stakeholders. However, state-of-the-art…

Effective detection of energy theft can prevent revenue losses of utility companies and is also important for smart grid security. In recent years, enabled by the massive fine-grained smart meter data, deep learning (DL) approaches are…

Cryptography and Security · Computer Science 2020-10-20 Jiangnan Li , Yingyuan Yang , Jinyuan Stella Sun

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

Machine Learning · Computer Science 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Prompt injection attacks manipulate large language models (LLMs) by misleading them to deviate from the original input instructions and execute maliciously injected instructions, because of their instruction-following capabilities and…

Cryptography and Security · Computer Science 2025-10-07 Yulin Chen , Haoran Li , Yuan Sui , Yufei He , Yue Liu , Yangqiu Song , Bryan Hooi

With the implementation of personal data privacy regulations, the field of machine learning (ML) faces the challenge of the "right to be forgotten". Machine unlearning has emerged to address this issue, aiming to delete data and reduce its…

Machine Learning · Computer Science 2024-04-02 Yi Xu