English
Related papers

Related papers: Perturbing Inputs to Prevent Model Stealing

200 papers

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

Computation and Language · Computer Science 2026-04-21 San Kim , Gary Geunbae Lee

Many state-of-the-art ML models have outperformed humans in various tasks such as image classification. With such outstanding performance, ML models are widely used today. However, the existence of adversarial attacks and data poisoning…

Machine Learning · Computer Science 2021-12-07 Jing Lin , Long Dang , Mohamed Rahouti , Kaiqi Xiong

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

Powered by machine learning services in the cloud, numerous learning-driven mobile applications are gaining popularity in the market. As deep learning tasks are mostly computation-intensive, it has become a trend to process raw data on…

Machine Learning · Computer Science 2021-06-16 Shuang Zhang , Liyao Xiang , Congcong Li , Yixuan Wang , Quanshi Zhang , Wei Wang , Bo Li

Machine Learning (ML)-powered apps are used in pervasive devices such as phones, tablets, smartwatches and IoT devices. Recent advances in collaborative, distributed ML such as Federated Learning (FL) attempt to solve privacy concerns of…

Machine Learning · Computer Science 2023-03-03 Souvik Paul , Nicolas Kourtellis

Purveyors of malicious network attacks continue to increase the complexity and the sophistication of their techniques, and their ability to evade detection continues to improve as well. Hence, intrusion detection systems must also evolve to…

Cryptography and Security · Computer Science 2020-02-20 Ahmed Shafee , Mohamed Baza , Douglas A. Talbert , Mostafa M. Fouda , Mahmoud Nabil , Mohamed Mahmoud

This paper proposes a new defense called $n$-ML against adversarial examples, i.e., inputs crafted by perturbing benign inputs by small amounts to induce misclassifications by classifiers. Inspired by $n$-version programming, $n$-ML trains…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Mahmood Sharif , Lujo Bauer , Michael K. Reiter

Network Intrusion Detection Systems (NIDS) are now increasingly leveraging Machine Learning (ML) techniques to detect malicious network activities. Numerous papers have scrutinized the security of ML-based NIDS (ML-NIDS) by testing them…

Cryptography and Security · Computer Science 2026-05-26 Miel Verkerken , Laurens D'hooge , Bruno Volckaert , Filip De Turck , Giovanni Apruzzese

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

Cryptography and Security · Computer Science 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

With the widespread use of machine learning (ML) techniques, ML as a service has become increasingly popular. In this setting, an ML model resides on a server and users can query it with their data via an API. However, if the user's input…

Cryptography and Security · Computer Science 2019-02-07 Lucjan Hanzlik , Yang Zhang , Kathrin Grosse , Ahmed Salem , Max Augustin , Michael Backes , Mario Fritz

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we know how to optimally perturb training examples to account for test examples, we may achieve better generalization performance.…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Taewook Nam , Eunho Yang , Sung Ju Hwang

Threat modeling has been successfully applied to model technical threats within information systems. However, a lack of methods focusing on non-technical assets and their representation can be observed in theory and practice. Following the…

Cryptography and Security · Computer Science 2024-09-04 Jan von der Assen , Jasmin Hochuli , Thomas Grübl , Burkhard Stiller

Large Language Models (LLMs) are increasingly deployed in sensitive domains including healthcare, legal services, and confidential communications, where privacy is paramount. This paper introduces Whisper Leak, a side-channel attack that…

Cryptography and Security · Computer Science 2025-11-06 Geoff McDonald , Jonathan Bar Or

Large Language Models (LLMs) have emerged as powerful tools, but their inherent safety risks - ranging from harmful content generation to broader societal harms - pose significant challenges. These risks can be amplified by the recent…

With the growing popularity of artificial intelligence and machine learning, a wide spectrum of attacks against deep learning models have been proposed in the literature. Both the evasion attacks and the poisoning attacks attempt to utilize…

Cryptography and Security · Computer Science 2022-08-16 Zeyan Liu , Fengjun Li , Jingqiang Lin , Zhu Li , Bo Luo

In a realistic dialogue system, the input information from users is often subject to various types of input perturbations, which affects the slot-filling task. Although rule-based data augmentation methods have achieved satisfactory…

Computation and Language · Computer Science 2024-03-07 Jinxu Zhao , Guanting Dong , Yueyan Qiu , Tingfeng Hui , Xiaoshuai Song , Daichi Guo , Weiran Xu

While data are the primary fuel for machine learning models, they often suffer from missing values, especially when collected in real-world scenarios. However, many off-the-shelf machine learning models, including artificial neural network…

Advances in deep learning have enabled a wide range of promising applications. However, these systems are vulnerable to Adversarial Machine Learning (AML) attacks; adversarially crafted perturbations to their inputs could cause them to…

Cryptography and Security · Computer Science 2022-01-06 Amira Guesmi , Khaled N. Khasawneh , Nael Abu-Ghazaleh , Ihsen Alouani

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Despite machine learning models being widely used today, the relationship between a model and its training dataset is not well understood. We explore correlation inference attacks, whether and when a model leaks information about the…

Machine Learning · Computer Science 2024-07-19 Ana-Maria Creţu , Florent Guépin , Yves-Alexandre de Montjoye