English
Related papers

Related papers: Killing One Bird with Two Stones: Model Extraction…

200 papers

As large language models (LLMs) become ubiquitous in our daily tasks and digital interactions, associated privacy risks are increasingly in focus. While LLM privacy research has primarily focused on the leakage of model training data, it…

Artificial Intelligence · Computer Science 2024-11-05 Batuhan Tömekçe , Mark Vero , Robin Staab , Martin Vechev

Transformer-based text classifiers such as BERT, RoBERTa, T5, and GPT have shown strong performance in natural language processing tasks but remain vulnerable to adversarial examples. These vulnerabilities raise significant security…

Computation and Language · Computer Science 2025-10-27 Bushra Sabir , Yansong Gao , Alsharif Abuadbba , M. Ali Babar

Machine Learning-as-a-Service, a pay-as-you-go business pattern, is widely accepted by third-party users and developers. However, the open inference APIs may be utilized by malicious customers to conduct model extraction attacks, i.e.,…

Cryptography and Security · Computer Science 2023-06-14 Shiqian Zhao , Kangjie Chen , Meng Hao , Jian Zhang , Guowen Xu , Hongwei Li , Tianwei Zhang

Model Extraction Attacks (MEAs) threaten modern machine learning systems by enabling adversaries to steal models, exposing intellectual property and training data. With the increasing deployment of machine learning models in distributed…

Cryptography and Security · Computer Science 2025-02-25 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

Language models are prone to memorizing their training data, making them vulnerable to extraction attacks. While existing research often examines isolated setups, such as a single model or a fixed prompt, real-world adversaries have a…

Cryptography and Security · Computer Science 2025-08-11 Yash More , Prakhar Ganesh , Golnoosh Farnadi

Advanced Persistent Threats (APTs) have caused significant losses across a wide range of sectors, including the theft of sensitive data and harm to system integrity. As attack techniques grow increasingly sophisticated and stealthy, the…

Cryptography and Security · Computer Science 2025-03-27 Fei Zuo , Junghwan Rhee , Yung Ryn Choe

Large Language Models are typically trained on datasets collected from the web, which may inadvertently contain harmful or sensitive personal information. To address growing privacy concerns, unlearning methods have been proposed to remove…

Machine Learning · Computer Science 2025-10-23 Xiaoyu Wu , Yifei Pang , Terrance Liu , Zhiwei Steven Wu

Information leakage is becoming a critical problem as various information becomes publicly available by mistake, and machine learning models train on that data to provide services. As a result, one's private information could easily be…

Machine Learning · Computer Science 2022-12-02 Geon Heo , Steven Euijong Whang

The article introduces a method for extracting words of different degrees of importance based on the BERT pre-training model and proves the effectiveness of this method. The article also discusses the impact of maintaining the same…

Computation and Language · Computer Science 2024-09-06 Qingwen Fu

The advance of explainable artificial intelligence, which provides reasons for its predictions, is expected to accelerate the use of deep neural networks in the real world like Machine Learning as a Service (MLaaS) that returns predictions…

Cryptography and Security · Computer Science 2021-07-20 Takayuki Miura , Satoshi Hasegawa , Toshiki Shibahara

Machine learning models are vulnerable to both security attacks (e.g., adversarial examples) and privacy attacks (e.g., private attribute inference). We take the first step to mitigate both the security and privacy attacks, and maintain…

Machine Learning · Computer Science 2024-12-17 Binghui Zhang , Sayedeh Leila Noorbakhsh , Yun Dong , Yuan Hong , Binghui Wang

Our study addresses a significant gap in online hate speech detection research by focusing on homophobia, an area often neglected in sentiment analysis research. Utilising advanced sentiment analysis models, particularly BERT, and…

Computation and Language · Computer Science 2024-05-16 Josh McGiff , Nikola S. Nikolov

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Users in various web and mobile applications are vulnerable to attribute inference attacks, in which an attacker leverages a machine learning classifier to infer a target user's private attributes (e.g., location, sexual orientation,…

Cryptography and Security · Computer Science 2020-04-15 Jinyuan Jia , Neil Zhenqiang Gong

Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applications owing to the large number of parameters and slow…

Computation and Language · Computer Science 2021-07-02 Keli Xie , Siyuan Lu , Meiqi Wang , Zhongfeng Wang

Large Language Models (LLMs) have become a cornerstone in the field of Natural Language Processing (NLP), offering transformative capabilities in understanding and generating human-like text. However, with their rising prominence, the…

Cryptography and Security · Computer Science 2024-03-26 Arijit Ghosh Chowdhury , Md Mofijul Islam , Vaibhav Kumar , Faysal Hossain Shezan , Vaibhav Kumar , Vinija Jain , Aman Chadha

The prosperity of machine learning has also brought people's concerns about data privacy. Among them, inference attacks can implement privacy breaches in various MLaaS scenarios and model training/prediction phases. Specifically, inference…

Machine Learning · Computer Science 2024-06-28 Feng Wu , Lei Cui , Shaowen Yao , Shui Yu

Increasing use of machine learning (ML) technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing…

Cryptography and Security · Computer Science 2022-01-25 Shagufta Mehnaz , Sayanton V. Dibbo , Ehsanul Kabir , Ninghui Li , Elisa Bertino

Recently, it has been shown that Machine Learning models can leak sensitive information about their training data. This information leakage is exposed through membership and attribute inference attacks. Although many attack strategies have…

Machine Learning · Computer Science 2023-03-08 Ganesh Del Grosso , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

Cryptography and Security · Computer Science 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua