English
Related papers

Related papers: Private Transformer Inference in MLaaS: A Survey

200 papers

With the increasing demands for privacy protection, many privacy-preserving machine learning systems were proposed in recent years. However, most of them cannot be put into production due to their slow training and inference speed caused by…

Cryptography and Security · Computer Science 2020-08-19 Fei Zheng

Machine learning as a service has given raise to privacy concerns surrounding clients' data and providers' models and has catalyzed research in private inference (PI): methods to process inferences without disclosing inputs. Recently,…

Machine Learning · Computer Science 2021-05-14 Zahra Ghodsi , Akshaj Veldanda , Brandon Reagen , Siddharth Garg

Machine Learning as a Service (MLaaS) operators provide model training and prediction on the cloud. MLaaS applications often rely on centralised collection and aggregation of user data, which could lead to significant privacy concerns when…

Cryptography and Security · Computer Science 2020-04-14 Ali Shahin Shamsabadi , Adria Gascon , Hamed Haddadi , Andrea Cavallaro

The foreseen growing role of outsourced machine learning services is raising concerns about the privacy of user data. Several technical solutions are being proposed to address the issue. Hardware security modules in cloud data centres…

Cryptography and Security · Computer Science 2019-10-07 Marc Joye , Fabien A. P. Petitcolas

Machine learning (ML) models, demonstrably powerful, suffer from a lack of interpretability. The absence of transparency, often referred to as the black box nature of ML models, undermines trust and urges the need for efforts to enhance…

Machine Learning · Computer Science 2024-06-25 Fatima Ezzeddine

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

The use of trusted hardware has become a promising solution to enable privacy-preserving machine learning. In particular, users can upload their private data and models to a hardware-enforced trusted execution environment (e.g. an enclave…

Hardware Architecture · Computer Science 2020-11-13 Peichen Xie , Xuanle Ren , Guangyu Sun

The successful deployment of artificial intelligence (AI) in many domains from healthcare to hiring requires their responsible use, particularly in model explanations and privacy. Explainable artificial intelligence (XAI) provides more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xuejun Zhao , Wencan Zhang , Xiaokui Xiao , Brian Y. Lim

Large language models (LLMs) have been widely applied for their remarkable capability of content generation. However, the practical use of open-source LLMs is hindered by high resource requirements, making deployment expensive and limiting…

Cryptography and Security · Computer Science 2025-05-05 Wenjie Qu , Yuguang Zhou , Yongji Wu , Tingsong Xiao , Binhang Yuan , Yiming Li , Jiaheng Zhang

Language Models as a Service (LMaaS) offers convenient access for developers and researchers to perform inference using pre-trained language models. Nonetheless, the input data and the inference results containing private information are…

Computation and Language · Computer Science 2024-02-14 Yixiang Yao , Fei Wang , Srivatsan Ravi , Muhao Chen

The growing use of Machine Learning and Artificial Intelligence (AI), particularly Large Language Models (LLMs) like OpenAI's GPT series, leads to disruptive changes across organizations. At the same time, there is a growing concern about…

Data privacy is important in the AI era, and differential privacy (DP) is one of the golden solutions. However, DP is typically applicable only if data have a bounded underlying distribution. We address this limitation by leveraging…

Cryptography and Security · Computer Science 2026-02-27 Zilong Cao , Xuan Bi , Hai Zhang

Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual…

Machine Learning · Computer Science 2025-07-08 Sathesh P. Sivashanmugam

Private inference (PI) serves an important role in guaranteeing the privacy of user data when interfacing with proprietary machine learning models such as LLMs. However, PI remains practically intractable due to the massive latency costs…

Cryptography and Security · Computer Science 2024-12-03 Patrick Yubeaton , Jianqiao Cambridge Mo , Karthik Garimella , Nandan Kumar Jha , Brandon Reagen , Chinmay Hegde , Siddharth Garg

Machine learning has revolutionized data analysis and pattern recognition, but its resource-intensive training has limited accessibility. Machine Learning as a Service (MLaaS) simplifies this by enabling users to delegate their data samples…

Cryptography and Security · Computer Science 2024-11-14 Arman Riasi , Jorge Guajardo , Thang Hoang

In the age of data-driven decision making, preserving privacy while providing personalized experiences has become paramount. Personalized Federated Learning (PFL) offers a promising framework by decentralizing the learning process, thus…

Machine Learning · Computer Science 2025-01-31 Kevin Cooper , Michael Geller

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

The prosperity of machine learning has also brought people's concerns about data privacy. Among them, inference attacks can implement privacy breaches in various MLaaS scenarios and model training/prediction phases. Specifically, inference…

Machine Learning · Computer Science 2024-06-28 Feng Wu , Lei Cui , Shaowen Yao , Shui Yu

This paper considers the single-server Private Linear Transformation (PLT) problem with individual privacy guarantees. In this problem, there is a user that wishes to obtain $L$ independent linear combinations of a $D$-subset of messages…

Information Theory · Computer Science 2021-06-11 Anoosheh Heidarzadeh , Nahid Esmati , Alex Sprintson