English
Related papers

Related papers: Private Transformer Inference in MLaaS: A Survey

200 papers

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

Machine Learning as a Service (MLaaS), such as Microsoft Azure, Amazon AWS, offers an effective DNN model to complete the machine learning task for small businesses and individuals who are restricted to the lacking data and computing power.…

Cryptography and Security · Computer Science 2018-07-24 Qiang Zhu , Xixiang Lv

Transformers, a cornerstone of deep-learning architectures for sequential data, have achieved state-of-the-art results in tasks like Natural Language Processing (NLP). Models such as BERT and GPT-3 exemplify their success and have driven…

Machine Learning · Computer Science 2025-01-22 Ali Abbasi Tadi , Dima Alhadidi , Luis Rueda

The generative Artificial Intelligence (AI) tools based on Large Language Models (LLMs) use billions of parameters to extensively analyse large datasets and extract critical private information such as, context, specific details,…

Cryptography and Security · Computer Science 2023-10-20 Imdad Ullah , Najm Hassan , Sukhpal Singh Gill , Basem Suleiman , Tariq Ahamed Ahanger , Zawar Shah , Junaid Qadir , Salil S. Kanhere

MLaaS (Machine Learning as a Service) has become popular in the cloud computing domain, allowing users to leverage cloud resources for running private inference of ML models on their data. However, ensuring user input privacy and secure…

Cryptography and Security · Computer Science 2024-04-12 Kishore Rajasekar , Randolph Loh , Kar Wai Fok , Vrizlynn L. L. Thing

The high cost of ownership of AI compute infrastructure and challenges of robust serving of large language models (LLMs) has led to a surge in managed Model-as-a-service deployments. Even when enterprises choose on-premises deployments, the…

Machine Learning · Computer Science 2025-06-12 Jay Roberts , Kyle Mylonakis , Sidhartha Roy , Kaan Kale

Large language models (LLMs) offer personalized responses based on user interactions, but this use case raises serious privacy concerns. Homomorphic encryption (HE) is a cryptographic protocol supporting arithmetic computations in encrypted…

Cryptography and Security · Computer Science 2025-02-24 Donghwan Rho , Taeseong Kim , Minje Park , Jung Woo Kim , Hyunsik Chae , Ernest K. Ryu , Jung Hee Cheon

The interactive nature of Large Language Models (LLMs), which closely track user data and context, has prompted users to share personal and private information in unprecedented ways. Even when users opt out of allowing their data to be used…

Cryptography and Security · Computer Science 2025-08-26 GodsGift Uzor , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

This paper focuses on designing a privacy-preserving Machine Learning (ML) inference protocol for a hierarchical setup, where clients own/generate data, model owners (cloud servers) have a pre-trained ML model, and edge servers perform ML…

Cryptography and Security · Computer Science 2024-09-17 Fatemeh Jafarian Dehkordi , Yasaman Keshtkarjahromi , Hulya Seferoglu

Users of modern Machine Learning (ML) cloud services face a privacy conundrum -- on one hand, they may have concerns about sending private data to the service for inference, but on the other hand, for specialized models, there may be no…

Machine Learning · Computer Science 2025-10-14 Kexin Li , Aastha Mehta , David Lie

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

Artificial intelligence (AI) models introduce privacy vulnerabilities to systems. These vulnerabilities may impact model owners or system users; they exist during model development, deployment, and inference phases, and threats can be…

Cryptography and Security · Computer Science 2024-04-05 Liv d'Aliberti , Evan Gronberg , Joseph Kovba

With the advances in 5G and IoT devices, the industries are vastly adopting artificial intelligence (AI) techniques for improving classification and prediction-based services. However, the use of AI also raises concerns regarding privacy…

Cryptography and Security · Computer Science 2022-01-19 Sunder Ali Khowaja , Kapal Dev , Nawab Muhammad Faseeh Qureshi , Parus Khuwaja , Luca Foschini

With the growing use of Transformer models hosted on cloud platforms to offer inference services, privacy concerns are escalating, especially concerning sensitive data like investment plans and bank account details. Secure Multi-Party…

Machine Learning · Computer Science 2025-06-10 Jinglong Luo , Yehong Zhang , Zhuo Zhang , Jiaqi Zhang , Xin Mu , Hui Wang , Yue Yu , Zenglin Xu

Transfer learning has become an increasingly popular technique in machine learning as a way to leverage a pretrained model trained for one task to assist with building a finetuned model for a related task. This paradigm has been especially…

Machine Learning · Computer Science 2024-10-18 John Abascal , Stanley Wu , Alina Oprea , Jonathan Ullman

Homomorphic encryption (HE) and secret sharing (SS) enable computations on encrypted data, providing significant privacy benefits for large transformer-based models (TBM) in sensitive sectors like medicine and finance. However, private TBM…

Cryptography and Security · Computer Science 2025-07-04 Yuntian Chen , Zhanyong Tang , Tianpei Lu , Bingsheng Zhang , Zhiying Shi , Zheng Wang

Machine Learning as a Service (MLaaS) has become a growing trend in recent years and several such services are currently offered. MLaaS is essentially a set of services that provides machine learning tools and capabilities as part of cloud…

Cryptography and Security · Computer Science 2019-11-27 Daniel Takabi , Robert Podschwadt , Jeff Druce , Curt Wu , Kevin Procopio

The use of Machine Learning (ML) for data-driven decision-making often relies on access to sensitive datasets, which introduces privacy challenges. Traditional encryption methods protect data at rest or in transit but fail to secure it…

Cryptography and Security · Computer Science 2026-04-28 Alexandre Marques , Beatriz Sá , Rui Botelho , Pedro Pinto

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for discovery of hidden semantic architecture of text datasets, and plays a fundamental role in many machine learning applications. However, like many other machine…

Machine Learning · Computer Science 2019-07-02 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Xinyu Yang

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao