English
Related papers

Related papers: Power-Softmax: Towards Secure LLM Inference over E…

200 papers

Preserving data confidentiality during the fine-tuning of open-source Large Language Models (LLMs) is crucial for sensitive applications. This work introduces an interactive protocol adapting the Low-Rank Adaptation (LoRA) technique for…

Cryptography and Security · Computer Science 2025-05-13 Jordan Frery , Roman Bredehoft , Jakub Klemsa , Arthur Meyre , Andrei Stoian

Machine learning (ML) algorithms are increasingly important for the success of products and services, especially considering the growing amount and availability of data. This also holds for areas handling sensitive data, e.g. applications…

Cryptography and Security · Computer Science 2023-09-19 Martin Nocker , David Drexel , Michael Rader , Alessio Montuoro , Pascal Schöttle

Leveled Homomorphic Encryption (LHE) offers a potential solution that could allow sectors with sensitive data to utilize the cloud and securely deploy their models for remote inference with Deep Neural Networks (DNN). However, this…

Machine Learning · Computer Science 2019-02-07 Moustafa AboulAtta , Matthias Ossadnik , Seyed-Ahmad Ahmadi

Privacy-preserving deep neural network (DNN) inference is a necessity in different regulated industries such as healthcare, finance and retail. Recently, homomorphic encryption (HE) has been used as a method to enable analytics while…

Cryptography and Security · Computer Science 2023-06-13 Moran Baruch , Nir Drucker , Lev Greenberg , Guy Moshkowich

Secure inference enables privacy-preserving machine learning by leveraging cryptographic protocols that support computations on sensitive user data without exposing it. However, integrating cryptographic protocols with large language models…

Cryptography and Security · Computer Science 2025-09-12 Zhiyu He , Maojiang Wang , Xinwen Gao , Yuchuan Luo , Lin Liu , Shaojing Fu

Homomorphic encryption (HE) is a promising technique used for privacy-preserving computation. Since HE schemes only support primitive polynomial operations, homomorphic evaluation of polynomial approximations for non-polynomial functions…

Cryptography and Security · Computer Science 2024-05-27 John Chiang

Recent work using Fully Homomorphic Encryption (FHE) has made non-interactive privacy-preserving inference of deep Convolutional Neural Networks (CNN) possible. However, the performance of these methods remain limited by their heavy…

Cryptography and Security · Computer Science 2026-02-10 Eduardo Chielle , Manaar Alam , Jinting Liu , Jovan Kascelan , Michail Maniatakos

Federated Learning trains machine learning models on distributed devices by aggregating local model updates instead of local data. However, privacy concerns arise as the aggregated local models on the server may reveal sensitive personal…

Machine Learning · Computer Science 2024-06-18 Weizhao Jin , Yuhang Yao , Shanshan Han , Jiajun Gu , Carlee Joe-Wong , Srivatsan Ravi , Salman Avestimehr , Chaoyang He

The community explored to build private inference frameworks for transformer-based large language models (LLMs) in a server-client setting, where the server holds the model parameters and the client inputs its private data (or prompt) for…

Machine Learning · Computer Science 2023-12-18 Xuanqi Liu , Zhuotao Liu

Homomorphic encryption is one of the representative solutions to privacy-preserving machine learning (PPML) classification enabling the server to classify private data of clients while guaranteeing privacy. This work focuses on PPML using…

Cryptography and Security · Computer Science 2021-06-15 Junghyun Lee , Eunsang Lee , Joon-Woo Lee , Yongjune Kim , Young-Sik Kim , Jong-Seon No

The rapid development of the Transformer-based Large Language Models (LLMs) in recent years has been closely linked to their ever-growing and already enormous sizes. Many LLMs contain hundreds of billions of parameters and require dedicated…

Computation and Language · Computer Science 2025-02-26 Mahsa Salmani , Ilya Soloveychik

Privacy-preserving machine learning (PPML) has become increasingly important in applications where sensitive data must remain confidential. Homomorphic Encryption (HE) enables computation directly on encrypted data, allowing neural network…

Cryptography and Security · Computer Science 2026-04-21 Nges Brian Njungle , Eric Jahns , Michel A. Kinsy

Privacy-preserving machine learning (PPML) solutions are gaining widespread popularity. Among these, many rely on homomorphic encryption (HE) that offers confidentiality of the model and the data, but at the cost of large latency and memory…

While homomorphic encryption (HE) provides strong privacy protection, its high computational cost has restricted its application to simple tasks. Recently, hyperdimensional computing (HDC) applied to HE has shown promising performance for…

Cryptography and Security · Computer Science 2025-11-04 Jaewoo Park , Chenghao Quan , Jongeun Lee

Transformer inference in machine-learning-as-a-service (MLaaS) raises privacy concerns for sensitive user inputs. Prior secure solutions that combine fully homomorphic encryption (FHE) and secure multiparty computation (MPC) are…

Cryptography and Security · Computer Science 2026-04-14 Yufan Zhu , Chao Jin , Khin Mi Mi Aung , Xiaokui Xiao

Large scale deep learning model, such as modern language models and diffusion architectures, have revolutionized applications ranging from natural language processing to computer vision. However, their deployment in distributed or…

As machine learning (ML) permeates fields like healthcare, facial recognition, and blockchain, the need to protect sensitive data intensifies. Fully Homomorphic Encryption (FHE) allows inference on encrypted data, preserving the privacy of…

Cryptography and Security · Computer Science 2024-05-08 Jianming Tong , Jingtian Dang , Anupam Golder , Callie Hao , Arijit Raychowdhury , Tushar Krishna

As more and more pre-trained language models adopt on-cloud deployment, the privacy issues grow quickly, mainly for the exposure of plain-text user data (e.g., search history, medical record, bank account). Privacy-preserving inference of…

Cryptography and Security · Computer Science 2022-06-03 Tianyu Chen , Hangbo Bao , Shaohan Huang , Li Dong , Binxing Jiao , Daxin Jiang , Haoyi Zhou , Jianxin Li , Furu Wei

Homomorphic encryption (HE) is a prominent framework for privacy-preserving machine learning, enabling inference directly on encrypted data. However, evaluating softmax, a core component of transformer architectures, remains particularly…

Cryptography and Security · Computer Science 2026-05-11 Hanjun Park , Byeongseo Min , Jiheon Woo , Min-Wook Jeong , Jongho Shin , Yongwoo Lee , Young-Sik Kim , Yongjune Kim

The recently proposed Kolmogorov-Arnold Networks (KANs) offer enhanced interpretability and greater model expressiveness. However, KANs also present challenges related to privacy leakage during inference. Homomorphic encryption (HE)…

Machine Learning · Computer Science 2024-09-13 Zhizheng Lai , Yufei Zhou , Peijia Zheng , Lin Chen