English
Related papers

Related papers: Accelerating Private Large Transformers Inference …

200 papers

Large language models (LLMs) offer personalized responses based on user interactions, but this use case raises serious privacy concerns. Homomorphic encryption (HE) is a cryptographic protocol supporting arithmetic computations in encrypted…

Cryptography and Security · Computer Science 2025-02-24 Donghwan Rho , Taeseong Kim , Minje Park , Jung Woo Kim , Hyunsik Chae , Ernest K. Ryu , Jung Hee Cheon

Fully Homomorphic Encryption (FHE) allows for computation directly on encrypted data and enables privacy-preserving neural inference in the cloud. Prior work has focused on models with dense inputs (e.g., CNNs), with less attention given to…

Cryptography and Security · Computer Science 2026-02-23 Karthik Garimella , Austin Ebel , Gabrielle De Micheli , Brandon Reagen

This paper presents an efficient framework for private Transformer inference that combines Homomorphic Encryption (HE) and Secure Multi-party Computation (MPC) to protect data privacy. Existing methods often leverage HE for linear layers…

Cryptography and Security · Computer Science 2025-09-03 Tianshi Xu , Wen-jie Lu , Jiangrui Yu , Chen Yi , Chenqi Lin , Runsheng Wang , Meng Li

Federated learning is a method used in machine learning to allow multiple devices to work together on a model without sharing their private data. Each participant keeps their private data on their system and trains a local model and only…

Cryptography and Security · Computer Science 2025-04-07 Feiran Yang

With the fast evolution of large language models (LLMs), privacy concerns with user queries arise as they may contain sensitive information. Private inference based on homomorphic encryption (HE) has been proposed to protect user query…

Cryptography and Security · Computer Science 2024-05-28 Chenqi Lin , Tianshi Xu , Zebin Yang , Runsheng Wang , Ru Huang , Meng Li

Machine Learning (ML) has become one of the most impactful fields of data science in recent years. However, a significant concern with ML is its privacy risks due to rising attacks against ML models. Privacy-Preserving Machine Learning…

Cryptography and Security · Computer Science 2024-09-11 Khoa Nguyen , Mindaugas Budzys , Eugene Frimpong , Tanveer Khan , Antonis Michalas

Modern cryptographic methods for implementing privacy-preserving LLMs such as \gls{HE} require the LLMs to have a polynomial form. Forming such a representation is challenging because transformers include non-polynomial components, such as…

Homomorphic Encryption (HE) enables secure computation on encrypted data, addressing privacy concerns in cloud computing. However, the high computational cost of HE operations, particularly matrix multiplication (MM), remains a major…

Hardware Architecture · Computer Science 2025-12-18 Zhihan Xu , Rajgopal Kannan , Viktor K. Prasanna

Designing privacy-preserving deep learning models is a major challenge within the deep learning community. Homomorphic Encryption (HE) has emerged as one of the most promising approaches in this realm, enabling the decoupling of knowledge…

Machine Learning · Computer Science 2023-11-16 Itamar Zimerman , Moran Baruch , Nir Drucker , Gilad Ezov , Omri Soceanu , Lior Wolf

Large language models (LLMs) power modern AI applications, but processing sensitive data on untrusted servers raises privacy concerns. Homomorphic encryption (HE) enables computation on encrypted data for secure inference. However, neural…

Machine Learning · Computer Science 2025-11-19 Matan Avitan , Moran Baruch , Nir Drucker , Itamar Zimerman , Yoav Goldberg

The community explored to build private inference frameworks for transformer-based large language models (LLMs) in a server-client setting, where the server holds the model parameters and the client inputs its private data (or prompt) for…

Machine Learning · Computer Science 2023-12-18 Xuanqi Liu , Zhuotao Liu

Privacy-preserving machine learning (PPML) has become increasingly important in applications where sensitive data must remain confidential. Homomorphic Encryption (HE) enables computation directly on encrypted data, allowing neural network…

Cryptography and Security · Computer Science 2026-04-21 Nges Brian Njungle , Eric Jahns , Michel A. Kinsy

Federated Learning trains machine learning models on distributed devices by aggregating local model updates instead of local data. However, privacy concerns arise as the aggregated local models on the server may reveal sensitive personal…

Machine Learning · Computer Science 2024-06-18 Weizhao Jin , Yuhang Yao , Shanshan Han , Jiajun Gu , Carlee Joe-Wong , Srivatsan Ravi , Salman Avestimehr , Chaoyang He

Homomorphic Encryption (HE) is an emerging encryption scheme that allows computations to be performed directly on encrypted messages. This property provides promising applications such as privacy-preserving deep learning and cloud…

Cryptography and Security · Computer Science 2021-10-01 Yujia Zhai , Mohannad Ibrahim , Yiqin Qiu , Fabian Boemer , Zizhong Chen , Alexey Titov , Alexander Lyashevsky

As machine learning (ML) models become increasingly deployed through cloud infrastructures, the confidentiality of user data during inference poses a significant security challenge. Homomorphic Encryption (HE) has emerged as a compelling…

Cryptography and Security · Computer Science 2025-10-29 Tejaswini Bollikonda

Privacy-preserving machine learning (PPML) is an emerging topic to handle secure machine learning inference over sensitive data in untrusted environments. Fully homomorphic encryption (FHE) enables computation directly on encrypted data on…

Cryptography and Security · Computer Science 2025-10-24 Yu Hin Chan , Hao Yang , Shiyu Shen , Xingyu Fan , Shengzhe Lyu , Patrick S. Y. Hung , Ray C. C. Cheung

Transformer models have revolutionized AI, enabling applications like content generation and sentiment analysis. However, their use in Machine Learning as a Service (MLaaS) raises significant privacy concerns, as centralized servers process…

Cryptography and Security · Computer Science 2024-12-12 Yang Li , Xinyu Zhou , Yitong Wang , Liangxin Qian , Jun Zhao

Despite the cloud enormous technical and financial advantages, security and privacy have always been the primary concern for adopting cloud computing facility, especially for government agencies and commercial sectors with high-security…

Cryptography and Security · Computer Science 2025-08-29 Yang Gao , Gang Quan , Soamar Homsi , Wujie Wen , Liqiang Wang

It has been a long standing problem to securely outsource computation tasks to an untrusted party with integrity and confidentiality guarantees. While fully homomorphic encryption (FHE) is a promising technique that allows computations…

Cryptography and Security · Computer Science 2019-05-21 Wenhao Wang , Yichen Jiang , Qintao Shen , Weihao Huang , Hao Chen , Shuang Wang , XiaoFeng Wang , Haixu Tang , Kai Chen , Kristin Lauter , Dongdai Lin

We present the first theoretical convergence analysis of machine learning training under fully homomorphic encryption (FHE), combined with a differentially private (DP) training algorithm tailored to encrypted computation. Our approach…

Machine Learning · Computer Science 2026-05-28 Yvonne Zhou , Mingyu Liang , Ivan Brugere , Danial Dervovic , Yue Guo , Antigoni Polychroniadou , Min Wu , Dana Dachman-Soled
‹ Prev 1 2 3 10 Next ›