English
Related papers

Related papers: Primer: Fast Private Transformer Inference on Encr…

200 papers

Designing privacy-preserving deep learning models is a major challenge within the deep learning community. Homomorphic Encryption (HE) has emerged as one of the most promising approaches in this realm, enabling the decoupling of knowledge…

Machine Learning · Computer Science 2023-11-16 Itamar Zimerman , Moran Baruch , Nir Drucker , Gilad Ezov , Omri Soceanu , Lior Wolf

With the growing use of Transformer models hosted on cloud platforms to offer inference services, privacy concerns are escalating, especially concerning sensitive data like investment plans and bank account details. Secure Multi-Party…

Machine Learning · Computer Science 2025-06-10 Jinglong Luo , Yehong Zhang , Zhuo Zhang , Jiaqi Zhang , Xin Mu , Hui Wang , Yue Yu , Zenglin Xu

This paper proposes Impala, a new cryptographic protocol for private inference in the client-cloud setting. Impala builds upon recent solutions that combine the complementary strengths of homomorphic encryption (HE) and secure multi-party…

Cryptography and Security · Computer Science 2022-05-16 Woo-Seok Choi , Brandon Reagen , Gu-Yeon Wei , David Brooks

A typical setup in many machine learning scenarios involves a server that holds a model and a user that possesses data, and the challenge is to perform inference while safeguarding the privacy of both parties. Private Inference has been…

Information Theory · Computer Science 2023-11-27 Zirui Deng , Vinayak Ramkumar , Rawad Bitar , Netanel Raviv

Modern cryptographic methods for implementing privacy-preserving LLMs such as \gls{HE} require the LLMs to have a polynomial form. Forming such a representation is challenging because transformers include non-polynomial components, such as…

Secure signal processing is becoming a de facto model for preserving privacy. We propose a model based on the Fully Homomorphic Encryption (FHE) technique to mitigate security breaches. Our framework provides a method to perform a Fast…

Cryptography and Security · Computer Science 2016-11-29 Thomas Shortell , Ali Shokoufandeh

Data privacy concerns often prevent the use of cloud-based machine learning services for sensitive personal data. While homomorphic encryption (HE) offers a potential solution by enabling computations on encrypted data, the challenge is to…

Cryptography and Security · Computer Science 2021-03-08 Kanthi Sarpatwar , Karthik Nandakumar , Nalini Ratha , James Rayfield , Karthikeyan Shanmugam , Sharath Pankanti , Roman Vaculin

In contemporary cloud-based services, protecting users' sensitive data and ensuring the confidentiality of the server's model are critical. Fully homomorphic encryption (FHE) enables inference directly on encrypted inputs, but its…

In today's machine learning landscape, fine-tuning pretrained transformer models has emerged as an essential technique, particularly in scenarios where access to task-aligned training data is limited. However, challenges surface when data…

Machine Learning · Computer Science 2024-02-15 Prajwal Panzade , Daniel Takabi , Zhipeng Cai

The prevalent use of Transformer-like models, exemplified by ChatGPT in modern language processing applications, underscores the critical need for enabling private inference essential for many cloud-based services reliant on such models.…

Machine Learning · Computer Science 2024-09-10 Xiangrui Xu , Qiao Zhang , Rui Ning , Chunsheng Xin , Hongyi Wu

Large language model (LLM) based services are primarily structured as client-server interactions, with clients sending queries directly to cloud providers that host LLMs. This approach currently compromises data privacy as all queries must…

Cryptography and Security · Computer Science 2025-12-15 Karthik Garimella , Negar Neda , Austin Ebel , Nandan Kumar Jha , Brandon Reagen

Fully homomorphic encryption (FHE) has experienced significant development and continuous breakthroughs in theory, enabling its widespread application in various fields, like outsourcing computation and secure multi-party computing, in…

Cryptography and Security · Computer Science 2023-03-21 Yanwei Gong , Xiaolin Chang , Jelena Mišić , Vojislav B. Mišić , Jianhua Wang , Haoran Zhu

Since the first theoretically feasible full homomorphic encryption (FHE) scheme was proposed in 2009, great progress has been achieved. These improvements have made FHE schemes come off the paper and become quite useful in solving some…

Cryptography and Security · Computer Science 2024-03-19 Yuqi Guo , Lin Li , Zhongxiang Zheng , Hanrui Yun , Ruoyan Zhang , Xiaolin Chang , Zhixuan Gao

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

Fully Homomorphic Encryption (FHE) is a technique that allows arbitrary computations to be performed on encrypted data without the need for decryption, making it ideal for securing many emerging applications. However, FHE computation is…

The processing of sensitive user data using deep learning models is an area that has gained recent traction. Existing work has leveraged homomorphic encryption (HE) schemes to enable computation on encrypted data. An early work was…

Machine Learning · Computer Science 2022-08-29 Han Xuanyuan , Francisco Vargas , Stephen Cummins

We present the first theoretical convergence analysis of machine learning training under fully homomorphic encryption (FHE), combined with a differentially private (DP) training algorithm tailored to encrypted computation. Our approach…

Machine Learning · Computer Science 2026-05-28 Yvonne Zhou , Mingyu Liang , Ivan Brugere , Danial Dervovic , Yue Guo , Antigoni Polychroniadou , Min Wu , Dana Dachman-Soled

Fully Homomorphic Encryption (FHE) allows for computation directly on encrypted data and enables privacy-preserving neural inference in the cloud. Prior work has focused on models with dense inputs (e.g., CNNs), with less attention given to…

Cryptography and Security · Computer Science 2026-02-23 Karthik Garimella , Austin Ebel , Gabrielle De Micheli , Brandon Reagen

As machine learning (ML) models become increasingly deployed through cloud infrastructures, the confidentiality of user data during inference poses a significant security challenge. Homomorphic Encryption (HE) has emerged as a compelling…

Cryptography and Security · Computer Science 2025-10-29 Tejaswini Bollikonda

Due to the rising privacy demand in data mining, Homomorphic Encryption (HE) is receiving more and more attention recently for its capability to do computations over the encrypted field. By using the HE technique, it is possible to securely…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-20 Junyi Li , Heng Huang