English
Related papers

Related papers: Accelerating Private Large Transformers Inference …

200 papers

There is a growing trend to outsource the inference task of large transformer models to cloud servers. However, this poses a severe threat to users' private data as they are exposed to cloud servers after uploading. Although several works…

Cryptography and Security · Computer Science 2024-03-26 Weize Wang , Yi Kuang

Large language models(LLMs) are currently at the forefront of the machine learning field, which show a broad application prospect but at the same time expose some risks of privacy leakage. We combined Fully Homomorphic Encryption(FHE) and…

Cryptography and Security · Computer Science 2025-01-08 Zhang Ruoyan , Zheng Zhongxiang , Bao Wankang

With the rapid surge in the prevalence of Large Language Models (LLMs), individuals are increasingly turning to conversational AI for initial insights across various domains, including health-related inquiries such as disease diagnosis.…

Cryptography and Security · Computer Science 2024-05-07 Aditya Malik , Nalini Ratha , Bharat Yalavarthi , Tilak Sharma , Arjun Kaushik , Charanjit Jutla

With the growing popularity of LLMs among the general public users, privacy-preserving and adversarial robustness have become two pressing demands for LLM-based services, which have largely been pursued separately but rarely jointly. In…

Cryptography and Security · Computer Science 2025-02-04 Jiawen Zhang , Kejia Chen , Zunlei Feng , Jian Lou , Mingli Song , Jian Liu , Xiaohu Yang

Two parties wish to collaborate on their datasets. However, before they reveal their datasets to each other, the parties want to have the guarantee that the collaboration would be fruitful. We look at this problem from the point of view of…

Cryptography and Security · Computer Science 2024-10-10 Hassan Jameel Asghar , Zhigang Lu , Zhongrui Zhao , Dali Kaafar

As large language models (LLMs) become ubiquitous, privacy concerns pertaining to inference inputs keep growing. In this context, fully homomorphic encryption (FHE) has emerged as a primary cryptographic solution to provide non-interactive…

Cryptography and Security · Computer Science 2026-01-27 Jaiyoung Park , Sejin Park , Jai Hyun Park , Jung Ho Ahn , Jung Hee Cheon , Guillaume Hanrot , Jung Woo Kim , Minje Park , Damien Stehlé

Due to the extensive application of machine learning (ML) in a wide range of fields and the necessity of data privacy, privacy-preserving machine learning (PPML) solutions have recently gained significant traction. One group of approaches…

Cryptography and Security · Computer Science 2025-01-31 Parsa Ghazvinian , Robert Podschwadt , Prajwal Panzade , Mohammad H. Rafiei , Daniel Takabi

Machine Learning (ML) has emerged as one of data science's most transformative and influential domains. However, the widespread adoption of ML introduces privacy-related concerns owing to the increasing number of malicious attacks targeting…

Machine Learning · Computer Science 2024-01-29 Eugene Frimpong , Khoa Nguyen , Mindaugas Budzys , Tanveer Khan , Antonis Michalas

Homomorphic encryption (HE) is pivotal for secure computation on encrypted data, crucial in privacy-preserving data analysis. However, efficiently processing high-dimensional data in HE, especially for machine learning and statistical…

Cryptography and Security · Computer Science 2024-06-17 Joon Soo Yoo , Baek Kyung Song , Tae Min Ahn , Ji Won Heo , Ji Won Yoon

Sparse matrix-vector multiplication (SpMV) is a fundamental operation in scientific computing, data analysis, and machine learning. When the data being processed are sensitive, preserving privacy becomes critical, and homomorphic encryption…

Cryptography and Security · Computer Science 2026-03-06 Yang Gao , Gang Quan , Wujie Wen , Scott Piersall , Qian Lou , Liqiang Wang

Incorporating fully homomorphic encryption (FHE) into the inference process of a convolutional neural network (CNN) draws enormous attention as a viable approach for achieving private inference (PI). FHE allows delegating the entire…

Cryptography and Security · Computer Science 2023-10-26 Jaiyoung Park , Donghwan Kim , Jongmin Kim , Sangpyo Kim , Wonkyung Jung , Jung Hee Cheon , Jung Ho Ahn

With the increasing demands for privacy protection, many privacy-preserving machine learning systems were proposed in recent years. However, most of them cannot be put into production due to their slow training and inference speed caused by…

Cryptography and Security · Computer Science 2020-08-19 Fei Zheng

In today's machine learning landscape, fine-tuning pretrained transformer models has emerged as an essential technique, particularly in scenarios where access to task-aligned training data is limited. However, challenges surface when data…

Machine Learning · Computer Science 2024-02-15 Prajwal Panzade , Daniel Takabi , Zhipeng Cai

Federated fine-tuning is critical for improving the performance of large language models (LLMs) in handling domain-specific tasks while keeping training data decentralized and private. However, prior work has shown that clients' private…

Cryptography and Security · Computer Science 2026-02-24 Jianmin Liu , Li Yan , Borui Li , Lei Yu , Chao Shen

Homomorphic encryption enables arbitrary computation over data while it remains encrypted. This privacy-preserving feature is attractive for machine learning, but requires significant computational time due to the large overhead of the…

Cryptography and Security · Computer Science 2018-11-27 Edward Chou , Josh Beal , Daniel Levy , Serena Yeung , Albert Haque , Li Fei-Fei

As privacy concerns in AI technologies continue to grow, Homomorphic Encryption (HE) offers a way to perform computations on encrypted data without the need of decryption during operations. However, HE is limited to addition and…

Cryptography and Security · Computer Science 2026-05-25 Dimitrios Sygletos , Dimitra Papatsaroucha , Marios Choudetsanakis , Ilias Politis , Evangelos K. Markakis

Privacy-preserving solutions enable companies to offload confidential data to third-party services while fulfilling their government regulations. To accomplish this, they leverage various cryptographic techniques such as Homomorphic…

Due to the rising privacy demand in data mining, Homomorphic Encryption (HE) is receiving more and more attention recently for its capability to do computations over the encrypted field. By using the HE technique, it is possible to securely…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-20 Junyi Li , Heng Huang

With the rapid advancement of AI technology, we have seen more and more concerns on data privacy, leading to some cutting-edge research on machine learning with encrypted computation. Fully Homomorphic Encryption (FHE) is a crucial…

Cryptography and Security · Computer Science 2026-03-31 Longfei Guo , Pengbo Li , Ting Gao , Yonghai Zhong , Haojie Fan , Jinqiao Duan

Big data has been a pervasive catchphrase in recent years, but dealing with data scarcity has become a crucial question for many real-world deep learning (DL) applications. A popular methodology to efficiently enable the training of DL…

Cryptography and Security · Computer Science 2022-10-21 Roman Walch , Samuel Sousa , Lukas Helminger , Stefanie Lindstaedt , Christian Rechberger , Andreas Trügler