English
Related papers

Related papers: Activate Me!: Designing Efficient Activation Funct…

200 papers

This paper introduces efficient modifications to neural network-based sequence processing approaches, laying new grounds for scalable privacy-preserving machine learning under Fully Homomorphic Encryption (FHE). Transformers are now…

Machine Learning · Computer Science 2026-03-24 Rickard Brännvall , Tony Zhang , Henrik Forsgren , Andrei Stoian , Fredrik Sandin , Marcus Liwicki

Machine learning (ML) is widely used today, especially through deep neural networks (DNNs), however, increasing computational load and resource requirements have led to cloud-based solutions. To address this problem, a new generation of…

Cryptography and Security · Computer Science 2025-06-23 Farzad Nikfam , Raffaele Casaburi , Alberto Marchisio , Maurizio Martina , Muhammad Shafique

Fully homomorphic encryption (FHE) enables computation on encrypted data without decryption, making it central to privacy-preserving applications. However, no existing scheme efficiently supports both arithmetic and comparison operations in…

Cryptography and Security · Computer Science 2026-04-23 Erwin Eko Wahyudi , Yan Solihin , Qian Lou

Fully Homomorphic Encryption~(FHE) is a key technology enabling privacy-preserving computing. However, the fundamental challenge of FHE is its inefficiency, due primarily to the underlying polynomial computations with high computation…

Cryptography and Security · Computer Science 2025-02-04 Junxue Zhang , Xiaodian Cheng , Liu Yang , Jinbin Hu , Ximeng Liu , Kai Chen

We address two fundamental challenges in adapting general deep CNNs for FHE-based inference: approximating non-linear activations such as ReLU with low-degree polynomials while minimizing accuracy degradation, and overcoming the ciphertext…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Huaming Ling , Ying Wang , Si Chen , Junfeng Fan

Activation functions influence behavior and performance of DNNs. Nonlinear activation functions, like Rectified Linear Units (ReLU), Exponential Linear Units (ELU) and Scaled Exponential Linear Units (SELU), outperform the linear…

Neural and Evolutionary Computing · Computer Science 2019-02-05 Alberto Marchisio , Muhammad Abdullah Hanif , Semeen Rehman , Maurizio Martina , Muhammad Shafique

Fully Homomorphic Encryption (FHE) has the potential to substantially improve privacy and security by enabling computation directly on encrypted data. This is especially true with deep learning, as today, many popular user services are…

Cryptography and Security · Computer Science 2025-02-14 Austin Ebel , Karthik Garimella , Brandon Reagen

Fully homomorphic encryption (FHE) is an encryption method that allows to perform computation on encrypted data, without decryption. FHE preserves the privacy of the users of online services that handle sensitive data, such as health data,…

Machine Learning · Computer Science 2023-02-23 Andrei Stoian , Jordan Frery , Roman Bredehoft , Luis Montero , Celia Kherfallah , Benoit Chevallier-Mames

The recently proposed Kolmogorov-Arnold Networks (KANs) offer enhanced interpretability and greater model expressiveness. However, KANs also present challenges related to privacy leakage during inference. Homomorphic encryption (HE)…

Machine Learning · Computer Science 2024-09-13 Zhizheng Lai , Yufei Zhou , Peijia Zheng , Lin Chen

Fully Homomorphic Encryption (FHE) is a cryptographic method that guarantees the privacy and security of user data during computation. FHE algorithms can perform unlimited arithmetic computations directly on encrypted data without…

Cryptography and Security · Computer Science 2023-06-21 Charles Gouert , Vinu Joseph , Steven Dalton , Cedric Augonnet , Michael Garland , Nektarios Georgios Tsoutsos

Homomorphic Encryption (HE) is one of the most promising post-quantum cryptographic schemes that enable privacy-preserving computation on servers. However, noise accumulates as we perform operations on HE-encrypted data, restricting the…

Cryptography and Security · Computer Science 2022-11-01 Jongmin Kim , Gwangho Lee , Sangpyo Kim , Gina Sohn , John Kim , Minsoo Rhu , Jung Ho Ahn

Homomorphic encryption (HE) is a promising privacy-preserving technique for cross-silo federated learning (FL), where organizations perform collaborative model training on decentralized data. Despite the strong privacy guarantee, general HE…

Cryptography and Security · Computer Science 2021-09-30 Zhifeng Jiang , Wei Wang , Yang Liu

In recent years, Quantum Machine Learning (QML) has increasingly captured the interest of researchers. Among the components in this domain, activation functions hold a fundamental and indispensable role. Our research focuses on the…

Quantum Physics · Physics 2024-04-10 Wei Zi , Siyi Wang , Hyunji Kim , Xiaoming Sun , Anupam Chattopadhyay , Patrick Rebentrost

Federated learning has become increasingly widespread due to its ability to train models collaboratively without centralizing sensitive data. While most research on FL emphasizes privacy-preserving techniques during training, the evaluation…

Cryptography and Security · Computer Science 2025-08-12 Cem Ata Baykara , Ali Burak Ünal , Mete Akgün

The increasing amount of data and the growing complexity of problems has resulted in an ever-growing reliance on cloud computing. However, many applications, most notably in healthcare, finance or defense, demand security and privacy which…

Cryptography and Security · Computer Science 2022-04-28 Saransh Gupta , Rosario Cammarota , Tajana Rosing

Machine learning (ML) systems that guarantee security and privacy often rely on Fully Homomorphic Encryption (FHE) as a cornerstone technique, enabling computations on encrypted data without exposing sensitive information. However, a…

Cryptography and Security · Computer Science 2024-12-20 Dongfang Zhao

Cross-silo federated learning (FL) enables multiple clients to collaboratively train a machine learning model without sharing training data, but privacy in FL remains a major challenge. Techniques using homomorphic encryption (HE) have been…

Cryptography and Security · Computer Science 2023-05-16 Jiahui Wu , Weizhe Zhang , Fucai Luo

Fully Homomorphic Encryption (FHE) refers to a set of encryption schemes that allow computations to be applied directly on encrypted data without requiring a secret key. This enables novel application scenarios where a client can safely…

Machine Learning · Computer Science 2018-10-02 Roshan Dathathri , Olli Saarikivi , Hao Chen , Kim Laine , Kristin Lauter , Saeed Maleki , Madanlal Musuvathi , Todd Mytkowicz

The widely used ReLU is favored for its hardware efficiency, {as the implementation at inference is a one bit sign case,} yet suffers from issues such as the ``dying ReLU'' problem, where during training, neurons fail to activate and…

Machine Learning · Computer Science 2025-10-31 Moshe Kimhi , Idan Kashani , Avi Mendelson , Chaim Baskin

Fully Homomorphic Encryption (FHE) is a set of powerful cryptographic schemes that allows computation to be performed directly on encrypted data with an unlimited depth. Despite FHE's promising in privacy-preserving computing, yet in most…

Cryptography and Security · Computer Science 2025-04-23 Yi Huang , Xinsheng Gong , Xiangyu Kong , Dibei Chen , Jianfeng Zhu , Wenping Zhu , Liangwei Li , Mingyu Gao , Shaojun Wei , Aoyang Zhang , Leibo Liu