English
Related papers

Related papers: Activate Me!: Designing Efficient Activation Funct…

200 papers

Computational privacy is a property of cryptographic system that ensures the privacy of data being processed at an untrusted server. Fully Homomorphic Encryption Schemes (FHE) promise to provide such property. Contemporary FHE schemes are…

Cryptography and Security · Computer Science 2014-06-10 Sashank Dara

Recent studies have shown that the choice of activation function can significantly affect the performance of deep learning networks. However, the benefits of novel activation functions have been inconsistent and task dependent, and…

Machine Learning · Computer Science 2022-01-25 Garrett Bingham , Risto Miikkulainen

Rectified linear unit (ReLU) is a widely used activation function for deep convolutional neural networks. However, because of the zero-hard rectification, ReLU networks miss the benefits from negative values. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Suo Qiu , Xiangmin Xu , Bolun Cai

Fully homomorphic encryption (FHE) allows anyone to perform computations on encrypted data, despite not having the secret decryption key. Since the Gentry's work in 2009, the primitive has interested many researchers. In this paper, we…

Cryptography and Security · Computer Science 2015-11-18 Zhengjun Cao , Lihua Liu

While many hardware accelerators have recently been proposed to address the inefficiency problem of fully homomorphic encryption (FHE) schemes, none of them is able to deliver optimal performance when facing real-world FHE workloads…

Hardware Architecture · Computer Science 2025-01-31 Junxue Zhang , Xiaodian Cheng , Gang Cao , Meng Dai , Yijun Sun , Han Tian , Dian Shen , Yong Wang , Kai Chen

Fully homomorphic encryption (FHE) allows an untrusted party to evaluate arithmetic cir- cuits, i.e., perform additions and multiplications on encrypted data, without having the decryp- tion key. One of the most efficient class of FHE…

Data Structures and Algorithms · Computer Science 2017-11-20 Hao Chen

Word-wise Fully Homomorphic Encryption (FHE) schemes, such as CKKS, are gaining significant traction due to their ability to provide post-quantum-resistant, privacy-preserving approximate computing; an especially desirable feature in…

Modern cryptographic methods for implementing privacy-preserving LLMs such as \gls{HE} require the LLMs to have a polynomial form. Forming such a representation is challenging because transformers include non-polynomial components, such as…

The federated learning (FL) technique was developed to mitigate data privacy issues in the traditional machine learning paradigm. While FL ensures that a user's data always remain with the user, the gradients are shared with the centralized…

Artificial Intelligence · Computer Science 2024-10-08 Yogachandran Rahulamathavan , Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Carsten Maple

Privacy-Preserving Machine Learning algorithms must balance classification accuracy with data privacy. This can be done using a combination of cryptographic and machine learning tools such as Convolutional Neural Networks (CNN). CNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Inbar Helbitz , Shai Avidan

Neural networks have shown tremendous growth in recent years to solve numerous problems. Various types of neural networks have been introduced to deal with different types of problems. However, the main goal of any neural network is to…

Machine Learning · Computer Science 2022-06-29 Shiv Ram Dubey , Satish Kumar Singh , Bidyut Baran Chaudhuri

Transfer learning is a de facto standard method for efficiently training machine learning models for data-scarce problems by adding and fine-tuning new classification layers to a model pre-trained on large datasets. Although numerous…

Cryptography and Security · Computer Science 2024-06-21 Seewoo Lee , Garam Lee , Jung Woo Kim , Junbum Shin , Mun-Kyu Lee

The use of Neural Networks (NNs) for sensitive data processing is becoming increasingly popular, raising concerns about data privacy and security. Homomorphic Encryption (HE) has the potential to be used as a solution to preserve data…

Cryptography and Security · Computer Science 2023-05-04 Ivone Amorim , Eva Maia , Pedro Barbosa , Isabel Praça

Machine Learning as a Service (MLaaS) is an increasingly popular design where a company with abundant computing resources trains a deep neural network and offers query access for tasks like image classification. The challenge with this…

Activation functions (AFs) play a pivotal role in the performance of neural networks. The Rectified Linear Unit (ReLU) is currently the most commonly used AF. Several replacements to ReLU have been suggested but improvements have proven…

Neural and Evolutionary Computing · Computer Science 2022-06-27 Raz Lapid , Moshe Sipper

Much of machine learning relies on the use of large amounts of data to train models to make predictions. When this data comes from multiple sources, for example when evaluation of data against a machine learning model is offered as a…

Cryptography and Security · Computer Science 2020-01-30 Peter Fenner , Edward O. Pyzer-Knapp

Secure multi-party computation (MPC) techniques can be used to provide data privacy when users query deep neural network (DNN) models hosted on a public cloud. State-of-the-art MPC techniques can be directly leveraged for DNN models that…

Cryptography and Security · Computer Science 2024-03-19 Mazharul Islam , Sunpreet S. Arora , Rahul Chatterjee , Peter Rindal , Maliheh Shirvanian

The dramatic increase of data breaches in modern computing platforms has emphasized that access control is not sufficient to protect sensitive user data. Recent advances in cryptography allow end-to-end processing of encrypted data without…

Cryptography and Security · Computer Science 2023-01-19 Eduardo Chielle , Oleg Mazonka , Homer Gamil , Michail Maniatakos

Privacy enhancing technologies (PETs) have been proposed as a way to protect the privacy of data while still allowing for data analysis. In this work, we focus on Fully Homomorphic Encryption (FHE), a powerful tool that allows for arbitrary…

Cryptography and Security · Computer Science 2023-08-08 Jordan Frery , Andrei Stoian , Roman Bredehoft , Luis Montero , Celia Kherfallah , Benoit Chevallier-Mames , Arthur Meyre

This paper explores the use of partially homomorphic encryption (PHE) for encrypted vector similarity search, with a focus on facial recognition and broader applications like reverse image search, recommendation engines, and large language…

Cryptography and Security · Computer Science 2025-03-11 Sefik Serengil , Alper Ozpinar