English
Related papers

Related papers: Privacy-Preserving Inference in Machine Learning S…

200 papers

We present a practical system for privacy-aware large language model (LLM) inference that splits a transformer between a trusted local GPU and an untrusted cloud GPU, communicating only intermediate activations over the network. Our system…

Cryptography and Security · Computer Science 2026-02-20 Michael Cunningham

The rapid development of large language models (LLMs) has driven the widespread adoption of cloud-based LLM inference services, while also bringing prominent privacy risks associated with the transmission and processing of private data in…

Cryptography and Security · Computer Science 2026-03-31 Yu Lin , Qizhi Zhang , Wenqiang Ruan , Daode Zhang , Jue Hong , Ye Wu , Hanning Xia , Yunlong Mao , Sheng Zhong

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu

Privacy and security-related concerns are growing as machine learning reaches diverse application domains. The data holders want to train with private data while exploiting accelerators, such as GPUs, that are hosted in the cloud. However,…

Cryptography and Security · Computer Science 2021-05-04 Hanieh Hashemi , Yongqin Wang , Murali Annavaram

In the wake of the burgeoning expansion of generative artificial intelligence (AI) services, the computational demands inherent to these technologies frequently necessitate cloud-powered computational offloading, particularly for…

Machine Learning · Computer Science 2024-10-28 Shoki Ohta , Takayuki Nishio

As Edge Intelligence (EI) becomes increasingly prevalent in domains such as smart healthcare, manufacturing, and critical infrastructure, ensuring data privacy while maintaining system efficiency is a growing challenge. This paper presents…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Quoc Lap Trieu , Bahman Javadi , Jim Basilakis

As Deep Neural Network (DNN) inference becomes increasingly prevalent on edge and mobile platforms, critical challenges emerge in privacy protection, resource constraints, and dynamic model deployment. This paper proposes a privacy-aware…

Multiagent Systems · Computer Science 2026-03-03 Hong Wang , Xuwei Fan , Zhipeng Cheng , Yachao Yuan , Minghui Min , Minghui Liwang , Xiaoyu Xia

Privacy-preserving deep learning is crucial for deploying deep neural network based solutions, especially when the model works on data that contains sensitive information. Most privacy-preserving methods lead to undesirable performance…

Cryptography and Security · Computer Science 2019-09-19 Lichao Sun , Yingbo Zhou , Ji Wang , Jia Li , Richard Sochar , Philip S. Yu , Caiming Xiong

Data-driven inertial sequence learning has revolutionized navigation in GPS-denied environments, offering superior odometric resolution compared to traditional Bayesian methods. However, deep learning-based inertial tracking systems remain…

Machine Learning · Computer Science 2025-10-23 Omer Tariq , Muhammad Bilal , Muneeb Ul Hassan , Dongsoo Han , Jon Crowcroft

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

The rapid adoption of data-driven methods in biomedicine has intensified concerns over privacy, governance, and regulation, limiting raw data sharing and hindering the assembly of representative cohorts for clinically relevant AI. This…

Large scale deep learning model, such as modern language models and diffusion architectures, have revolutionized applications ranging from natural language processing to computer vision. However, their deployment in distributed or…

We propose AriaNN, a low-interaction privacy-preserving framework for private neural network training and inference on sensitive data. Our semi-honest 2-party computation protocol (with a trusted dealer) leverages function secret sharing, a…

Machine Learning · Computer Science 2021-10-29 Théo Ryffel , Pierre Tholoniat , David Pointcheval , Francis Bach

The skip-gram model (SGM), which employs a neural network to generate node vectors, serves as the basis for numerous popular graph embedding techniques. However, since the training datasets contain sensitive linkage information, the…

Machine Learning · Computer Science 2025-03-28 Sen Zhang , Qingqing Ye , Haibo Hu , Jianliang Xu

ldp deployments are vulnerable to inference attacks as an adversary can link the noisy responses to their identity and subsequently, auxiliary information using the order of the data. An alternative model, shuffle DP, prevents this by…

Machine Learning · Computer Science 2021-10-18 Casey Meehan , Amrita Roy Chowdhury , Kamalika Chaudhuri , Somesh Jha

The convergence of Artificial Intelligence (AI) and blockchain technology is reshaping the digital world, offering decentralized, secure, and efficient AI services on blockchain platforms. Despite the promise, the high computational demands…

Cryptography and Security · Computer Science 2024-02-26 Cathie So , KD Conway , Xiaohang Yu , Suning Yao , Kartin Wong

The integration of Large Language Models (LLMs) in 6G vehicular networks promises unprecedented advancements in intelligent transportation systems. However, offloading LLM computations from vehicles to edge infrastructure poses significant…

Cryptography and Security · Computer Science 2025-09-09 Ikhlasse Badidi , Nouhaila El Khiyaoui , Aya Riany , Badr Ben Elallid , Amine Abouaomar

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Internet of Things (IoT) devices and applications are being deployed in our homes and workplaces. These devices often rely on continuous data collection to feed machine learning models. However, this approach introduces several privacy and…