中文
相关论文

相关论文: MPCFormer: fast, performant and private Transforme…

200 篇论文

Transformer models gain popularity because of their superior inference accuracy and inference throughput. However, the transformer is computation-intensive, causing a long inference time. The existing works on transformer inference…

性能 · 计算机科学 2023-04-19 Yuan Feng , Hyeran Jeon , Filip Blagojevic , Cyril Guyot , Qing Li , Dong Li

Secure multi-party computation (MPC) enables computation directly on encrypted data and protects both data and model privacy in deep learning inference. However, existing neural network architectures, including Vision Transformers (ViTs),…

密码学与安全 · 计算机科学 2023-08-22 Wenxuan Zeng , Meng Li , Wenjie Xiong , Tong Tong , Wen-jie Lu , Jin Tan , Runsheng Wang , Ru Huang

This paper focuses on designing a privacy-preserving Machine Learning (ML) inference protocol for a hierarchical setup, where clients own/generate data, model owners (cloud servers) have a pre-trained ML model, and edge servers perform ML…

密码学与安全 · 计算机科学 2024-09-17 Fatemeh Jafarian Dehkordi , Yasaman Keshtkarjahromi , Hulya Seferoglu

When applying machine learning to sensitive data, one has to find a balance between accuracy, information security, and computational-complexity. Recent studies combined Homomorphic Encryption with neural networks to make inferences while…

机器学习 · 计算机科学 2019-06-07 Alon Brutzkus , Oren Elisha , Ran Gilad-Bachrach

We are witnessing an increasing trend towardsusing Machine Learning (ML) based prediction systems, span-ning across different application domains, including productrecommendation systems, personal assistant devices, facialrecognition, etc.…

分布式、并行与集群计算 · 计算机科学 2020-08-24 Jashwant Raj Gunasekaran , Prashanth Thinakaran , Cyan Subhra Mishra , Mahmut Taylan Kandemir , Chita R. Das

Transformer-based language models have achieved remarkable performance across a wide range of tasks, yet their high inference latency poses a significant challenge for real-timeand large-scale deployment. While existing caching…

计算与语言 · 计算机科学 2026-03-03 Harsh Vardhan Bansal

Multi-Party Computation (MPC) is a technique enabling data from several sources to be used in a secure computation revealing only the result while protecting the original data, facilitating shared utilization of data sets gathered by…

密码学与安全 · 计算机科学 2020-07-03 Pierre-Francois Wolfe , Rushi Patel , Robert Munafo , Mayank Varia , Martin Herbordt

The impressive performance of transformer models has sparked the deployment of intelligent applications on resource-constrained edge devices. However, ensuring high-quality service for real-time edge systems is a significant challenge due…

分布式、并行与集群计算 · 计算机科学 2025-08-29 Guanyu Xu , Zhiwei Hao , Li Shen , Yong Luo , Fuhui Sun , Xiaoyan Wang , Han Hu , Yonggang Wen

On-device machine learning (ML) inference can enable the use of private user data on user devices without revealing them to remote servers. However, a pure on-device solution to private ML inference is impractical for many applications that…

The prevalent use of Transformer-like models, exemplified by ChatGPT in modern language processing applications, underscores the critical need for enabling private inference essential for many cloud-based services reliant on such models.…

机器学习 · 计算机科学 2024-09-10 Xiangrui Xu , Qiao Zhang , Rui Ning , Chunsheng Xin , Hongyi Wu

Transformer has been successfully used in practical applications, such as ChatGPT, due to its powerful advantages. However, users' input is leaked to the model provider during the service. With people's attention to privacy,…

密码学与安全 · 计算机科学 2023-08-22 Yuanchao Ding , Hua Guo , Yewei Guan , Weixin Liu , Jiarong Huo , Zhenyu Guan , Xiyong Zhang

Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The…

Secure Multi-party Computation (MPC) enables untrusted parties to jointly compute a function without revealing their inputs. Its application to machine learning (ML) has gained significant attention, particularly for secure inference…

密码学与安全 · 计算机科学 2026-02-17 Tingting Tang , Yongqin Wang , Murali Annavaram

In an MPC-protected distributed computation, although the use of MPC assures data privacy during computation, sensitive information may still be inferred by curious MPC participants from the computation output. This can be observed, for…

密码学与安全 · 计算机科学 2025-03-11 Ivan Tjuawinata , Jiabo Wang , Mengmeng Yang , Shanxiang Lyu , Huaxiong Wang , Kwok-Yan Lam

Machine learning has recently gained traction as a way to overcome the slow accelerator generation and implementation process on an FPGA. It can be used to build performance and resource usage models that enable fast early-stage design…

硬件体系结构 · 计算机科学 2022-10-04 Gagandeep Singh , Dionysios Diamantopoulos , Juan Gómez-Luna , Sander Stuijk , Henk Corporaal , Onur Mutlu

Confidential multi-stakeholder machine learning (ML) allows multiple parties to perform collaborative data analytics while not revealing their intellectual property, such as ML source code, model, or datasets. State-of-the-art solutions…

机器学习 · 计算机科学 2021-06-04 Wojciech Ozga , Do Le Quoc , Christof Fetzer

This paper explores the privacy of cloud outsourced Model Predictive Control (MPC) for a linear system with input constraints. In our cloud-based architecture, a client sends her private states to the cloud who performs the MPC computation…

最优化与控制 · 数学 2018-09-20 Andreea B. Alexandru , Manfred Morari , George J. Pappas

Existing work on privacy-preserving machine learning with Secure Multiparty Computation (MPC) is almost exclusively focused on model training and on inference with trained models, thereby overlooking the important data pre-processing stage.…

密码学与安全 · 计算机科学 2021-02-09 Xiling Li , Rafael Dowsley , Martine De Cock

Workload forecasting is pivotal in cloud service applications, such as auto-scaling and scheduling, with profound implications for operational efficiency. Although Transformer-based forecasting models have demonstrated remarkable success in…

机器学习 · 计算机科学 2025-07-18 Jiadong Chen , Hengyu Ye , Fuxin Jiang , Xiao He , Tieying Zhang , Jianjun Chen , Xiaofeng Gao

In the domain of multivariate forecasting, transformer models stand out as powerful apparatus, displaying exceptional capabilities in handling messy datasets from real-world contexts. However, the inherent complexity of these datasets,…

机器学习 · 计算机科学 2024-03-08 Jingjing Xu , Caesar Wu , Yuan-Fang Li , Pascal Bouvry