中文
相关论文

相关论文: MPCFormer: fast, performant and private Transforme…

200 篇论文

In this paper, we propose a new secure machine learning inference platform assisted by a small dedicated security processor, which will be easier to protect and deploy compared to today's TEEs integrated into high-performance processors.…

密码学与安全 · 计算机科学 2024-10-30 Pengzhi Huang , Thang Hoang , Yueying Li , Elaine Shi , G. Edward Suh

Transformers have reached remarkable success in sequence modeling. However, these models have efficiency issues as they need to store all the history token-level representations as memory. We present Memformer, an efficient neural network…

计算与语言 · 计算机科学 2022-04-14 Qingyang Wu , Zhenzhong Lan , Kun Qian , Jing Gu , Alborz Geramifard , Zhou Yu

Homomorphic encryption (HE) and secret sharing (SS) enable computations on encrypted data, providing significant privacy benefits for large transformer-based models (TBM) in sensitive sectors like medicine and finance. However, private TBM…

密码学与安全 · 计算机科学 2025-07-04 Yuntian Chen , Zhanyong Tang , Tianpei Lu , Bingsheng Zhang , Zhiying Shi , Zheng Wang

A typical setup in many machine learning scenarios involves a server that holds a model and a user that possesses data, and the challenge is to perform inference while safeguarding the privacy of both parties. Private Inference has been…

信息论 · 计算机科学 2023-11-27 Zirui Deng , Vinayak Ramkumar , Rawad Bitar , Netanel Raviv

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of…

Accuracy and efficiency remain challenges for multi-party computation (MPC) frameworks. Spin is a GPU-accelerated MPC framework that supports multiple computation parties and a dishonest majority adversarial setup. We propose optimized…

密码学与安全 · 计算机科学 2024-02-27 Wuxuan Jiang , Xiangjun Song , Shenbai Hong , Haijun Zhang , Wenxin Liu , Bo Zhao , Wei Xu , Yi Li

Secure Multi-Party Computation (MPC) is an area of cryptography that enables computation on sensitive data from multiple sources while maintaining privacy guarantees. However, theoretical MPC protocols often do not scale efficiently to…

密码学与安全 · 计算机科学 2019-01-03 Valerie Chen , Valerio Pastro , Mariana Raykova

Secure multi-party computation (MPC) allows parties to perform computations on data while keeping that data private. This capability has great potential for machine-learning applications: it facilitates training of machine-learning models…

机器学习 · 计算机科学 2022-09-19 Brian Knott , Shobha Venkataraman , Awni Hannun , Shubho Sengupta , Mark Ibrahim , Laurens van der Maaten

Secure Multi-Party Computation (MPC) offers a practical foundation for privacy-preserving machine learning at the edge, with MPC commonly employed to support nonlinear operations. These MPC protocols fundamentally rely on Oblivious Transfer…

密码学与安全 · 计算机科学 2025-08-26 Zhuoran Li , Hanieh Totonchi Asl , Ebrahim Nouri , Yifei Cai , Danella Zhao

The emergence of cloud computing provides a new computing paradigm for users -- massive and complex computing tasks can be outsourced to cloud servers. However, the privacy issues also follow. Fully homomorphic encryption shows great…

密码学与安全 · 计算机科学 2021-04-01 Lizhi Xiong , Wenhao Zhou , Zhihua Xia , Qi Gu , Jian Weng

Machine Learning as a Service (MLaaS) exposes sensitive client data to service providers. Private inference mitigates this risk while preserving model functionality. Despite extensive progress in MPC-based solutions, they remain constrained…

密码学与安全 · 计算机科学 2026-04-22 Kaiwen Wang , Xiaolin Chang , Junchao Fan , Yuehan Dong

Transformers have had a profound impact on the field of artificial intelligence, especially on large language models and their variants. However, as was the case with neural networks, their black-box nature limits trust and deployment in…

机器学习 · 计算机科学 2026-04-13 Abhiram Vellore , Niraj K. Jha

It is widely acknowledged that the performance of Transformer models is logarithmically related to their number of parameters and computational complexity. While approaches like Mixture of Experts (MoE) decouple parameter count from…

机器学习 · 计算机科学 2025-02-07 Zihao Huang , Qiyang Min , Hongzhi Huang , Defa Zhu , Yutao Zeng , Ran Guo , Xun Zhou

Privacy-preserving Transformer inference has gained attention due to the potential leakage of private information. Despite recent progress, existing frameworks still fall short of practical model scales, with gaps up to a hundredfold. A…

密码学与安全 · 计算机科学 2026-01-13 Bowen Shen , Yuyue Chen , Peng Yang , Bin Zhang , Xi Zhang , Zoe L. Jiang

Faster, cheaper, and more power efficient optimization solvers than those currently offered by general-purpose solutions are required for extending the use of model predictive control (MPC) to resource-constrained embedded platforms. We…

Today's cloud vendors are competing to provide various offerings to simplify and accelerate AI service deployment. However, cloud users always have concerns about the confidentiality of their runtime data, which are supposed to be processed…

密码学与安全 · 计算机科学 2020-08-14 Zhongshu Gu , Heqing Huang , Jialong Zhang , Dong Su , Hani Jamjoom , Ankita Lamba , Dimitrios Pendarakis , Ian Molloy

Privacy-preserving machine learning (PPML) aims at enabling machine learning (ML) algorithms to be used on sensitive data. We contribute to this line of research by proposing a framework that allows efficient and secure evaluation of…

Secure Multi-Party Computation (MPC) enables collaborative analytics without exposing private data. However, OLAP queries under MPC remain prohibitively slow due to oblivious execution and padding of intermediate results with filler tuples.…

数据库 · 计算机科学 2025-10-24 Long Gu , Shaza Zeitouni , Carsten Binnig , Zsolt István

Efficient inference is a critical challenge in deep generative modeling, particularly as diffusion models grow in capacity and complexity. While increased complexity often improves accuracy, it raises compute costs, latency, and memory…

机器学习 · 计算机科学 2025-09-24 Siu Hang Ho , Prasad Ganesan , Nguyen Duong , Daniel Schlabig

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

系统与控制 · 电气工程与系统科学 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli