中文
相关论文

相关论文: Ditto: Quantization-aware Secure Inference of Tran…

200 篇论文

With the growing deployment of pre-trained models like Transformers on cloud platforms, privacy concerns about model parameters and inference data are intensifying. Existing Privacy-Preserving Transformer Inference (PPTI) frameworks face…

机器学习 · 计算机科学 2025-06-11 Jinglong Luo , Guanzhong Chen , Yehong Zhang , Shiyu Liu , Hui Wang , Yue Yu , Xun Zhou , Yuan Qi , Zenglin Xu

Secure Multi-Party Computation (MPC) offers a practical foundation for privacy-preserving machine learning at the edge, with MPC commonly employed to support nonlinear operations. These MPC protocols fundamentally rely on Oblivious Transfer…

密码学与安全 · 计算机科学 2025-08-26 Zhuoran Li , Hanieh Totonchi Asl , Ebrahim Nouri , Yifei Cai , Danella Zhao

Modern computing systems are limited in performance by the memory bandwidth available to processors, a problem known as the memory wall. Processing-in-Memory (PIM) promises to substantially improve this problem by moving processing closer…

密码学与安全 · 计算机科学 2025-04-24 Sahar Ghoflsaz Ghinani , Jingyao Zhang , Elaheh Sadredini

Transformer models gain popularity because of their superior inference accuracy and inference throughput. However, the transformer is computation-intensive, causing a long inference time. The existing works on transformer inference…

性能 · 计算机科学 2023-04-19 Yuan Feng , Hyeran Jeon , Filip Blagojevic , Cyril Guyot , Qing Li , Dong Li

Cryptographically secure neural network inference typically relies on secure computing techniques such as Secure Multi-Party Computation (MPC), enabling cloud servers to process client inputs without decrypting them. Although prior…

密码学与安全 · 计算机科学 2026-04-20 Yukuan Zhang , Mengxin Zheng , Qian Lou

Secure Multi-party Computation (MPC) enables untrusted parties to jointly compute a function without revealing their inputs. Its application to machine learning (ML) has gained significant attention, particularly for secure inference…

密码学与安全 · 计算机科学 2026-02-17 Tingting Tang , Yongqin Wang , Murali Annavaram

Quantiles are key in distributed analytics, but computing them over sensitive data risks privacy. Local differential privacy (LDP) offers strong protection but lower accuracy than central DP, which assumes a trusted aggregator. Secure…

密码学与安全 · 计算机科学 2025-09-18 Hannah Keller , Jacob Imola , Fabrizio Boninsegna , Rasmus Pagh , Amrita Roy Chowdhury

Diffusion transformers (DiTs) combine transformer architectures with diffusion models. However, their computational complexity imposes significant limitations on real-time applications and sustainability of AI systems. In this study, we aim…

机器学习 · 计算机科学 2025-02-07 Younghye Hwang , Hyojin Lee , Joonhyuk Kang

Model Predictive Control (MPC) is a powerful control strategy for power electronics, but it highly relies on manually-derived and topology-specific analytical models, which is labor-intensive and time-consuming in practical designs. To…

系统与控制 · 电气工程与系统科学 2025-12-16 Jialin Zheng , Haoyu Wang , Yangbin Zeng , Han Xu , Di Mou , Hong Li , Patrick Wheeler , Sergio Vazquez , Leopoldo G. Franquelo

Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues.…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Yefei He , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

The prevalent use of Transformer-like models, exemplified by ChatGPT in modern language processing applications, underscores the critical need for enabling private inference essential for many cloud-based services reliant on such models.…

机器学习 · 计算机科学 2024-09-10 Xiangrui Xu , Qiao Zhang , Rui Ning , Chunsheng Xin , Hongyi Wu

Secure multi-party computation (MPC) offers a practical foundation for privacy-preserving machine learning at the edge. However, current MPC systems rely heavily on communication and computation-intensive primitives-such as secure…

硬件体系结构 · 计算机科学 2026-03-27 Zhuoran Li , Hanieh Totonchi Asl , Yifei Cai , Ebrahim Nouri , Danella Zhao

Large transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes them…

计算与语言 · 计算机科学 2021-08-06 Haytham ElFadeel , Stan Peshterliev

The growing volumes of data being collected and its analysis to provide better services are creating worries about digital privacy. To address privacy concerns and give practical solutions, the literature has relied on secure multiparty…

密码学与安全 · 计算机科学 2022-06-27 Nishat Koti , Shravani Patil , Arpita Patra , Ajith Suresh

Model Predictive Control (MPC) is widely used in robot control by optimizing a sequence of control outputs over a finite-horizon. Computational approaches for MPC include deterministic methods (e.g., iLQR and COBYLA), as well as…

机器人学 · 计算机科学 2025-11-03 Zhaoxin Li , Xiaoke Wang , Letian Chen , Rohan Paleja , Subramanya Nageshrao , Matthew Gombolay

Large language models (LLMs) require substantial compute, and thus energy, at inference time. While quantizing weights and activations is effective at improving efficiency, naive quantization of LLMs can significantly degrade performance…

机器学习 · 计算机科学 2025-06-06 Boris van Breugel , Yelysei Bondarenko , Paul Whatmough , Markus Nagel

We address the problem of efficiently verifying a commitment in a two-party computation. This addresses the scenario where a party P1 commits to a value $x$ to be used in a subsequent secure computation with another party P2 that wants to…

密码学与安全 · 计算机科学 2022-01-28 Nitin Agrawal , James Bell , Adrià Gascón , Matt J. Kusner

Transformer based models, like BERT and RoBERTa, have achieved state-of-the-art results in many Natural Language Processing tasks. However, their memory footprint, inference latency, and power consumption are prohibitive efficient inference…

计算与语言 · 计算机科学 2022-05-02 Sehoon Kim , Amir Gholami , Zhewei Yao , Michael W. Mahoney , Kurt Keutzer

Accuracy and efficiency remain challenges for multi-party computation (MPC) frameworks. Spin is a GPU-accelerated MPC framework that supports multiple computation parties and a dishonest majority adversarial setup. We propose optimized…

密码学与安全 · 计算机科学 2024-02-27 Wuxuan Jiang , Xiangjun Song , Shenbai Hong , Haijun Zhang , Wenxin Liu , Bo Zhao , Wei Xu , Yi Li

In an MPC-protected distributed computation, although the use of MPC assures data privacy during computation, sensitive information may still be inferred by curious MPC participants from the computation output. This can be observed, for…

密码学与安全 · 计算机科学 2025-03-11 Ivan Tjuawinata , Jiabo Wang , Mengmeng Yang , Shanxiang Lyu , Huaxiong Wang , Kwok-Yan Lam