English
Related papers

Related papers: Ditto: Quantization-aware Secure Inference of Tran…

200 papers

With the growing deployment of pre-trained models like Transformers on cloud platforms, privacy concerns about model parameters and inference data are intensifying. Existing Privacy-Preserving Transformer Inference (PPTI) frameworks face…

Machine Learning · Computer Science 2025-06-11 Jinglong Luo , Guanzhong Chen , Yehong Zhang , Shiyu Liu , Hui Wang , Yue Yu , Xun Zhou , Yuan Qi , Zenglin Xu

Secure Multi-Party Computation (MPC) offers a practical foundation for privacy-preserving machine learning at the edge, with MPC commonly employed to support nonlinear operations. These MPC protocols fundamentally rely on Oblivious Transfer…

Cryptography and Security · Computer Science 2025-08-26 Zhuoran Li , Hanieh Totonchi Asl , Ebrahim Nouri , Yifei Cai , Danella Zhao

Modern computing systems are limited in performance by the memory bandwidth available to processors, a problem known as the memory wall. Processing-in-Memory (PIM) promises to substantially improve this problem by moving processing closer…

Cryptography and Security · Computer Science 2025-04-24 Sahar Ghoflsaz Ghinani , Jingyao Zhang , Elaheh Sadredini

Transformer models gain popularity because of their superior inference accuracy and inference throughput. However, the transformer is computation-intensive, causing a long inference time. The existing works on transformer inference…

Performance · Computer Science 2023-04-19 Yuan Feng , Hyeran Jeon , Filip Blagojevic , Cyril Guyot , Qing Li , Dong Li

Cryptographically secure neural network inference typically relies on secure computing techniques such as Secure Multi-Party Computation (MPC), enabling cloud servers to process client inputs without decrypting them. Although prior…

Cryptography and Security · Computer Science 2026-04-20 Yukuan Zhang , Mengxin Zheng , Qian Lou

Secure Multi-party Computation (MPC) enables untrusted parties to jointly compute a function without revealing their inputs. Its application to machine learning (ML) has gained significant attention, particularly for secure inference…

Cryptography and Security · Computer Science 2026-02-17 Tingting Tang , Yongqin Wang , Murali Annavaram

Quantiles are key in distributed analytics, but computing them over sensitive data risks privacy. Local differential privacy (LDP) offers strong protection but lower accuracy than central DP, which assumes a trusted aggregator. Secure…

Cryptography and Security · Computer Science 2025-09-18 Hannah Keller , Jacob Imola , Fabrizio Boninsegna , Rasmus Pagh , Amrita Roy Chowdhury

Diffusion transformers (DiTs) combine transformer architectures with diffusion models. However, their computational complexity imposes significant limitations on real-time applications and sustainability of AI systems. In this study, we aim…

Machine Learning · Computer Science 2025-02-07 Younghye Hwang , Hyojin Lee , Joonhyuk Kang

Model Predictive Control (MPC) is a powerful control strategy for power electronics, but it highly relies on manually-derived and topology-specific analytical models, which is labor-intensive and time-consuming in practical designs. To…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Jialin Zheng , Haoyu Wang , Yangbin Zeng , Han Xu , Di Mou , Hong Li , Patrick Wheeler , Sergio Vazquez , Leopoldo G. Franquelo

Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yefei He , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

The prevalent use of Transformer-like models, exemplified by ChatGPT in modern language processing applications, underscores the critical need for enabling private inference essential for many cloud-based services reliant on such models.…

Machine Learning · Computer Science 2024-09-10 Xiangrui Xu , Qiao Zhang , Rui Ning , Chunsheng Xin , Hongyi Wu

Secure multi-party computation (MPC) offers a practical foundation for privacy-preserving machine learning at the edge. However, current MPC systems rely heavily on communication and computation-intensive primitives-such as secure…

Hardware Architecture · Computer Science 2026-03-27 Zhuoran Li , Hanieh Totonchi Asl , Yifei Cai , Ebrahim Nouri , Danella Zhao

Large transformer models, such as BERT, achieve state-of-the-art results in machine reading comprehension (MRC) for open-domain question answering (QA). However, transformers have a high computational cost for inference which makes them…

Computation and Language · Computer Science 2021-08-06 Haytham ElFadeel , Stan Peshterliev

The growing volumes of data being collected and its analysis to provide better services are creating worries about digital privacy. To address privacy concerns and give practical solutions, the literature has relied on secure multiparty…

Cryptography and Security · Computer Science 2022-06-27 Nishat Koti , Shravani Patil , Arpita Patra , Ajith Suresh

Model Predictive Control (MPC) is widely used in robot control by optimizing a sequence of control outputs over a finite-horizon. Computational approaches for MPC include deterministic methods (e.g., iLQR and COBYLA), as well as…

Robotics · Computer Science 2025-11-03 Zhaoxin Li , Xiaoke Wang , Letian Chen , Rohan Paleja , Subramanya Nageshrao , Matthew Gombolay

Large language models (LLMs) require substantial compute, and thus energy, at inference time. While quantizing weights and activations is effective at improving efficiency, naive quantization of LLMs can significantly degrade performance…

Machine Learning · Computer Science 2025-06-06 Boris van Breugel , Yelysei Bondarenko , Paul Whatmough , Markus Nagel

We address the problem of efficiently verifying a commitment in a two-party computation. This addresses the scenario where a party P1 commits to a value $x$ to be used in a subsequent secure computation with another party P2 that wants to…

Cryptography and Security · Computer Science 2022-01-28 Nitin Agrawal , James Bell , Adrià Gascón , Matt J. Kusner

Transformer based models, like BERT and RoBERTa, have achieved state-of-the-art results in many Natural Language Processing tasks. However, their memory footprint, inference latency, and power consumption are prohibitive efficient inference…

Computation and Language · Computer Science 2022-05-02 Sehoon Kim , Amir Gholami , Zhewei Yao , Michael W. Mahoney , Kurt Keutzer

Accuracy and efficiency remain challenges for multi-party computation (MPC) frameworks. Spin is a GPU-accelerated MPC framework that supports multiple computation parties and a dishonest majority adversarial setup. We propose optimized…

Cryptography and Security · Computer Science 2024-02-27 Wuxuan Jiang , Xiangjun Song , Shenbai Hong , Haijun Zhang , Wenxin Liu , Bo Zhao , Wei Xu , Yi Li

In an MPC-protected distributed computation, although the use of MPC assures data privacy during computation, sensitive information may still be inferred by curious MPC participants from the computation output. This can be observed, for…

Cryptography and Security · Computer Science 2025-03-11 Ivan Tjuawinata , Jiabo Wang , Mengmeng Yang , Shanxiang Lyu , Huaxiong Wang , Kwok-Yan Lam