English
Related papers

Related papers: Private Transformer Inference in MLaaS: A Survey

200 papers

Large pretrained language models (LLMs) have shown surprising In-Context Learning (ICL) ability. An important application in deploying large language models is to augment LLMs with a private database for some specific task. The main problem…

Cryptography and Security · Computer Science 2024-05-09 Chunyan Zheng , Keke Sun , Wenhao Zhao , Haibo Zhou , Lixin Jiang , Shaoyang Song , Chunlai Zhou

Differential privacy has emerged as the main definition for private data analysis and machine learning. The {\em global} model of differential privacy, which assumes that users trust the data collector, provides strong privacy guarantees…

Cryptography and Security · Computer Science 2019-10-29 Joshua Allen , Bolin Ding , Janardhan Kulkarni , Harsha Nori , Olga Ohrimenko , Sergey Yekhanin

The emergence and evolution of Local Differential Privacy (LDP) and its various adaptations play a pivotal role in tackling privacy issues related to the vast amounts of data generated by intelligent devices, which are crucial for…

Cryptography and Security · Computer Science 2024-01-26 Likun Qin , Tianshuo Qiu

The collection and availability of big data, combined with advances in pre-trained models (e.g. BERT), have revolutionized the predictive performance of natural language processing tasks. This allows corporations to provide machine learning…

Cryptography and Security · Computer Science 2022-11-01 Xuanli He , Chen Chen , Lingjuan Lyu , Qiongkai Xu

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

In-context learning (ICL) in Large Language Models (LLMs) has shown remarkable performance across various tasks without requiring fine-tuning. However, recent studies have highlighted the risk of private data leakage through the prompt in…

Artificial Intelligence · Computer Science 2025-09-16 Seongho Joo , Hyukhun Koh , Kyomin Jung

The rise of large language models (LLMs), such as ChatGPT, Gemini, and Grok, has reshaped the AI landscape. As prominent instances of foundational models (FMs), they exhibit remarkable capabilities in generating human-like content, pushing…

Artificial Intelligence · Computer Science 2026-05-19 Yu Qiao , Huy Q. Le , Avi Deb Raha , Phuong-Nam Tran , Apurba Adhikary , Mengchun Zhang , Loc X. Nguyen , Eui-Nam Huh , Dusit Niyato , Choong Seon Hong

Global financial crime activity is driving demand for machine learning solutions in fraud prevention. However, prevention systems are commonly serviced to financial institutions in isolation, and few provisions exist for data sharing due to…

Cryptography and Security · Computer Science 2024-01-08 Iker Perez , Jason Wong , Piotr Skalski , Stuart Burrell , Richard Mortier , Derek McAuley , David Sutton

The wide deployment of the generative pre-trained transformer (GPT) has raised privacy concerns for both clients and servers. While cryptographic primitives can be employed for secure GPT inference to protect the privacy of both parties,…

Cryptography and Security · Computer Science 2025-05-22 Zhengyi Li , Yue Guan , Kang Yang , Yu Feng , Ning Liu , Yu Yu , Jingwen Leng , Minyi Guo

The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and…

Cryptography and Security · Computer Science 2024-02-28 Le Yang , Miao Tian , Duan Xin , Qishuo Cheng , Jiajian Zheng

The rapid advancement of ML models in critical sectors such as healthcare, finance, and security has intensified the need for robust data security, model integrity, and reliable outputs. Large multimodal foundational models, while crucial…

Cryptography and Security · Computer Science 2024-12-13 Hongyang Zhang , Yue Zhao , Claudio Angione , Harry Yang , James Buban , Ahmad Farhan , Fielding Johnston , Patrick Colangelo

While open Large Language Models (LLMs) have made significant progress, they still fall short of matching the performance of their closed, proprietary counterparts, making the latter attractive even for the use on highly private data.…

Machine Learning · Computer Science 2024-11-18 Vincent Hanke , Tom Blanchard , Franziska Boenisch , Iyiola Emmanuel Olatunji , Michael Backes , Adam Dziedzic

A common privacy issue in traditional machine learning is that data needs to be disclosed for the training procedures. In situations with highly sensitive data such as healthcare records, accessing this information is challenging and often…

Cryptography and Security · Computer Science 2021-03-31 Pavlos Papadopoulos , Will Abramson , Adam J. Hall , Nikolaos Pitropakis , William J. Buchanan

Artificial Intelligence (AI) has attracted a great deal of attention in recent years. However, alongside all its advancements, problems have also emerged, such as privacy violations, security issues and model fairness. Differential privacy,…

Cryptography and Security · Computer Science 2020-09-01 Tianqing Zhu , Dayong Ye , Wei Wang , Wanlei Zhou , Philip S. Yu

The interactive use of large language models (LLMs) in AI assistants (at work, home, etc.) introduces a new set of inference-time privacy risks: LLMs are fed different types of information from multiple sources in their inputs and are…

Artificial Intelligence · Computer Science 2024-07-02 Niloofar Mireshghallah , Hyunwoo Kim , Xuhui Zhou , Yulia Tsvetkov , Maarten Sap , Reza Shokri , Yejin Choi

CPU-based trusted execution environments (TEEs) and differential privacy (DP) have gained wide applications for private inference. Due to high inference latency in TEEs, researchers use partition-based approaches that offload linear model…

Cryptography and Security · Computer Science 2025-09-12 Honglan Yu , Yibin Wang , Feifei Dai , Dong Liu , Haihui Fan , Xiaoyan Gu

Recent advances in Large Language Models (LLMs) have led to the widespread adoption of third-party inference services, raising critical privacy concerns. Existing methods of performing private third-party inference, such as Secure…

Cryptography and Security · Computer Science 2025-05-27 Rahul Thomas , Louai Zahran , Erica Choi , Akilesh Potti , Micah Goldblum , Arka Pal

Recent development in the field of explainable artificial intelligence (XAI) has helped improve trust in Machine-Learning-as-a-Service (MLaaS) systems, in which an explanation is provided together with the model prediction in response to…

Machine Learning · Computer Science 2022-12-15 Truc Nguyen , Phung Lai , NhatHai Phan , My T. Thai

The pervasiveness of proprietary language models has raised critical privacy concerns, necessitating advancements in private inference (PI), where computations are performed directly on encrypted data without revealing users' sensitive…

Machine Learning · Computer Science 2025-01-10 Nandan Kumar Jha , Brandon Reagen

The Internet of Medical Things transcends traditional medical boundaries, enabling a transition from reactive treatment to proactive prevention. This innovative method revolutionizes healthcare by facilitating early disease detection and…

Cryptography and Security · Computer Science 2025-09-04 Ayoub Si-ahmed , Mohammed Ali Al-Garadi , Narhimene Boustia
‹ Prev 1 3 4 5 6 7 10 Next ›