English
Related papers

Related papers: Efficient ML Models for Practical Secure Inference

200 papers

Machine Learning (ML) applications on healthcare can have a great impact on people's lives helping deliver better and timely treatment to those in need. At the same time, medical data is usually big and sparse requiring important…

Machine Learning · Computer Science 2018-12-27 Dianbo Liu , Nestor Sepulveda , Ming Zheng

The growing popularity of Machine Learning (ML) has led to its deployment in various sensitive domains, which has resulted in significant research focused on ML security and privacy. However, in some applications, such as Augmented/Virtual…

Cryptography and Security · Computer Science 2024-04-26 Abhinav Kumar , Miguel A. Guirao Aguilera , Reza Tourani , Satyajayant Misra

As intelligent sensing expands into high-privacy environments such as restrooms and changing rooms, the field faces a critical privacy-security paradox. Traditional RGB surveillance raises significant concerns regarding visual recording and…

Cryptography and Security · Computer Science 2026-02-02 Huan Song , Shuyu Tian , Junyi Hao , Cheng Yuan , Zhenyu Jia , Jiawei Shao , Xuelong Li

The privacy of data is a major challenge in machine learning as a trained model may expose sensitive information of the enclosed dataset. Besides, the limited computation capability and capacity of edge devices have made cloud-hosted…

Machine Learning · Computer Science 2020-05-15 Behnam Khaleghi , Mohsen Imani , Tajana Rosing

Single-molecule localization microscopy (SMLM) surpasses the diffraction limit, achieving subcellular resolution. Traditional SMLM analysis methods often rely on point spread function (PSF) model fitting, limiting the application of complex…

Quantitative Methods · Quantitative Biology 2024-10-04 Tingdan Luo

In this paper, we study the problem of secure ML inference against a malicious client and a semi-trusted server such that the client only learns the inference output while the server learns nothing. This problem is first formulated by…

Cryptography and Security · Computer Science 2022-10-28 Guowen Xu , Xingshuo Han , Tianwei Zhang , Shengmin Xu , Jianting Ning , Xinyi Huang , Hongwei Li , Robert H. Deng

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit

We propose a learning algorithm to design a light-weight neural multiplexer that given the input and computational resource requirements, calls the model that will consume the minimum compute resources for a successful inference. Mobile…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-18 Amir Erfan Eshratifar , Massoud Pedram

As Machine Learning (ML) gets applied to security-critical or sensitive domains, there is a growing need for integrity and privacy for outsourced ML computations. A pragmatic solution comes from Trusted Execution Environments (TEEs), which…

Machine Learning · Statistics 2019-02-28 Florian Tramèr , Dan Boneh

Intrusion Detection Systems (IDS) are crucial for identifying malicious traffic, yet traditional signature-based methods struggle with zero-day attacks and high false positive rates. AI-driven packet-capture analysis offers a promising…

Cryptography and Security · Computer Science 2025-03-28 Yongcheol Kim , Chanjae Lee , Young Yoon

The drastic increase in language models' parameters has led to a new trend of deploying models in cloud servers, raising growing concerns about private inference for Transformer-based models. Existing two-party privacy-preserving…

Computation and Language · Computer Science 2023-12-12 Zi Liang , Pinghui Wang , Ruofei Zhang , Nuo Xu , Lifeng Xing , Shuo Zhang

Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected,…

Machine Learning · Statistics 2026-04-09 Tijana Zrnic , Emmanuel J. Candès

The vast storage capacity and computational power of cloud servers have led to the widespread outsourcing of machine learning inference services. While offering significant operational benefits, this practice also introduces privacy risks,…

Cryptography and Security · Computer Science 2025-07-22 Shuai Yuan , Hongwei Li , Xinyuan Qian , Guowen Xu

Large Language Models (LLMs) have achieved remarkable performance and received significant research interest. The enormous computational demands, however, hinder the local deployment on devices with limited resources. The current prevalent…

Cryptography and Security · Computer Science 2026-02-13 Yujie Gu , Richeng Jin , Xiaoyu Ji , Yier Jin , Wenyuan Xu

Large Language Models (LLMs) face challenges for on-device inference due to high memory demands. Traditional methods to reduce memory usage often compromise performance and lack adaptability. We propose FlexInfer, an optimized offloading…

Operating Systems · Computer Science 2025-03-07 Hongchao Du , Shangyu Wu , Arina Kharlamova , Nan Guan , Chun Jason Xue

The use of Machine Learning (ML) models in cybersecurity solutions requires high-quality data that is stripped of redundant, missing, and noisy information. By selecting the most relevant features, data integrity and model efficiency can be…

Cryptography and Security · Computer Science 2024-06-13 Miguel Silva , João Vitorino , Eva Maia , Isabel Praça

Though action recognition in videos has achieved great success recently, it remains a challenging task due to the massive computational cost. Designing lightweight networks is a possible solution, but it may degrade the recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Wenhao Wu , Dongliang He , Xiao Tan , Shifeng Chen , Yi Yang , Shilei Wen

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

Dense prediction is a fundamental requirement for many medical vision tasks such as medical image restoration, registration, and segmentation. The most popular vision model, Convolutional Neural Networks (CNNs), has reached bottlenecks due…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Mingyuan Meng , Yuxin Xue , Dagan Feng , Lei Bi , Jinman Kim

We present CrypTFlow, a first of its kind system that converts TensorFlow inference code into Secure Multi-party Computation (MPC) protocols at the push of a button. To do this, we build three components. Our first component, Athos, is an…

Cryptography and Security · Computer Science 2020-03-20 Nishant Kumar , Mayank Rathee , Nishanth Chandran , Divya Gupta , Aseem Rastogi , Rahul Sharma