English
Related papers

Related papers: Fusion: Efficient and Secure Inference Resilient t…

200 papers

Privacy-preserving Transformer inference has gained attention due to the potential leakage of private information. Despite recent progress, existing frameworks still fall short of practical model scales, with gaps up to a hundredfold. A…

Cryptography and Security · Computer Science 2026-01-13 Bowen Shen , Yuyue Chen , Peng Yang , Bin Zhang , Xi Zhang , Zoe L. Jiang

Federated learning is a prominent framework that enables clients (e.g., mobile devices or organizations) to train a collaboratively global model under a central server's orchestration while keeping local training datasets' privacy. However,…

Machine Learning · Computer Science 2021-07-20 Farnaz Tahmasebian , Jian Lou , Li Xiong

We investigate an emerging setup in which a small, on-device language model (LM) with access to local data communicates with a frontier, cloud-hosted LM to solve real-world tasks involving financial, medical, and scientific reasoning over…

Machine Learning · Computer Science 2025-02-27 Avanika Narayan , Dan Biderman , Sabri Eyuboglu , Avner May , Scott Linderman , James Zou , Christopher Re

We propose a communication-efficient collaborative inference framework in the domain of edge inference, focusing on the efficient use of vision transformer (ViT) models. The partitioning strategy of conventional collaborative inference…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Jiwoong Im , Nayoung Kwon , Taewoo Park , Jiheon Woo , Jaeho Lee , Yongjune Kim

Modern mobile devices are equipped with high-performance hardware resources such as graphics processing units (GPUs), making the end-side intelligent services more feasible. Even recently, specialized silicons as neural engines are being…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Amir Erfan Eshratifar , Amirhossein Esmaili , Massoud Pedram

Secure aggregation is a cryptographic protocol that securely computes the aggregation of its inputs. It is pivotal in keeping model updates private in federated learning. Indeed, the use of secure aggregation prevents the server from…

Machine Learning · Computer Science 2022-09-07 Dario Pasquini , Danilo Francati , Giuseppe Ateniese

The Metaverse, a burgeoning collective virtual space merging augmented reality and persistent virtual worlds, necessitates advanced artificial intelligence (AI) and communication technologies to support immersive and interactive…

Machine Learning · Computer Science 2024-08-27 Yahao Ding , Wen Shang , Minrui Xu , Zhaohui Yang , Ye Hu , Dusit Niyato , Mohammad Shikh-Bahaei

We develop a resilient binary hypothesis testing framework for decision making in adversarial multi-robot crowdsensing tasks. This framework exploits stochastic trust observations between robots to arrive at tractable, resilient decision…

Robotics · Computer Science 2022-09-27 Matthew Cavorsi , Orhan Eren Akgün , Michal Yemini , Andrea Goldsmith , Stephanie Gil

Diffusion Transformers (DiTs) deliver state-of-the-art generative performance but their quadratic training cost with sequence length makes large-scale pretraining prohibitively expensive. Token dropping can reduce training cost, yet na\"ive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Dogyun Park , Moayed Haji-Ali , Yanyu Li , Willi Menapace , Sergey Tulyakov , Hyunwoo J. Kim , Aliaksandr Siarohin , Anil Kag

For collaborative inference through a cloud computing platform, it is sometimes essential for the client to shield its sensitive information from the cloud provider. In this paper, we introduce Ensembler, an extensible framework designed to…

Cryptography and Security · Computer Science 2024-12-24 Dancheng Liu , Chenhui Xu , Jiajie Li , Amir Nassereldine , Jinjun Xiong

A wide variety of deep neural applications increasingly rely on the cloud to perform their compute-heavy inference. This common practice requires sending private and privileged data over the network to remote servers, exposing it to the…

Cryptography and Security · Computer Science 2020-10-29 Fatemehsadat Mireshghallah , Mohammadkazem Taram , Prakash Ramrakhyani , Dean Tullsen , Hadi Esmaeilzadeh

With the increasing deployment of generative machine learning models in privacy-sensitive domains such as healthcare and personalized services, ensuring secure inference has become a critical challenge. Secure multi-party computation (MPC)…

Machine Learning · Computer Science 2025-08-05 Tianpei Lu , Bingsheng Zhang , Lekun Peng , Bowen Zheng , Lichun Li , Kui Ren

Semantic communication enhances transmission efficiency by conveying semantic information rather than raw input symbol sequences. Task-oriented semantic communication is a variant that tries to retains only task-specific information, thus…

Cryptography and Security · Computer Science 2025-10-06 Xuesong Wang , Mo Li , Xingyan Shi , Zhaoqian Liu , Shenghao Yang

The community explored to build private inference frameworks for transformer-based large language models (LLMs) in a server-client setting, where the server holds the model parameters and the client inputs its private data (or prompt) for…

Machine Learning · Computer Science 2023-12-18 Xuanqi Liu , Zhuotao Liu

Collaborative inference has received significant research interest in machine learning as a vehicle for distributing computation load, reducing latency, as well as addressing privacy preservation in communications. Recent collaborative…

Machine Learning · Computer Science 2022-06-17 Jani Boutellier , Bo Tan , Jari Nurmi

Federated Learning (FL), a distributed machine learning paradigm, has been adapted to mitigate privacy concerns for customers. Despite their appeal, there are various inference attacks that can exploit shared-plaintext model updates to…

Cryptography and Security · Computer Science 2022-07-20 Hua Ma , Qun Li , Yifeng Zheng , Zhi Zhang , Xiaoning Liu , Yansong Gao , Said F. Al-Sarawi , Derek Abbott

Federated learning is known to be vulnerable to both security and privacy issues. Existing research has focused either on preventing poisoning attacks from users or on concealing the local model updates from the server, but not both.…

Machine Learning · Computer Science 2024-06-05 Truc Nguyen , My T. Thai

Federated Learning enables collaborative training of a global model across multiple geographically dispersed clients without the need for data sharing. However, it is susceptible to inference attacks, particularly label inference attacks.…

Machine Learning · Computer Science 2025-05-01 Zhixuan Ma , Haichang Gao , Junxiang Huang , Ping Wang

Recent studies have revealed that federated learning (FL), once considered secure due to clients not sharing their private data with the server, is vulnerable to attacks such as client-side training data distribution inference, where a…

Cryptography and Security · Computer Science 2024-04-05 Yichang Xu , Ming Yin , Minghong Fang , Neil Zhenqiang Gong

While Secure Aggregation (SA) protects update confidentiality in Cross-silo Federated Learning, it fails to guarantee aggregation integrity, allowing malicious servers to silently omit or tamper with updates. Existing verifiable aggregation…

Cryptography and Security · Computer Science 2026-03-12 Xian Qin , Xue Yang , Xiaohu Tang