English
Related papers

Related papers: Layered Randomized Quantization for Communication-…

200 papers

In this paper, we introduce a novel decentralized surrogate gradient-based algorithm for quantile regression in a feature-distributed setting, where global features are dispersed across multiple machines within a decentralized network. The…

Computation · Statistics 2025-04-24 Peiwen Xiao , Xiaohui Liu , Guangming Pan , Wei Long

In federated learning (FL), balancing privacy protection, learning quality, and efficiency remains a challenge. Privacy protection mechanisms, such as Differential Privacy (DP), degrade learning quality, or, as in the case of Homomorphic…

Machine Learning · Computer Science 2026-03-06 Yenan Wang , Carla Fabiana Chiasserini , Elad Michael Schiller

Federated learning (FL) enables geographically dispersed edge devices (i.e., clients) to learn a global model without sharing the local datasets, where each client performs gradient descent with its local data and uploads the gradients to a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-19 Heting Liu , Fang He , Guohong Cao

Graph Neural Networks have achieved tremendous success in modeling complex graph data in a variety of applications. However, there are limited studies investigating privacy protection in GNNs. In this work, we propose a learning framework…

Machine Learning · Computer Science 2024-08-07 Karuna Bhaila , Wen Huang , Yongkai Wu , Xintao Wu

Federated Learning (FL) enables participant devices to collaboratively train deep learning models without sharing their data with the server or other devices, effectively addressing data privacy and computational concerns. However, FL faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Asadullah Tariq , Tariq Qayyum , Mohamed Adel Serhani , Farag Sallabi , Ikbal Taleb , Ezedin S. Barka

Recently, federated learning (FL) has sparked widespread attention as a promising decentralized machine learning approach which provides privacy and low delay. However, communication bottleneck still constitutes an issue, that needs to be…

Signal Processing · Electrical Eng. & Systems 2022-03-14 Pavlos S. Bouzinis , Panagiotis D. Diamantoulakis , George K. Karagiannidis

Modern deep learning techniques focus on extracting intricate information from data to achieve accurate predictions. However, the training datasets may be crowdsourced and include sensitive information, such as personal contact details,…

Machine Learning · Statistics 2026-02-10 Zhongjie Shi , Puyu Wang , Chenyang Zhang , Yuan Cao

This paper provides an integrated perspective on addressing key challenges in developing reliable and secure Quantum Neural Networks (QNNs) in the Noisy Intermediate-Scale Quantum (NISQ) era. In this paper, we present an integrated…

Quantum Physics · Physics 2025-08-22 Nouhaila Innan , Muhammad Kashif , Alberto Marchisio , Mohamed Bennai , Muhammad Shafique

Quantization is a common approach to mitigate the communication cost of federated learning (FL). In practice, the quantized local parameters are further encoded via an entropy coding technique, such as Huffman coding, for efficient data…

Machine Learning · Computer Science 2024-09-11 Shayan Mohajer Hamidi , Ali Bereyhi

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for hidden semantic discovery of text data and serves as a fundamental tool for text analysis in various applications. However, the LDA model as well as the training…

Machine Learning · Computer Science 2020-10-12 Fangyuan Zhao , Xuebin Ren , Shusen Yang , Qing Han , Peng Zhao , Xinyu Yang

We study $L_2$ mean estimation under central differential privacy and communication constraints, and address two key challenges: firstly, existing mean estimation schemes that simultaneously handle both constraints are usually optimized for…

Cryptography and Security · Computer Science 2024-05-07 Wei-Ning Chen , Berivan Isik , Peter Kairouz , Albert No , Sewoong Oh , Zheng Xu

We consider the critical problem of distributed learning over data while keeping it private from the computational servers. The state-of-the-art approaches to this problem rely on quantizing the data into a finite field, so that the…

Machine Learning · Computer Science 2020-07-20 Mahdi Soleymani , Hessam Mahdavifar , A. Salman Avestimehr

Federated learning (FL) is an emerging paradigm for training machine learning models using possibly private data available at edge devices. The distributed operation of FL gives rise to challenges that are not encountered in centralized…

Machine Learning · Computer Science 2023-03-22 Natalie Lang , Elad Sofer , Tomer Shaked , Nir Shlezinger

Network quantization is an effective solution to compress deep neural networks for practical usage. Existing network quantization methods cannot sufficiently exploit the depth information to generate low-bit compressed network. In this…

Machine Learning · Computer Science 2018-12-18 Yuhui Xu , Yongzhuang Wang , Aojun Zhou , Weiyao Lin , Hongkai Xiong

Federated learning (FL) is a decentralized approach, enabling multiple participants to collaboratively train a model while ensuring the protection of data privacy. The transmission of updates from numerous edge clusters to the server…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Haowei Li , Weiying Xie , Hangyu Ye , Jitao Ma , Shuran Ma , Yunsong Li

Federated Learning (FL) plays a prominent role in solving machine learning problems with data distributed across clients. In FL, to reduce the communication overhead of data between clients and the server, each client communicates the local…

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

The disparity in healthcare personnel expertise and medical resources across different regions of the world is a pressing social issue. Artificial intelligence technology offers new opportunities to alleviate this issue. Segment Anything…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zhikai Li , Jing Zhang , Qingyi Gu

Data privacy has become an increasingly important issue in Machine Learning (ML), where many approaches have been developed to tackle this challenge, e.g. cryptography (Homomorphic Encryption (HE), Differential Privacy (DP), etc.) and…

Machine Learning · Computer Science 2022-09-13 Hanchi Ren , Jingjing Deng , Xianghua Xie

We present a privacy-preserving distributed learning framework for telecom ecosystems in the 6G-era that enables the vision of shared ownership and governance of ML models, while protecting the privacy of the data owners. We demonstrate its…

Networking and Internet Architecture · Computer Science 2020-08-18 Pooyan Safari , Behnam Shariati , Johannes Karl Fischer