English
Related papers

Related papers: A Typed Tensor Language for Federated Learning

200 papers

The reliance of language model training on massive amounts of computation and vast datasets scraped from potentially low-quality, copyrighted, or sensitive data has come into question practically, legally, and ethically. Federated learning…

Machine Learning · Computer Science 2024-05-28 Alex Iacob , Lorenzo Sani , Bill Marino , Preslav Aleksandrov , William F. Shen , Nicholas Donald Lane

Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices, each with its own local training data set. In this paper, we present a compressive sensing approach for…

Signal Processing · Electrical Eng. & Systems 2020-08-06 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Jun Li , H. Vincent Poor

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

Federated learning is a paradigm of distributed machine learning in which multiple clients coordinate with a central server to learn a model, without sharing their own training data. Standard federated optimization methods such as Federated…

Machine Learning · Computer Science 2024-05-15 Sohom Mukherjee , Nicolas Loizou , Sebastian U. Stich

Federated learning data is drawn from a distribution of distributions: clients are drawn from a meta-distribution, and their data are drawn from local data distributions. Thus generalization studies in federated learning should separate…

Machine Learning · Computer Science 2022-03-17 Honglin Yuan , Warren Morningstar , Lin Ning , Karan Singhal

Federated Learning (FL) enables collaborative training of distributed clients while protecting privacy. To enhance generalization capability in FL, prototype-based FL is in the spotlight, since shared global prototypes offer semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huan Wang , Jun Shen , Haoran Li , Zhenyu Yang , Jun Yan , Ousman Manjang , Yanlong Zhai , Di Wu , Guansong Pang

Federated learning is generally used in tasks where labels are readily available (e.g., next word prediction). Relaxing this constraint requires design of unsupervised learning techniques that can support desirable properties for federated…

Machine Learning · Computer Science 2022-06-14 Ekdeep Singh Lubana , Chi Ian Tang , Fahim Kawsar , Robert P. Dick , Akhil Mathur

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Federated learning is widely used to perform decentralized training of a global model on multiple devices while preserving the data privacy of each device. However, it suffers from heterogeneous local data on each training device which…

Machine Learning · Computer Science 2023-01-18 Sirui Hu , Ling Feng , Xiaohan Yang , Yongchao Chen

Federated learning (FL) is an emerging machine learning paradigm that allows to accomplish model training without aggregating data at a central server. Most studies on FL consider a centralized framework, in which a single server is endowed…

Machine Learning · Computer Science 2023-03-22 Bin Wang , Jun Fang , Hongbin Li , Xiaojun Yuan , Qing Ling

Federated learning, an emerging machine learning paradigm, enables clients to collaboratively train a model without exchanging local data. Clients participating in the training process significantly impact the convergence rate, learning…

Machine Learning · Computer Science 2024-08-30 Fares Fourati , Salma Kharrat , Vaneet Aggarwal , Mohamed-Slim Alouini , Marco Canini

We introduce the concept of concatenated tensor networks to efficiently describe quantum states. We show that the corresponding concatenated tensor network states can efficiently describe time evolution and possess arbitrary block-wise…

Quantum Physics · Physics 2010-06-17 R. Hübener , V. Nebendahl , W. Dür

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

Federated Learning is widely employed to tackle distributed sensitive data. Existing methods primarily focus on addressing in-federation data heterogeneity. However, we observed that they suffer from significant performance degradation when…

Machine Learning · Computer Science 2024-07-09 Mengmeng Ma , Tang Li , Xi Peng

Federated learning involves training statistical models over remote devices such as mobile phones while keeping data localized. Training in heterogeneous and potentially massive networks introduces opportunities for privacy-preserving data…

Machine Learning · Computer Science 2022-01-21 Afra Mashhadi , Alex Kyllo , Reza M. Parizi

We present an analysis tool based on joint matrix factorization for comparing latent representations of multilingual and monolingual models. An alternative to probing, this tool allows us to analyze multiple sets of representations in a…

Computation and Language · Computer Science 2023-10-25 Zheng Zhao , Yftah Ziser , Bonnie Webber , Shay B. Cohen

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

Machine Learning · Computer Science 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

The communication bottleneck in federated learning (FL) has spurred extensive research into techniques to reduce the volume of data exchanged between client devices and the central parameter server. In this paper, we systematically classify…

Information Theory · Computer Science 2026-04-17 Adrian Edin , Michel Kieffer , Mikael Johansson , Zheng Chen

This paper proposes a federated learning technique for deep algorithm unfolding with applications to sparse signal recovery and compressed sensing. We refer to this architecture as Fed-CS. Specifically, we unfold and learn the iterative…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Komal Krishna Mogilipalepu , Sumanth Kumar Modukuri , Amarlingam Madapu , Sundeep Prabhakar Chepuri

Federated Learning (FL) is a machine learning paradigm in which many clients cooperatively train a single centralized model while keeping their data private and decentralized. FL is commonly used in edge computing, which involves placing…