English
Related papers

Related papers: Combining Federated and Active Learning for Commun…

200 papers

Federated learning is a promising distributed machine learning paradigm that can effectively exploit large-scale data without exposing users' privacy. However, it may incur significant communication overhead, thereby potentially impairing…

Machine Learning · Computer Science 2024-08-07 Shiwei Li , Wenchao Xu , Haozhao Wang , Xing Tang , Yining Qi , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

In recent advancements in machine learning, federated learning allows a network of distributed clients to collaboratively develop a global model without needing to share their local data. This technique aims to safeguard privacy, countering…

Machine Learning · Computer Science 2024-07-18 Davide Domini , Gianluca Aguzzi , Nicolas Farabegoli , Mirko Viroli , Lukas Esterle

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious…

Machine Learning · Computer Science 2020-10-27 Jinke Ren , Guanding Yu , Guangyao Ding

In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the increasing computation power of GPUs, the bottleneck of…

Machine Learning · Computer Science 2021-09-14 Xiangyi Chen , Xiaoyun Li , Ping Li

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Multi-task learning aims to learn multiple tasks jointly by exploiting their relatedness to improve the generalization performance for each task. Traditionally, to perform multi-task learning, one needs to centralize data from all the tasks…

Machine Learning · Computer Science 2017-06-21 Sulin Liu , Sinno Jialin Pan , Qirong Ho

Federated learning poses new statistical and systems challenges in training machine learning models over distributed networks of devices. In this work, we show that multi-task learning is naturally suited to handle the statistical…

Machine Learning · Computer Science 2018-02-28 Virginia Smith , Chao-Kai Chiang , Maziar Sanjabi , Ameet Talwalkar

In the traditional distributed machine learning scenario, the user's private data is transmitted between clients and a central server, which results in significant potential privacy risks. In order to balance the issues of data privacy and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zihao Zhao , Yuzhu Mao , Yang Liu , Linqi Song , Ye Ouyang , Xinlei Chen , Wenbo Ding

We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept…

Machine Learning · Computer Science 2018-11-14 Michael Kamp , Linara Adilova , Joachim Sicking , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

The provision of communication services via portable and mobile devices, such as aerial base stations, is a crucial concept to be realized in 5G/6G networks. Conventionally, IoT/edge devices need to transmit the data directly to the base…

Machine Learning · Computer Science 2022-01-21 Sunder Ali Khowaja , Kapal Dev , Parus Khuwaja , Paolo Bellavista

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows…

Machine Learning · Computer Science 2021-07-26 Osama Shahid , Seyedamin Pouriyeh , Reza M. Parizi , Quan Z. Sheng , Gautam Srivastava , Liang Zhao

With more regulations tackling users' privacy-sensitive data protection in recent years, access to such data has become increasingly restricted and controversial. To exploit the wealth of data generated and located at distributed entities…

Machine Learning · Computer Science 2020-11-10 Nader Bouacida , Jiahui Hou , Hui Zang , Xin Liu

Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient…

Information Theory · Computer Science 2022-07-12 Chunmei Xu , Shengheng Liu , Zhaohui Yang , Yongming Huang , Kai-Kit Wong

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

Federated learning (FL), as an emerging distributed machine learning paradigm, allows a mass of edge devices to collaboratively train a global model while preserving privacy. In this tutorial, we focus on FL via over-the-air computation…

Machine Learning · Computer Science 2023-10-17 Jingyang Zhu , Yuanming Shi , Yong Zhou , Chunxiao Jiang , Wei Chen , Khaled B. Letaief

Cellular traffic prediction is of great importance on the path of enabling 5G mobile networks to perform intelligent and efficient infrastructure planning and management. However, available data are limited to base station logging…

Machine Learning · Computer Science 2023-08-29 Vasileios Perifanis , Nikolaos Pavlidis , Remous-Aris Koutsiamanis , Pavlos S. Efraimidis

Federated learning is a novel decentralized learning architecture. During the training process, the client and server must continuously upload and receive model parameters, which consumes a lot of network transmission resources. Some…

Machine Learning · Computer Science 2025-04-14 Yan-Ann Chen , Guan-Lin Chen

Federated Learning (FL) is a machine learning approach that enables the creation of shared models for powerful applications while allowing data to remain on devices. This approach provides benefits such as improved data privacy, security,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Jieming Bian , Cong Shen , Jie Xu

The dramatic success of deep learning is largely due to the availability of data. Data samples are often acquired on edge devices, such as smart phones, vehicles and sensors, and in some cases cannot be shared due to privacy considerations.…

Signal Processing · Electrical Eng. & Systems 2022-05-18 Tomer Gafni , Nir Shlezinger , Kobi Cohen , Yonina C. Eldar , H. Vincent Poor