中文
相关论文

相关论文: Communication-Efficient Federated Learning for Neu…

200 篇论文

Semantic communication has emerged as a pillar for the next generation of communication systems due to its capabilities in alleviating data redundancy. Most semantic communication systems are built upon advanced deep learning models whose…

机器学习 · 计算机科学 2025-02-07 Loc X. Nguyen , Huy Q. Le , Ye Lin Tun , Pyae Sone Aung , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

Multilingual NMT has become an attractive solution for MT deployment in production. But to match bilingual quality, it comes at the cost of larger and slower models. In this work, we consider several ways to make multilingual NMT faster at…

计算与语言 · 计算机科学 2021-11-09 Alexandre Berard , Dain Lee , Stéphane Clinchant , Kweonwoo Jung , Vassilina Nikoulina

Federated Learning (FL) is an emerging learning scheme that allows different distributed clients to train deep neural networks together without data sharing. Neural networks have become popular due to their unprecedented success. To the…

机器学习 · 计算机科学 2021-05-12 Baihe Huang , Xiaoxiao Li , Zhao Song , Xin Yang

Large language model (LLM) shows promising performances in a variety of downstream tasks, such as machine translation (MT). However, using LLMs for translation suffers from high computational costs and significant latency. Based on our…

计算与语言 · 计算机科学 2025-05-21 Zhanglin Wu , Daimeng Wei , Xiaoyu Chen , Hengchao Shang , Jiaxin Guo , Zongyao Li , Yuanchang Luo , Jinlong Yang , Zhiqiang Rao , Hao Yang

Robust machine learning (ML) models can be developed by leveraging large volumes of data and distributing the computational tasks across numerous devices or servers. Federated learning (FL) is a technique in the realm of ML that facilitates…

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

机器学习 · 计算机科学 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Federated Learning (FL) is a communication-efficient and privacy-preserving distributed machine learning framework that has gained a significant amount of research attention recently. Despite the different forms of FL algorithms (e.g.,…

分布式、并行与集群计算 · 计算机科学 2023-02-16 Jieming Bian , Cong Shen , Jie Xu

Federated learning (FL) enables distribution of machine learning workloads from the cloud to resource-limited edge devices. Unfortunately, current deep networks remain not only too compute-heavy for inference and training on edge devices,…

机器学习 · 计算机科学 2021-12-21 Sameer Bibikar , Haris Vikalo , Zhangyang Wang , Xiaohan Chen

Scaling up the convolutional neural network (CNN) size (e.g., width, depth, etc.) is known to effectively improve model accuracy. However, the large model size impedes training on resource-constrained edge devices. For instance, federated…

机器学习 · 计算机科学 2020-11-06 Chaoyang He , Murali Annavaram , Salman Avestimehr

Federated learning (FL) is a promising paradigm to enable collaborative model training with decentralized data. However, the training process of Large Language Models (LLMs) generally incurs the update of significant parameters, which…

机器学习 · 计算机科学 2024-02-13 Tianshi Che , Ji Liu , Yang Zhou , Jiaxiang Ren , Jiwen Zhou , Victor S. Sheng , Huaiyu Dai , Dejing Dou

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

机器学习 · 计算机科学 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

计算与语言 · 计算机科学 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

In classical federated learning, the clients contribute to the overall training by communicating local updates for the underlying model on their private data to a coordinating server. However, updating and communicating the entire model…

机器学习 · 计算机科学 2022-02-18 Jianyu Wang , Hang Qi , Ankit Singh Rawat , Sashank Reddi , Sagar Waghmare , Felix X. Yu , Gauri Joshi

Federated learning is a decentralized approach for training models on distributed devices, by summarizing local changes and sending aggregate parameters from local models to the cloud rather than the data itself. In this research we employ…

机器学习 · 计算机科学 2020-08-19 Joel Stremmel , Arjun Singh

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

机器学习 · 计算机科学 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

Large Language Models (LLMs) herald a transformative era in artificial intelligence (AI). However, the expansive scale of data and parameters of LLMs requires high-demand computational and memory resources, restricting their accessibility…

机器学习 · 计算机科学 2024-11-26 Shengwen Ding , Chenhui Hu

Neural machine translation is known to require large numbers of parallel training sentences, which generally prevent it from excelling on low-resource language pairs. This thesis explores the use of cross-lingual transfer learning on neural…

计算与语言 · 计算机科学 2020-01-07 Tom Kocmi

Over the past few years, significant advancements have been made in the field of machine learning (ML) to address resource management, interference management, autonomy, and decision-making in wireless networks. Traditional ML approaches…

机器学习 · 计算机科学 2023-11-07 Xiaonan Liu , Yansha Deng , Arumugam Nallanathan , Mehdi Bennis

Motivated by the increasing computational capacity of wireless user equipments (UEs), e.g., smart phones, tablets, or vehicles, as well as the increasing concerns about sharing private data, a new machine learning model has emerged, namely…

信息论 · 计算机科学 2019-10-10 Howard H. Yang , Zuozhu Liu , Tony Q. S. Quek , H. Vincent Poor