English
Related papers

Related papers: Coded Federated Computing in Wireless Networks wit…

200 papers

Quantum computing is presently undergoing rapid development to achieve a significant speedup promised in certain applications. Nonetheless, scaling quantum computers remains a formidable engineering challenge, prompting exploration of…

Building on the previous work of Lee et al. and Ferdinand et al. on coded computation, we propose a sequential approximation framework for solving optimization problems in a distributed manner. In a distributed computation system, latency…

Information Theory · Computer Science 2017-10-26 Jingge Zhu , Ye Pu , Vipul Gupta , Claire Tomlin , Kannan Ramchandran

Federated Learning (FL) is a novel distributed machine learning approach to leverage data from Internet of Things (IoT) devices while maintaining data privacy. However, the current FL algorithms face the challenges of non-independent and…

Machine Learning · Computer Science 2023-12-20 Gang Hu , Yinglei Teng , Nan Wang , F. Richard Yu

Distributed computing, in which a resource-intensive task is divided into subtasks and distributed among different machines, plays a key role in solving large-scale problems. Coded computing is a recently emerging paradigm where redundancy…

Information Theory · Computer Science 2023-03-15 Hoang Dau , Ryan Gabrys , Yu-Chih Huang , Chen Feng , Quang-Hung Luu , Eidah Alzahrani , Zahir Tari

Federated Learning (FL) algorithms commonly sample a random subset of clients to address the straggler issue and improve communication efficiency. While recent works have proposed various client sampling methods, they have limitations in…

Machine Learning · Computer Science 2024-05-15 Jiaxiang Geng , Yanzhao Hou , Xiaofeng Tao , Juncheng Wang , Bing Luo

Coded distributed computing introduced by Li et al. in 2015 is an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce. In particular, Li et al. show that…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

We consider a mobile edge computing scenario where users want to perform a linear inference operation $\boldsymbol{W} \boldsymbol{x}$ on local data $\boldsymbol{x}$ for some network-side matrix $\boldsymbol{W}$. The inference is performed…

Information Theory · Computer Science 2021-08-18 Anton Frigård , Siddhartha Kumar , Eirik Rosnes , Alexandre Graell i Amat

Coded Distributed Computing (CDC) introduced by Li et al. in 2015 offers an efficient approach to trade computing power to reduce the communication load in general distributed computing frameworks such as MapReduce and Spark. In particular,…

Information Theory · Computer Science 2020-07-23 Nicholas Woolsey , Rong-Rong Chen , Mingyue Ji

How can we optimally trade extra computing power to reduce the communication load in distributed computing? We answer this question by characterizing a fundamental tradeoff between computation and communication in distributed computing,…

Information Theory · Computer Science 2017-09-26 Songze Li , Mohammad Ali Maddah-Ali , Qian Yu , A. Salman Avestimehr

With the advantages of high-speed parallel processing, quantum computers can efficiently solve large-scale complex optimization problems in future networks. However, due to the uncertain qubit fidelity and quantum channel noise, distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-07 Napat Ngoenriang , Minrui Xu , Jiawen Kang , Dusit Niyato , Han Yu , Xuemin , Shen

In this chapter we will argue that studying such multi-scale multi-science systems gives rise to inherently hybrid models containing many different algorithms best serviced by different types of computing environments (ranging from…

Astrophysics · Physics 2007-05-23 A. G. Hoekstra , S. F. Portegies Zwart , M. Bubak , P. M. A. Sloot

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Placement delivery arrays for distributed computing (Comp-PDAs) have recently been proposed as a framework to construct universal computing schemes for MapReduce-like systems. In this work, we extend this concept to systems with straggling…

Information Theory · Computer Science 2020-04-28 Qifa Yan , Michèle Wigger , Sheng Yang , Xiaohu Tang

Distributed quantum information processing is a promising platform for scaling up quantum information processing, where small- and intermediate-scale quantum devices are connected by a network of quantum channels for communicating quantum…

Quantum Physics · Physics 2019-03-26 Hayata Yamasaki

Channel uncertainty and co-channel interference are two major challenges in the design of wireless systems such as future generation cellular networks. This paper studies receiver design for a wireless channel model with both time-varying…

Information Theory · Computer Science 2009-10-15 Yan Zhu , Dongning Guo , Michael L. Honig

One of the fundamental challenges in the design of distributed wireless networks is the large dynamic range of network state. Since continuous tracking of global network state at all nodes is practically impossible, nodes can only acquire…

Information Theory · Computer Science 2017-04-18 Alireza Vahid , Vaneet Aggarwal , A. Salman Avestimehr , Ashutosh Sabharwal

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) is a collaborative machine learning paradigm, which enables deep learning model training over a large volume of decentralized data residing in mobile devices without accessing clients' private data. Driven by the…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Lintao Li , Longwei Yang , Xin Guo , Yuanming Shi , Haiming Wang , Wei Chen , Khaled B. Letaief

Distributed computing platforms provide a robust mechanism to perform large-scale computations by splitting the task and data among multiple locations, possibly located thousands of miles apart geographically. Although such distribution of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-24 Alok Singh , Eric Stephan , Malachi Schram , Ilkay Altintas

Mass data traffics, low-latency wireless services and advanced artificial intelligence (AI) technologies have driven the emergence of a new paradigm for wireless networks, namely edge-intelligent networks, which are more efficient and…

Information Theory · Computer Science 2022-05-17 Qiao Qi , Xiaoming Chen