English
Related papers

Related papers: A Scalable Framework for Wireless Distributed Comp…

200 papers

Motivated by mobile edge computing and wireless data centers, we study a wireless distributed computing framework where the distributed nodes exchange information over a wireless interference network. Our framework follows the structure of…

Information Theory · Computer Science 2018-10-19 Fan Li , Jinyuan Chen , Zhiying Wang

In wireless distributed computing, networked nodes perform intermediate computations over data placed in their memory and exchange these intermediate values to calculate function values. In this paper we consider an asymmetric setting where…

Information Theory · Computer Science 2017-08-10 Linqi Song , Sundara Rajan Srinivasavaradhan , Christina Fragouli

Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data…

Information Theory · Computer Science 2018-01-08 Mohamed A. Attia , Ravi Tandon

We consider a wireless distributed computing system based on the MapReduce framework, which consists of three phases: \textit{Map}, \textit{Shuffle}, and \textit{Reduce}. The system consists of a set of distributed nodes assigned to compute…

Information Theory · Computer Science 2024-06-25 Elizabath Peter , K. K. Krishnan Namboodiri , B. Sundar Rajan

Intelligent mobile platforms such as smart vehicles and drones have recently become the focus of attention for onboard deployment of machine learning mechanisms to enable low latency decisions with low risk of privacy breach. However, most…

Information Theory · Computer Science 2019-05-22 Kai Yang , Yuanming Shi , Zhi Ding

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon

Distributed computing platforms typically assume the availability of reliable and dedicated connections among the processors. This work considers an alternative scenario, relevant for wireless data centers and federated learning, in which…

Information Theory · Computer Science 2019-01-17 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

The last decades have seen a surge of interests in distributed computing thanks to advances in clustered computing and big data technology. Existing distributed algorithms typically assume {\it all the data are already in one place}, and…

Machine Learning · Computer Science 2019-05-07 Donghui Yan , Yingjie Wang , Jin Wang , Guodong Wu , Honggang Wang

Consider a distributed computing system in which the worker nodes are connected over a shared wireless channel. Nodes can store a fraction of the data set over which computation needs to be carried out, and a Map-Shuffle-Reduce protocol is…

Information Theory · Computer Science 2018-10-29 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

Vertical distributed learning exploits the local features collected by multiple learning workers to form a better global model. However, the exchange of data between the workers and the model aggregator for parameter training incurs a heavy…

Networking and Internet Architecture · Computer Science 2022-09-07 Idan Achituve , Wenbo Wang , Ethan Fetaya , Amir Leshem

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi

Data shuffling of training data among different computing nodes (workers) has been identified as a core element to improve the statistical performance of modern large-scale machine learning algorithms. Data shuffling is often considered as…

Information Theory · Computer Science 2020-01-15 Kai Wan , Daniela Tuninetti , Mingyue Ji , Giuseppe Caire , Pablo Piantanida

Large-scale distributed computing systems face two major bottlenecks that limit their scalability: straggler delay caused by the variability of computation times at different worker nodes and communication bottlenecks caused by shuffling…

Information Theory · Computer Science 2017-07-04 Amirhossein Reisizadeh , Ramtin Pedarsani

We consider the problem of data exchange by a group of closely-located wireless nodes. In this problem each node holds a set of packets and needs to obtain all the packets held by other nodes. Each of the nodes can broadcast the packets in…

Information Theory · Computer Science 2016-11-15 Salim El Rouayheb , Alex Sprintson , Parastoo Sadeghi

A promising research area that has recently emerged, is on how to use index coding to improve the communication efficiency in distributed computing systems, especially for data shuffling in iterative computations. In this paper, we posit…

Information Theory · Computer Science 2018-05-04 Linqi Song , Christina Fragouli , Tianchu Zhao

This paper studies the shuffling phase in a distributed computing model with rate-limited links between nodes. Each node is connected to all other nodes via a noiseless broadcast link with a finite capacity. For this network, the shuffling…

Information Theory · Computer Science 2024-05-07 Shanuja Sasi , Onur Günlü

The wireless sensor network is a collection of energy-constrained nodes. Their objective is to sense, collect and process information for some ad-hoc purpose. Typically the nodes are deployed in geographically inaccessible regions. Thus the…

Networking and Internet Architecture · Computer Science 2012-04-16 Subhabrata Mukherjee , Amrita Saha , Mrinal K. Naskar , Amitava Mukherjee

Small cell enchantment is emerging as the key technique for wireless network evolution. One challenging problem for small cell enhancement is how to achieve high data rate with as-low-as-possible control and computation overheads. As a…

Networking and Internet Architecture · Computer Science 2014-02-12 Shuqin Li , Liyu Cai

Clustering has become an increasingly important task in analysing huge amounts of data. Traditional applications require that all data has to be located at the site where it is scrutinized. Nowadays, large amounts of heterogeneous, complex…

Databases · Computer Science 2014-09-24 Eshref Januzaj , Hans-Peter Kriegel , Martin Pfeifle

Collaboration between small-scale wireless devices hinges on their ability to infer properties shared across multiple nearby nodes. Wireless-enabled mobile devices in particular create a highly dynamic environment not conducive to…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-20 Oliver Kennedy , Christoph Koch , Al Demers
‹ Prev 1 2 3 10 Next ›