中文
相关论文

相关论文: Swing: Short-cutting Rings for Higher Bandwidth Al…

200 篇论文

The discrepancy between the upper bound on throughput in wireless networks and the throughput scaling in random networks which is also known as the connectivity-throughput trade-off is analyzed. In a random network with $\lambda$ nodes per…

信息论 · 计算机科学 2010-08-23 Ralph Tanbourgi , Holger Jäkel , Friedrich K. Jondral

Communication remains a central bottleneck in large-scale distributed machine learning, and gradient sparsification has emerged as a promising strategy to alleviate this challenge. However, existing gradient compressors face notable…

机器学习 · 计算机科学 2025-11-05 Chuyan Chen , Chenyang Ma , Zhangxin Li , Yutong He , Yanjie Dong , Kun Yuan

Network dynamics offers critical insights into the behavior and evolution of complex systems. Here, we focus on the topological dynamics of networks to explore a unique process for reducing the average distance: topological compression. The…

一般拓扑 · 数学 2025-08-07 Jian-Hui Li , Zu-Guo Yu , Yu-Chu Tian

We study the scalability of consensus-based distributed optimization algorithms by considering two questions: How many processors should we use for a given problem, and how often should they communicate when communication is not free?…

分布式、并行与集群计算 · 计算机科学 2012-09-06 Konstantinos I. Tsianos , Sean Lawlor , Michael G. Rabbat

Large-scale machine learning models are often trained by parallel stochastic gradient descent algorithms. However, the communication cost of gradient aggregation and model synchronization between the master and worker nodes becomes the…

机器学习 · 计算机科学 2020-07-03 Xiaorui Liu , Yao Li , Jiliang Tang , Ming Yan

Recently there has been a surge of research on improving the communication efficiency of distributed training. However, little work has been done to systematically understand whether the network is the bottleneck and to what extent. In this…

分布式、并行与集群计算 · 计算机科学 2020-06-26 Zhen Zhang , Chaokun Chang , Haibin Lin , Yida Wang , Raman Arora , Xin Jin

We consider three types of application layer coding for streaming over lossy links: random linear coding, systematic random linear coding, and structured coding. The file being streamed is divided into sub-blocks (generations). Code symbols…

信息论 · 计算机科学 2012-06-15 Yao Li , Péter Vingelmann , Morten Videbæk Pedersen , Emina Soljanin

Cloud data centers are evolving fast. At the same time, today's large-scale data analytics applications require non-trivial performance tuning that is often specific to the applications, workloads, and data center infrastructure. We propose…

分布式、并行与集群计算 · 计算机科学 2023-01-11 Qizhen Zhang , Jiacheng Wu , Ang Chen , Vincent Liu , Boon Thau Loo

One approach for reducing run time and improving efficiency of machine learning is to reduce the convergence rate of the optimization algorithm used. Shuffling is an algorithm technique that is widely used in machine learning, but it only…

机器学习 · 计算机科学 2023-06-29 Yuetong Xu , Baharan Mirzasoleiman

Parameter Server (PS) and Ring-AllReduce (RAR) are two widely utilized synchronization architectures in multi-worker Deep Learning (DL), also referred to as Distributed Deep Learning (DDL). However, PS encounters challenges with the…

网络与互联网体系结构 · 计算机科学 2024-07-30 Zixuan Chen , Xuandong Liu , Minglin Li , Yinfan Hu , Hao Mei , Huifeng Xing , Hao Wang , Wanxin Shi , Sen Liu , Yang Xu

All to all broadcast is a collective communication in a network with the constraint that every node must send to each other certain piece of its data. This paper addresses the problem of optimal all port all to all broadcast in…

网络与互联网体系结构 · 计算机科学 2009-09-09 Jean Pierre Jung , Ibrahima Sakho

Improvements in the performance of deep neural networks have often come through the design of larger and more complex networks. As a result, fast memory is a significant limiting factor in our ability to improve network performance. One…

机器学习 · 计算机科学 2019-12-25 Simon Alford , Ryan Robinett , Lauren Milechin , Jeremy Kepner

This paper investigates and compares the performance of wireless sensor networks where sensors operate on the principles of cooperative communications. We consider a scenario where the source transmits signals to the destination with the…

信息论 · 计算机科学 2013-07-02 Qasim Zeeshan Ahmed , Ki-Hong Park , Mohamed-Slim Alouini , Sonia Aissa

A novel transmissive reconfigurable intelligent surface (TRIS) transceiver-empowered simultaneous wireless information and power transfer (SWIPT) framework is proposed. The sum-rate of the information decoding (ID) users is maximized by…

信号处理 · 电气工程与系统科学 2025-11-18 Yuan Guo , Wen Chen , Xudong Bai , Chong He , Qiong Wu

We present Broadcast by Balanced Saturation (BBS), a general broadcast algorithm designed to optimize communication efficiency across diverse network topologies. BBS maximizes node utilization, addressing challenges in broadcast operations…

网络与互联网体系结构 · 计算机科学 2026-04-21 Hongbo Lu , Junsung Hwang , Bernard Tenreiro , Nabila Jaman Tripti , Darren Hamilton , Yuefan Deng

We consider a data aggregating wireless network where all nodes have data to send to a single destination node, the sink. We consider a linear placement of nodes with the sink at one end. The nodes communicate directly to the sink (single…

网络与互联网体系结构 · 计算机科学 2013-02-14 Easwar Vivek Mangipudi , Venkatesh Ramaiyan , Srikrishna Bhashyam

In this paper, we address the scenario where nodes with sensor data are connected in a tree network, and every node wants to compute a given symmetric Boolean function of the sensor data. We first consider the problem of computing a…

信息论 · 计算机科学 2010-05-03 Hemant Kowshik , P. R. Kumar

While new forms of attacks are developed every day to compromise essential infrastructures, service providers are also expected to develop strategies to mitigate the risk of extreme failures. In this context, tools of Network Science have…

物理与社会 · 物理学 2015-03-13 V. H. P. Louzada , F. Daolio , H. J. Herrmann , M. Tomassini

Edge computing operates between the cloud and end users and strives to provide low-latency computing services for simultaneous users. Redundant use of multiple edge nodes can reduce latency, as edge systems often operate in uncertain…

分布式、并行与集群计算 · 计算机科学 2024-11-26 Pei Peng , Emina Soljanin

We consider the problem of constructing a communication infrastructure from scratch, for a collection of identical wireless nodes. Combinatorially, this means a) finding a set of links that form a strongly connected spanning graph on a set…

网络与互联网体系结构 · 计算机科学 2012-10-17 Magnus M. Halldorsson , Pradipta Mitra