English
Related papers

Related papers: Trivance: Latency-Optimal AllReduce by Shortcuttin…

200 papers

This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ…

Optimization and Control · Mathematics 2020-03-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

In recent years, the issue of energy consumption in high performance computing (HPC) systems has attracted a great deal of attention. In response to this, many energy-aware algorithms have been developed in different layers of HPC systems,…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-05-13 Nikzad Babaii Rizvandi

Transmission Control Protocol (TCP) is the dominant reliable transport protocol utilized in the Internet. Improving the performance of TCP associated with the presence of multi-hop is one of the research challenges in wireless mesh…

Networking and Internet Architecture · Computer Science 2013-05-14 Sumedha Chokhandre , Urmila Shrawankar

A lot of effort has been invested into characterizing the convergence rates of gradient based algorithms for non-linear convex optimization. Recently, motivated by large datasets and problems in machine learning, the interest has shifted…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-23 Konstantinos I. Tsianos , Michael G. Rabbat

The rapid adoption of large language models and multimodal foundation models has made multimodal data preparation pipelines critical AI infrastructure. These pipelines interleave CPU-heavy preprocessing with accelerator-backed (GPU/NPU/TPU)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-03 Ding Pan , Zhuangzhuang Zhou , Long Qian , Binhang Yuan

Google's BBR (Bottleneck Bandwidth and Round-trip Propagation Time) approach is used to enhance internet network transmission. It is particularly intended to efficiently handle enormous amounts of data. Traditional TCP (Transmission Control…

Networking and Internet Architecture · Computer Science 2024-02-09 Vaishnavi Mhaske , Khushi Jain , Sai Karthik Thatikonda , Asif Kunwar

Online video understanding is essential for applications like public surveillance and AI glasses. However, applying Multimodal Large Language Models (MLLMs) to this domain is challenging due to the large number of video frames, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Xinqi Jin , Hanxun Yu , Bohan Yu , Kebin Liu , Jian Liu , Keda Tao , Yixuan Pei , Huan Wang , Fan Dang , Jiangchuan Liu , Weiqiang Wang

The paper present a novel approach for the solution of the Multi-Robot Communication-Aware Trajectory Planning, which builds on a general optimisation framework where the changes in robots positions are used as decision variable, and linear…

Robotics · Computer Science 2024-06-27 Jeppe Heini Mikkelsen , Roberto Galeazzi , Matteo Fumagalli

Recent studies have extensively explored NPU architectures for accelerating AI inference in on-device environments, which are inherently resource-constrained. Meanwhile, transformer-based large language models (LLMs) have become dominant,…

Hardware Architecture · Computer Science 2026-02-16 Jonghun Lee , Junghoon Lee , Hyeonjin Kim , Seoho Jeon , Jisup Yoon , Hyunbin Park , Meejeong Park , Heonjae Ha

Parallel trajectory optimization via the Alternating Direction Method of Multipliers (ADMM) has emerged as a scalable approach to long-horizon motion planning. However, existing frameworks typically decompose the problem into parallel…

Robotics · Computer Science 2026-04-27 Jiajun Yu , Guodong Liu , Li Wang , Pengxiang Zhou , Wentao Liu , Yin He , Chao Xu , Fei Gao , Yanjun Cao

Machine Learning jobs, carried out on large number of distributed high performance systems, involve periodic communication using operations like AllReduce, AllGather, and Broadcast. These operations may create high bandwidth and bursty…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Jit Gupta , Andrew Li , Tarun Banka , Ariel Cohen , T. Sridhar , Raj Yavatkar

Edge computing enables latency-critical applications to process data close to end devices, yet task heterogeneity and limited resources pose significant challenges to efficient orchestration. This paper presents a measurement-driven,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-01 Yongmin Zhang , Pengyu Huang , Mingyi Dong , Jing Yao

Designing energy-efficient all-to-all multicasting protocols is of of great importance for multi-hop wireless networks such as wireless sensor networks and wireless ad hoc networks. In an all-to-all multicast session, there exists a set of…

Networking and Internet Architecture · Computer Science 2012-02-13 Kai Han , Yang Liu , Jun Luo

Maximizing the minimum rate for a full-duplex multiple-input multiple-output (MIMO) wireless network encompassing two sources and a two-way (TW) relay operating in a two hop manner is investigated. To improve the overall performance, using…

Signal Processing · Electrical Eng. & Systems 2020-04-06 Erfan Khordad , Ata Khalili , Soroush Akhlaghi

The surge of artificial intelligence, particularly large language models, has driven the rapid development of large-scale machine learning clusters. Executing distributed models on these clusters is often constrained by communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 William Won , Midhilesh Elavazhagan , Sudarshan Srinivasan , Swati Gupta , Tushar Krishna

Task execution quality significantly impacts multi-robot missions, yet existing task allocation frameworks rarely consider quality of service as a decision variable, despite its importance in applications like robotic disinfection and…

Robotics · Computer Science 2025-10-09 Ishaan Mehta , Junseo Kim , Sharareh Taghipour , Sajad Saeedi

This paper develops an optimal data aggregation policy for learning-based traffic control systems based on imagery collected from Road Side Units (RSUs) under imperfect communications. Our focus is optimizing semantic information flow from…

Optimization and Control · Mathematics 2023-06-30 Ahmad Sarlak , Xiwen Chen , Rahul Amin , Abolfazl Razi

As chip-to-chip silicon photonics gain traction for their bandwidth and energy efficiency, their circuit-switched nature raises a fundamental question for collective communication: when and how should the interconnect be reconfigured to…

Networking and Internet Architecture · Computer Science 2026-02-11 Mahir Rahman , Samuel Joseph , Nihar Kodkani , Behnaz Arzani , Vamsi Addanki

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively…

Optimization and Control · Mathematics 2025-08-14 Wentao Zhang , Baoyong Zhang , Deming Yuan , Shengyuan Xu , Vincent K. N. Lau

Demands for data traffic in high-speed railway (HSR) has increased drastically. The increasing entertainment needs of passengers, safety control information exchanges of trains, etc., make train-to-train (T2T) communications face the…

Information Theory · Computer Science 2023-08-22 Yunhan Ma , Yong Niu , Shiwen Mao , Zhu Han , Ruisi He , Zhangdui Zhong , Ning Wang , Bo Ai