English
Related papers

Related papers: UB-Mesh: a Hierarchically Localized nD-FullMesh Da…

200 papers

Embodied vision-based real-world systems, such as mobile robots, require a careful balance between energy consumption, compute latency, and safety constraints to optimize operation across dynamic tasks and contexts. As local computation…

In recent years, to sustain the resource-intensive computational needs for training deep neural networks (DNNs), it is widely accepted that exploiting the parallelism in large-scale computing clusters is critical for the efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-31 Menglu Yu , Chuan Wu , Bo Ji , Jia Liu

By taking full advantage of Computing, Communication and Caching (3C) resources at the network edge, Mobile Edge Computing (MEC) is envisioned as one of the key enablers for the next generation networks. However, current fixed-location MEC…

Signal Processing · Electrical Eng. & Systems 2020-10-15 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Wei Xu , Kun Yang

The evolution of 5G wireless technology has revolutionized connectivity, enabling a diverse range of applications. Among these are critical use cases such as real time teleoperation, which demands ultra reliable low latency communications…

Networking and Internet Architecture · Computer Science 2025-05-23 Narges Golmohammadi , Madan Mohan Rayguru , Sabur Baidya

In this paper, we study a new latency optimization problem for blockchain-based federated learning (BFL) in multi-server edge computing. In this system model, distributed mobile devices (MDs) communicate with a set of edge servers (ESs) to…

Machine Learning · Computer Science 2022-07-05 Dinh C. Nguyen , Seyyedali Hosseinalipour , David J. Love , Pubudu N. Pathirana , Christopher G. Brinton

Low-Latency and Low-Power Edge AI is essential for Virtual Reality and Augmented Reality applications. Recent advances show that hybrid models, combining convolution layers (CNN) and transformers (ViT), often achieve superior…

The evolution of Large Language Model (LLM) serving towards complex, distributed architectures--specifically the P/D-separated, large-scale DP+EP paradigm--introduces distinct scheduling challenges. Unlike traditional deployments where…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-19 Jian Tian , Shuailong Li , Yang Cao , Wenbo Cui , Minghan Zhu , Wenkang Wu , Jianming Zhang , Yanpeng Wang , Zhiwen Xiao , Zhenyu Hou , Dou Shen

Unified multimodal models (UMMs) that integrate understanding, reasoning, generation, and editing face inherent trade-offs between maintaining strong semantic comprehension and acquiring powerful generation capabilities. In this report, we…

This paper addresses the problem of universal synchronization primitives that can support scalable thread synchronization for large-scale many-core architectures. The universal synchronization primitives that have been deployed widely in…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-11-11 Phuong Hoai Ha , Philippas Tsigas , Otto J. Anshus

To alleviate hardware scarcity in training large deep neural networks (DNNs), particularly large language models (LLMs), we present FusionLLM, a decentralized training system designed and implemented for training DNNs using geo-distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Zhenheng Tang , Xueze Kang , Yiming Yin , Xinglin Pan , Yuxin Wang , Xin He , Qiang Wang , Rongfei Zeng , Kaiyong Zhao , Shaohuai Shi , Amelie Chi Zhou , Bo Li , Bingsheng He , Xiaowen Chu

Recent breakthroughs in Deep Neural Networks (DNNs) have fueled a tremendously growing demand for bringing DNN-powered intelligence into mobile platforms. While the potential of deploying DNNs on resource-constrained platforms has been…

Machine Learning · Computer Science 2020-06-09 Sicong Liu , Junzhao Du , Kaiming Nan , ZimuZhou , Atlas Wang , Yingyan Lin

A long-standing challenge is designing multi-scale structures with good connectivity between cells while optimizing each cell to reach close to the theoretical performance limit. We propose a new method for direct multi-scale topology…

Neural and Evolutionary Computing · Computer Science 2025-02-21 Hongrui Chen , Xingchen Liu , Levent Burak Kara

Large language models (LLMs) have been widely deployed for online generative services, where numerous LLM instances jointly handle workloads with fluctuating request arrival rates and variable request lengths. To efficiently execute…

Hardware Architecture · Computer Science 2026-03-06 Cong Li , Yihan Yin , Chenhao Xue , Zhao Wang , Fujun Bai , Yixin Guo , Xiping Jiang , Qiang Wu , Yuan Xie , Guangyu Sun

The two main thrusts of computational science are more accurate predictions and faster calculations; to this end, the zeitgeist in molecular dynamics (MD) simulations is pursuing machine learned and data driven interatomic models, e.g.…

Computational Physics · Physics 2020-02-24 Saaketh Desai , Samuel Temple Reeve , James F. Belak

Deep learning models often require specially designed architectures to process data of different dimensions, such as 1D time series, 2D images, and 3D volumetric data. Existing bidirectional models mainly focus on sequential data, making it…

Machine Learning · Computer Science 2024-11-26 Hao Liu

Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yupei Zhang , Li Pan , Qiushi Yang , Tan Li , Zhen Chen

The Mobile Network Operator (MNO) must select how to delegate Mobile Device (MD) queries to its Mobile Edge Computing (MEC) server in order to maximize the overall benefit of admitted requests with varying latency needs. Unmanned Aerial…

Networking and Internet Architecture · Computer Science 2022-12-20 Asrar Ahmed Baktayan , Ibrahim Ahmed Al-Baltah

LLM inference serving typically scales out with a two-tier architecture: a cluster router distributes requests to multiple inference engines, each of which then in turn performs its own internal scheduling. However, this commonly used…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-02 Yue Zhang , Yuansheng Chen , Xuan Mo , Alex Xi , Jialun Li , WeiGang Wu

This research introduces a transformative framework for integrating Vision-Enhanced Large Language Models (LLMs) with advanced transformer-based architectures to tackle challenges in high-resolution image synthesis and multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Karthikeya KV

In this work, we consider a novel type of Internet of Things (IoT) ultra-narrowband (UNB) network architecture that involves multiple multiplexing bands or channels for uplink transmission. An IoT device can randomly choose any of the…

Signal Processing · Electrical Eng. & Systems 2020-10-12 Enes Krijestorac , Ghaith Hattab , Petar Popovski , Danijela Cabric