English
Related papers

Related papers: Communication-Efficient Collaborative LLM Inferenc…

200 papers

Multimodal large language models (MLLMs) enable powerful cross-modal reasoning capabilities but impose substantial computational and latency burdens, posing critical challenges for deployment on resource-constrained edge devices. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-06 Zheming Yang , Qi Guo , Jun Wan , Jiarui Ruan , Yunqing Hu , Chang Zhao , Xiangyang Li

This paper studies Federated Learning (FL) in low Earth orbit (LEO) satellite constellations, where satellites are connected via intra-orbit inter-satellite links (ISLs) to their neighboring satellites. During the FL training process,…

Signal Processing · Electrical Eng. & Systems 2025-01-22 Nasrin Razmi , Sourav Mukherjee , Bho Matthiesen , Armin Dekorsy , Petar Popovski

Low Earth orbit (LEO) satellite mega constellations are beginning to include laser inter-satellite links (LISLs) to extend the Internet to the most remote locations on Earth. Since the process of establishing these links incurs a setup…

Networking and Internet Architecture · Computer Science 2024-06-05 Dhiraj Bhattacharjee , Pablo G. Madoery , Aizaz U. Chaudhry , Halim Yanikomeroglu , Gunes Karabulut Kurt , Peng Hu , Khaled Ahmed , Stephane Martel

Recent advancements in space technology have equipped low Earth Orbit (LEO) satellites with the capability to perform complex functions and run AI applications. Federated Learning (FL) on LEO satellites enables collaborative training of a…

Signal Processing · Electrical Eng. & Systems 2023-12-07 Lingling Wu , Jingjing Zhang

Low-Earth-Orbit (LEO) satellite constellations have become vital in emerging commercial and defense Non-Terrestrial Networks (NTNs). However, their predictable orbital dynamics and exposed geometries make them highly susceptible to…

Signal Processing · Electrical Eng. & Systems 2026-02-09 Shizhen Jia , Mingjun Ying , Marco Mezzavilla , Theodore S. Rappaport , Sundeep Rangan

The ever-increasing demand for ubiquitous, continuous, and high-quality services poses a great challenge to the traditional terrestrial network. To mitigate this problem, the mobile-edge-computing-enhanced low earth orbit (LEO) satellite…

Networking and Internet Architecture · Computer Science 2023-11-15 Yantong Wang , Chuanfen Feng , Jiande Sun

Reaching all regions of Earth, low Earth orbit (LEO) satellites can harvest delay-tolerant data from remotely located users on Earth without ground infrastructure. This work aims to assess a data harvest network architecture where users…

Information Theory · Computer Science 2024-08-12 Chang-Sik Choi

This paper investigates energy-efficient inter-satellite communication in Low Earth Orbit (LEO) networks, where satellites exchange both buffered and newly generated data through half-duplex inter-satellite links (ISLs). Due to orbital…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Yomali Lokugama , Charith Dissanayake , Saman Atapattu , Kandeepan Sithamparanathan

Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are usually complicatedly designed in model structure with…

Hardware Architecture · Computer Science 2024-06-25 Hui Wu , Yi Gan , Feng Yuan , Jing Ma , Wei Zhu , Yutao Xu , Hong Zhu , Yuhua Zhu , Xiaoli Liu , Jinghui Gu , Peng Zhao

We expand the scope of cache memory to include LEO constellations, which are highly distributed systems with thousands of satellites connected with free-space optics inter-satellite links (ISL) always only one hop from any point on earth.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-21 Thomas Sandholm , Sayandev Mukherjee , Lin Cheng , Bernardo A. Huberman

AI WiFi offload is emerging as a promising approach for providing large language model (LLM) services to resource-constrained wireless devices. However, unlike conventional edge computing, LLM inference over WiFi must jointly address…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-24 Mingqi Han , Xinghua Sun

Large-scale low-Earth-orbit (LEO) satellite systems are increasingly valued for their ability to enable rapid and wide-area data exchange, thereby facilitating the collaborative training of artificial intelligence (AI) models across…

Machine Learning · Computer Science 2025-09-17 Binquan Guo , Junteng Cao , Marie Siew , Binbin Chen , Tony Q. S. Quek , Zhu Han

A simple scheme for communication over MIMO broadcast channels is introduced which adopts the lattice reduction technique to improve the naive channel inversion method. Lattice basis reduction helps us to reduce the average transmitted…

Information Theory · Computer Science 2016-11-15 Mahmoud Taherzadeh , Amin Mobasher , Amir K. Khandani

Orthogonal Time Frequency Space (OTFS) modulation offers robust performance in high-mobility scenarios by transforming time-varying channels into the delay-Doppler (DD) domain. However, in high-mobility environment such as emerging 5G…

Information Theory · Computer Science 2026-01-29 Bo-Yuan Chen , Hsuan-Jung Su

Despite the impressive performance of LLMs, their widespread adoption faces challenges due to substantial computational and memory requirements during inference. Recent advancements in model compression and system-level optimization methods…

Machine Learning · Computer Science 2024-04-25 Arnav Chavan , Raghav Magazine , Shubham Kushwaha , Mérouane Debbah , Deepak Gupta

Large language model (LLM) agents on multi-step tasks suffer reasoning degradation, looping, drift, stuck states, at rates up to 30% on hard tasks. Current solutions include hard step limits (abrupt) or LLM-as-judge monitoring (10-15%…

Artificial Intelligence · Computer Science 2026-04-16 Rafflesia Khan , Nafiul Islam Khan

Low earth orbit (LEO) satellite has been considered as a potential supplement for the terrestrial Internet of Things (IoT). In this paper, we consider grant-free non-orthogonal random access (GF-NORA) in orthogonal frequency division…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Yong Zuo , Mingyang Yue , Mingchen Zhang , Sixian Li , Shaojie Ni , Xiaojun Yuan

This study analyses the medium access control (MAC) layer aspects of a low-Earth-orbit (LEO) satellite-based Internet of Things (IoT) network. A transmission scheme based on change detection is proposed to accommodate more users within the…

Signal Processing · Electrical Eng. & Systems 2024-06-21 Ayush Kumar Dwivedi , Houcine Chougrani , Sachin Chaudhari , Neeraj Varshney , Symeon Chatzinotas

Low Earth orbit (LEO) satellite Internet of Things (IoT) has been identified as one of the important components of the sixth-generation (6G) non-terrestrial networks (NTN) to provide ubiquitous connectivity. Due to the low orbit altitude…

Information Theory · Computer Science 2025-09-03 Ming Ying , Xiaoming Chen , Qiao Qi , Zhaoyang Zhang

The advances in satellite technology developments have recently seen a large number of small satellites being launched into space on Low Earth orbit (LEO) to collect massive data such as Earth observational imagery. The traditional way…

Machine Learning · Computer Science 2023-02-28 Mohamed Elmahallawy , Tie Luo