English
Related papers

Related papers: Communication-Efficient Collaborative LLM Inferenc…

200 papers

Low earth orbit (LEO) satellite networks have the potential to provide low-latency communication with global coverage. To unleash this potential, it is crucial to achieve efficient packet delivery. In this paper, we propose a…

Networking and Internet Architecture · Computer Science 2024-11-19 Hefan Zhang , Zhiyuan Wang , Shan Zhang , Qingkai Meng , Hongbin Luo

This paper proposes a novel split learning architecture designed to exploit the cyclical movement of Low Earth Orbit (LEO) satellites in non-terrestrial networks (NTNs). Although existing research focuses on offloading tasks to the NTN…

Networking and Internet Architecture · Computer Science 2025-11-05 Marc Martinez-Gost , Ana Pérez-Neira

Speculative decoding is an emerging technique that accelerates large language model (LLM) inference by allowing a smaller draft model to predict multiple tokens in advance, which are then verified or corrected by a larger target model. In…

Signal Processing · Electrical Eng. & Systems 2025-11-10 Ce Zheng , Tingting Yang

The rapid advancement of Low-Altitude Economy Networks (LAENets) has enabled a variety of applications, including aerial surveillance, environmental sensing, and semantic data collection. To support these scenarios, unmanned aerial vehicles…

Machine Learning · Computer Science 2025-10-14 Yang Li , Ruichen Zhang , Yinqiu Liu , Guangyuan Liu , Dusit Niyato , Abbas Jamalipour , Xianbin Wang , Dong In Kim

In the realm of Large Language Model (LLM) inference, the inherent structure of transformer models coupled with the multi-GPU tensor parallelism strategy leads to a sequential execution of computation and communication. This results in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Bin Xiao , Lei Su

The low-altitude economy (LAE) is a new economic paradigm that leverages low-altitude vehicles (LAVs) to perform diverse missions across diverse areas. To support the operations of LAE, it is essential to establish LAE networks that enable…

Networking and Internet Architecture · Computer Science 2025-07-08 Shizhao He , Jiacheng Wang , Ying-Chang Liang , Geng Sun , Dusit Niyato

The deployment of large language models' (LLMs) inference at the edge can facilitate prompt service responsiveness while protecting user privacy. However, it is critically challenged by the resource constraints of a single edge node.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Peirong Zheng , Wenchao Xu , Haozhao Wang , Jinyu Chen , Xuemin Shen

Orthogonal frequency division multiplexing (OFDM) based low Earth orbit (LEO) satellite communication system suffers from severe Doppler shifts, while {the Doppler-resilient affine frequency-division multiplexing (AFDM) transmission suffers…

Signal Processing · Electrical Eng. & Systems 2026-01-15 Shuntian Tang , Xiaomei Wu , Xinyi Wang , Le Zhao , Guang Yang , Zilong Liu , Fan Liu , Zesong Fei

Utilizing Low Earth Orbit (LEO) satellite networks equipped with Inter-Satellite Links (ISL) is envisioned to provide lower delay compared to traditional optical networks. However, LEO satellites have constrained energy resources as they…

Information Theory · Computer Science 2023-07-11 Kosta Dakic , Chiu Chun Chan , Bassel Al Homssi , Kandeepan Sithamparanathan , Akram Al-Hourani

The advancements of remote sensing (RS) pose increasingly high demands on computation and transmission resources. Conventional ground-offloading techniques, which transmit large amounts of raw data to the ground, suffer from poor…

Networking and Internet Architecture · Computer Science 2022-11-17 Jiaqi Cao , Shengli Zhang , Qingxia Chen , Houtian Wang , Mingzhe Wang , Naijin Liu

Caching is crucial in hybrid satellite-terrestrial networks to reduce latency, optimize throughput, and improve data availability by storing frequently accessed content closer to users, especially in bandwidth-limited satellite systems,…

Signal Processing · Electrical Eng. & Systems 2025-10-07 Zhou Zhang , Yizhu Wang , Saman Atapattu , Sumei Sun

Fine-tuning is the process of adapting the pre-trained large language models (LLMs) for downstream tasks. Due to substantial parameters, fine-tuning LLMs on mobile devices demands considerable memory resources, and suffers from high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-17 Songge Zhang , Guoliang Cheng , Xinyu Huang , Zuguang Li , Wen Wu , Lingyang Song , Xuemin Shen

Large vision-language models (LVLMs) have recently demonstrated great potential in remote sensing (RS) tasks (e.g., disaster monitoring) conducted by low Earth orbit (LEO) satellites. However, their deployment in real-world LEO satellite…

Networking and Internet Architecture · Computer Science 2025-10-29 Zihan Li , Jiahao Yang , Yuxin Zhang , Zhe Chen , Yue Gao

This paper investigates joint device identification, channel estimation, and symbol detection for cooperative multi-satellite-enhanced random access, where orthogonal time-frequency space modulation with the large antenna array is utilized…

Information Theory · Computer Science 2024-08-06 Boxiao Shen , Yongpeng Wu , Shiqi Gong , Heng Liu , Björn Ottersten , Wenjun Zhang

Device-edge co-inference, which partitions a deep neural network between a resource-constrained mobile device and an edge server, recently emerges as a promising paradigm to support intelligent mobile applications. To accelerate the…

Machine Learning · Computer Science 2021-09-01 Xinjie Zhang , Jiawei Shao , Yuyi Mao , Jun Zhang

Interference from terrestrial networks can reduce the communication rate for low Earth orbit (LEO) satellites in the upper mid-band. To coexist in frequency, MIMO precoding can be used to reduce the signal that impinges on the LEO…

Signal Processing · Electrical Eng. & Systems 2025-06-05 Nima Razavi , Murat Bayraktar , Nuria Gonzalez Prelcic , Robert W. Heath

Recently advanced low-Earth-orbit (LEO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, the traditional…

Systems and Control · Electrical Eng. & Systems 2022-12-08 Peng Hu

Federated learning (FL) for large language models (LLMs) offers a privacy-preserving scheme, enabling clients to collaboratively fine-tune locally deployed LLMs or smaller language models (SLMs) without exchanging raw data. While…

Machine Learning · Computer Science 2025-10-02 Xinlu Zhang , Na Yan , Yang Su , Yansha Deng , Toktam Mahmoodi

This paper presents a study of an integrated satellite-terrestrial network, where Low-Earth-Orbit (LEO) satellites are used to provide the backhaul link between base stations (BSs) and the core network. The mobility of LEO satellites raises…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Hung Nguyen-Kha , Vu Nguyen Ha , Eva Lagunas , Symeon Chatzinotas , Joel Grotz

Low earth orbit (LEO) satellite-assisted communications have been considered as one of key elements in beyond 5G systems to provide wide coverage and cost-efficient data services. Such dynamic space-terrestrial topologies impose exponential…

Signal Processing · Electrical Eng. & Systems 2021-10-14 Yaxiong Yuan , Lei lei , Thang X. Vu , Zheng Chang , Symeon Chatzinotas , Sumei Sun