English
Related papers

Related papers: Large Language Model-Based Task Offloading and Res…

200 papers

The improvement of economic policymaking presents an opportunity for broad societal benefit, a notion that has inspired research towards AI-driven policymaking tools. AI policymaking holds the potential to surpass human performance through…

Artificial Intelligence · Computer Science 2024-10-14 Henry Gasztowtt , Benjamin Smith , Vincent Zhu , Qinxun Bai , Edwin Zhang

Large Language Models (LLMs) have advanced rapidly but face significant memory demands. While quantization has shown promise for LLMs, current methods typically require lengthy training to alleviate the performance degradation from…

Artificial Intelligence · Computer Science 2024-05-31 Ke Yi , Yuhui Xu , Heng Chang , Chen Tang , Yuan Meng , Tong Zhang , Jia Li

With the rapid adoption of Large Language Models (LLMs), LLM-adapters have become increasingly common, providing lightweight specialization of large-scale models. Serving hundreds or thousands of these adapters on a single GPU allows…

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

We investigate the feasibility of using Multimodal Large Language Models (MLLMs) for real-time online episodic memory question answering. While cloud offloading is common, it raises privacy and latency concerns for wearable assistants,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Giuseppe Lando , Rosario Forte , Antonino Furnari

In this work, we study the problem of energy-efficient computation offloading enabled by edge computing. In the considered scenario, multiple users simultaneously compete for limited radio and edge computing resources to get offloaded tasks…

Machine Learning · Computer Science 2021-04-01 Mohamed Sana , Mattia Merluzzi , Nicola di Pietro , Emilio Calvanese Strinati

There is a rapidly growing number of open-source Large Language Models (LLMs) and benchmark datasets to compare them. While some models dominate these benchmarks, no single model typically achieves the best accuracy in all tasks and use…

Computation and Language · Computer Science 2023-09-28 Tal Shnitzer , Anthony Ou , Mírian Silva , Kate Soule , Yuekai Sun , Justin Solomon , Neil Thompson , Mikhail Yurochkin

In the rapidly evolving landscape of digital twins (DT) and 6G networks, the integration of large language models (LLMs) presents a novel approach to network management. This paper explores the application of LLMs in managing 6G-empowered…

Networking and Internet Architecture · Computer Science 2024-12-31 Shufan Jiang , Bangyan Lin , Yue Wu , Yuan Gao

This paper investigates the capability of off-the-shelf large language models (LLMs) to solve the economic dispatch (ED) problem. ED is a hard-constrained optimization problem solved on a day-ahead timescale by grid operators to minimize…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Sina Mohammadi , Ali Hassan , Rouzbeh Haghighi , Van-Hai Bui , Wencong Su

Accurate load forecasting is crucial for maintaining the power balance between generators and consumers,particularly with the increasing integration of renewable energy sources, which introduce significant intermittent volatility. With the…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Mingyang Gao , Suyang Zhou , Wei Gu , Zhi Wu , Haiquan Liu , Aihua Zhou

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

We introduce Model-Distributed Inference for Large-Language Models (MDI-LLM), a novel framework designed to facilitate the deployment of state-of-the-art large-language models (LLMs) across low-power devices at the edge. This is…

Machine Learning · Computer Science 2025-05-27 Davide Macario , Hulya Seferoglu , Erdem Koyuncu

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface…

Computation and Language · Computer Science 2024-02-20 Tom Bocklisch , Thomas Werkmeister , Daksh Varshneya , Alan Nichol

Deep learning architectures with powerful reasoning capabilities have driven significant advancements in autonomous driving technology. Large language models (LLMs) applied in this field can describe driving scenes and behaviors with a…

Artificial Intelligence · Computer Science 2024-10-01 Yizhou Huang , Yihua Cheng , Kezhi Wang

To overcome devices' limitations in performing computation-intense applications, mobile edge computing (MEC) enables users to offload tasks to proximal MEC servers for faster task computation. However, current MEC system design is based on…

Networking and Internet Architecture · Computer Science 2020-05-19 Chen-Feng Liu , Mehdi Bennis , Merouane Debbah , H. Vincent Poor

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Advancements in extended reality (XR) are driving the development of the metaverse, which demands efficient real-time transformation of 2D scenes into 3D objects, a computation-intensive process that necessitates task offloading because of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-06 Ibrahim Aliyu , Seungmin Oh , Sangwon Oh , Jinsul Kim

Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in…

Computation and Language · Computer Science 2024-06-24 Yue Huang , Chenrui Fan , Yuan Li , Siyuan Wu , Tianyi Zhou , Xiangliang Zhang , Lichao Sun

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

Computation and Language · Computer Science 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su