English
Related papers

Related papers: Minions: Cost-efficient Collaboration Between On-d…

200 papers

The conventional cloud-based large model learning framework is increasingly constrained by latency, cost, personalization, and privacy concerns. In this survey, we explore an emerging paradigm: collaborative learning between on-device small…

Machine Learning · Computer Science 2025-04-23 Chaoyue Niu , Yucheng Ding , Junhui Lu , Zhengxiang Huang , Hang Zeng , Yutong Dai , Xuezhen Tu , Chengfei Lv , Fan Wu , Guihai Chen

Large Language Models (LLMs) for complex reasoning is often hindered by high computational costs and latency, while resource-efficient Small Language Models (SLMs) typically lack the necessary reasoning capacity. Existing collaborative…

Computation and Language · Computer Science 2026-01-09 Chengsong Huang , Tong Zheng , Langlin Huang , Jinyuan Li , Haolin Liu , Jiaxin Huang

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

Prompting Large Language Models (LLMs) performs impressively in zero- and few-shot settings. Hence, small and medium-sized enterprises (SMEs) that cannot afford the cost of creating large task-specific training datasets, but also the cost…

Computation and Language · Computer Science 2023-10-23 Ilias Stogiannidis , Stavros Vassos , Prodromos Malakasiotis , Ion Androutsopoulos

Large Language Models (LLMs) enable various applications on edge devices such as smartphones, wearables, and embodied robots. However, their deployment often depends on expensive cloud-based APIs, creating high operational costs, which…

Robotics · Computer Science 2025-05-29 Yeshwanth Venkatesha , Souvik Kundu , Priyadarshini Panda

The rapid adoption of generative AI (GenAI), particularly Large Language Models (LLMs), has exposed critical limitations of cloud-centric deployments, including latency, cost, and privacy concerns. Meanwhile, Small Language Models (SLMs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Roberto Morabito , SiYoung Jang

This paper presents MinionsLLM, a novel framework that integrates Large Language Models (LLMs) with Behavior Trees (BTs) and Formal Grammars to enable natural language control of multi-agent systems within arbitrary, user-defined…

Computation and Language · Computer Science 2025-08-13 Andres Garcia Rincon , Eliseo Ferrante

The rapid rise of Large Language Models (LLMs) has revolutionized various artificial intelligence (AI) applications, from natural language processing to code generation. However, the computational demands of these models, particularly in…

Large Language Models (LLMs) exhibit impressive zero/few-shot inference and generation quality for high-resource languages (HRLs). A few of them have been trained on low-resource languages (LRLs) and give decent performance. Owing to the…

Computation and Language · Computer Science 2024-04-22 Arijit Nag , Animesh Mukherjee , Niloy Ganguly , Soumen Chakrabarti

Language models have gained significant interest due to their general-purpose capabilities, which appear to emerge as models are scaled to increasingly larger parameter sizes. However, these large models impose stringent requirements on…

Machine Learning · Computer Science 2024-12-23 Savitha Viswanadh Kandala , Pramuka Medaranga , Ambuj Varshney

Large Language Models (LLMs) are revolutionizing numerous industries, but their substantial computational demands create challenges for efficient deployment, particularly in cloud environments. Traditional approaches to inference serving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Minxian Xu , Junhan Liao , Jingfeng Wu , Yiyuan He , Kejiang Ye , Chengzhong Xu

The rapid rise of Language Models (LMs) has expanded the capabilities of natural language processing, powering applications from text generation to complex decision-making. While state-of-the-art LMs often boast hundreds of billions of…

Machine Learning · Computer Science 2025-11-24 Maximilian Abstreiter , Sasu Tarkoma , Roberto Morabito

Emerging intelligent service scenarios in 6G communication impose stringent requirements for low latency, high reliability, and privacy preservation. Generative large language models (LLMs) are gradually becoming key enablers for the…

Networking and Internet Architecture · Computer Science 2025-05-21 Pengyan Zhu , Tingting Yang

Large Language Models (LLMs) are becoming key components in various mobile operating systems, driving smart applications like interactive chatbots and personal assistants. While bringing enhanced intelligence to mobile ends, their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Genglin Wang , Liekang Zeng , Bufang Yang , Kaiwei Liu , Guoliang Xing , Chumin Sun , Li Zhou , Jie Sun , Zhenyu Yan

We propose a collaborative edge-to-server inference framework for vision-language models (VLMs) that reduces the communication cost while maintaining inference accuracy. In typical deployments, visual data captured at edge devices (clients)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Soochang Song , Yongjune Kim

Large Language Models (LLMs) have revolutionized inference across diverse natural language tasks, with larger models performing better but at higher computational costs. We propose a confidence-driven strategy that dynamically selects the…

Computation and Language · Computer Science 2026-02-26 Bo-Wei Chen , Chung-Chi Chen , An-Zi Yen

Small language models (SLMs), despite their widespread adoption in modern smart devices, have received significantly less academic attention compared to their large language model (LLM) counterparts, which are predominantly deployed in data…

Computation and Language · Computer Science 2025-02-27 Zhenyan Lu , Xiang Li , Dongqi Cai , Rongjie Yi , Fangming Liu , Xiwen Zhang , Nicholas D. Lane , Mengwei Xu

Large language models (LLMs) demonstrate superior reasoning capabilities compared to small language models (SLMs), but incur substantially higher costs. We propose COllaborative REAsoner (COREA), a system that cascades an SLM with an LLM to…

Computation and Language · Computer Science 2026-03-05 Chuang Zhang , Zizhen Zhu , Yihao Wei , Bing Tian , Junyi Liu , Henan Wang , Xavier Wang , Yaxiao Liu

As Internet of Things (IoT) technology advances, end devices like sensors and smartphones are progressively equipped with AI models tailored to their local memory and computational constraints. Local inference reduces communication costs…

Machine Learning · Computer Science 2024-08-22 Caelin Kaplan , Angelo Rodio , Tareq Si Salem , Chuan Xu , Giovanni Neglia

Large language models (LLMs) are becoming increasingly widespread. Organizations that want to use AI for productivity now face an important decision. They can subscribe to commercial LLM services or deploy models on their own…

Artificial Intelligence · Computer Science 2025-11-12 Guanzhong Pan , Vishal Chodnekar , Abinas Roy , Haibo Wang