English
Related papers

Related papers: Resource Management for GPT-based Model Deployed o…

200 papers

In support of open and reproducible research, there has been a rapidly increasing number of datasets made available for research. As the availability of datasets increases, it becomes more important to have quality metadata for discovering…

Computation and Language · Computer Science 2023-10-18 Shiwei Zhang , Mingfang Wu , Xiuzhen Zhang

Large language models (LLMs) have become increasingly embedded in organizational workflows. This has raised concerns over their energy consumption, financial costs, and data sovereignty. While performance benchmarks often celebrate…

Computation and Language · Computer Science 2026-05-19 Jennifer Haase , Finn Klessascheck , Jan Mendling , Sebastian Pokutta

Since the release of GPT2-1.5B in 2019, the large language models (LLMs) have evolved from specialized deep models to versatile foundation models. While demonstrating remarkable zero-shot ability, the LLMs still require fine-tuning on local…

Artificial Intelligence · Computer Science 2025-08-07 Yanjie Dong , Haijun Zhang , Chengming Li , Song Guo , Victor C. M. Leung , Xiping Hu

Cloud computing has been widely adopted due to the flexibility in resource provisioning and on-demand pricing models. Entire clusters of Virtual Machines (VMs) can be dynamically provisioned to meet the computational demands of users.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-27 Long Thai , Blesson Varghese , Adam Barker

Conventionally, the resource allocation is formulated as an optimization problem and solved online with instantaneous scenario information. Since most resource allocation problems are not convex, the optimal solutions are very difficult to…

Machine Learning · Computer Science 2017-12-20 Jun-Bo Wang , Junyuan Wang , Yongpeng Wu , Jin-Yuan Wang , Huiling Zhu , Min Lin , Jiangzhou Wang

Generative AI is transforming enterprise application development by enabling machines to create content, code, and designs. These models, however, demand substantial computational power and data management. Cloud computing addresses these…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Dhavalkumar Patel , Ganesh Raut , Satya Narayan Cheetirala , Girish N Nadkarni , Robert Freeman , Benjamin S. Glicksberg , Eyal Klang , Prem Timsina

The rapid advancement of Large Language Models (LLMs) has opened new possibilities in Multi-Robot Systems (MRS), enabling enhanced communication, task allocation and planning, and human-robot interaction. Unlike traditional single-robot and…

Robotics · Computer Science 2026-05-05 Peihan Li , Zijian An , Shams Abrar , Lifeng Zhou

Large language models (LLMs) have recently become a popular topic in the field of Artificial Intelligence (AI) research, with companies such as Google, Amazon, Facebook, Amazon, Tesla, and Apple (GAFA) investing heavily in their…

Artificial Intelligence · Computer Science 2023-05-11 Frank Joublin , Antonello Ceravola , Joerg Deigmoeller , Michael Gienger , Mathias Franzius , Julian Eggert

Robots are increasingly common in industry and daily life, such as in nursing homes where they can assist staff. A key challenge is developing intuitive interfaces for easy communication. The use of Large Language Models (LLMs) like GPT-4…

Robotics · Computer Science 2024-08-01 Stanislau Stankevich , Wojciech Dudek

Virtualization technology reduces cloud operational cost by increasing cloud resource utilization level. The incorporation of virtualization within cloud data centers can severely degrade cloud performance if not properly managed. Virtual…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-18 Misbah Liaqat , Shalini Ninoriya , Junaid Shuja , Raja Wasim Ahmad , Abdullah Gani

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

With rapidly increasing distributed deep learning workloads in large-scale data centers, efficient distributed deep learning framework strategies for resource allocation and workload scheduling have become the key to high-performance deep…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Feng Liang , Zhen Zhang , Haifeng Lu , Chengming Li , Victor C. M. Leung , Yanyi Guo , Xiping Hu

As multiple crises threaten the sustainability of our societies and pose at risk the planetary boundaries, complex challenges require timely, updated, and usable information. Natural-language processing (NLP) tools enhance and expand data…

Computers and Society · Computer Science 2025-02-05 Francesca Larosa , Sergio Hoyas , H. Alberto Conejero , Javier Garcia-Martinez , Francesco Fuso Nerini , Ricardo Vinuesa

Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on…

Machine Learning · Computer Science 2020-02-26 Ahmed Imteaj , Urmish Thakker , Shiqiang Wang , Jian Li , M. Hadi Amini

As mobile devices increasingly become focal points for advanced applications, edge computing presents a viable solution to their inherent computational limitations, particularly in deploying large language models (LLMs). However, despite…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Chang Liu , Jun Zhao

The rapid development of Large Language Models (LLMs) and Generative Pre-Trained Transformers(GPTs) in the field of Generative Artificial Intelligence (AI) can significantly impact task automation in themodern economy. We anticipate that…

Performance · Computer Science 2024-06-17 Valentin Rychkov , Claudia Picoco , Emilie Caleca

It is significant to apply load-balancing strategy to improve the performance and reliability of resource in data centers. One of the challenging scheduling problems in Cloud data centers is to take the allocation and migration of…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-27 Minxian Xu , Guangchun Luo , Ling Tian , Aiguo Chen , Yaqiu Jiang , Guozhong Li , Wenhong Tian

The rapid development of the mobile Internet and the Internet of Things is leading to a diversification of user devices and the emergence of new mobile applications on a regular basis. Such applications include those that are…

Computational Engineering, Finance, and Science · Computer Science 2024-08-13 Xirui Tang , Zeyu Wang , Xiaowei Cai , Honghua Su , Changsong Wei

Generative Pre-trained Transformer (GPT) is a state-of-the-art machine learning model capable of generating human-like text through natural language processing (NLP). GPT is trained on massive amounts of text data and uses deep learning…

Cloud computing has revolutionized the way organizations manage their IT infrastructure, but it has also introduced new challenges, such as managing cloud costs. The rapid adoption of artificial intelligence (AI) and machine learning (ML)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Saurabh Deochake