English
Related papers

Related papers: INFaaS: A Model-less and Managed Inference Serving…

200 papers

Model parallelism is conventionally viewed as a method to scale a single large deep learning model beyond the memory limits of a single device. In this paper, we demonstrate that model parallelism can be additionally used for the…

We present Inferflow, an efficient and highly configurable inference engine for large language models (LLMs). With Inferflow, users can serve most of the common transformer models by simply modifying some lines in corresponding…

Computation and Language · Computer Science 2024-01-17 Shuming Shi , Enbo Zhao , Deng Cai , Leyang Cui , Xinting Huang , Huayang Li

Internet-scale web applications are becoming increasingly storage-intensive and rely heavily on in-memory object caching to attain required I/O performance. We argue that the emerging serverless computing paradigm provides a well-suited,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Ao Wang , Jingyuan Zhang , Xiaolong Ma , Ali Anwar , Lukas Rupprecht , Dimitrios Skourtis , Vasily Tarasov , Feng Yan , Yue Cheng

The rising demand for Large Language Model (LLM) inference services has intensified pressure on computational resources, resulting in latency and cost challenges. This paper introduces a novel routing algorithm based on the Non-dominated…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-15 Shibo Yu , Mohammad Goudarzi , Adel Nadjaran Toosi

Large Language Models (LLMs) have revolutionized numerous domains, driving the rise of Language-Model-as-a-Service (LMaaS) platforms that process millions of queries daily. These platforms must minimize latency and meet Service Level…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-21 Zhihan Jiang , Yujie Huang , Guangba Yu , Junjie Huang , Jiazhen Gu , Michael R. Lyu

Serverless computing is transforming cloud application development, but the performance-cost trade-offs of control plane designs remain poorly understood due to a lack of open, cross-platform benchmarks and detailed system analyses. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-04 Leonid Kondrashov , Boxi Zhou , Hancheng Wang , Dmitrii Ustiugov

By provisioning inference offloading services, edge inference drives the rapid growth of AI applications at network edge. However, how to reduce the inference latency remains a significant challenge. To address this issue, we develop a…

Networking and Internet Architecture · Computer Science 2025-10-14 Guanqiao Qu , Qian Chen , Xianhao Chen , Kaibin Huang , Yuguang Fang

Edge computing has become a popular paradigm where services and applications are deployed at the network edge closer to the data sources. It provides applications with outstanding benefits, including reduced response latency and enhanced…

Networking and Internet Architecture · Computer Science 2022-09-15 Mingjin Zhang , Jiannong Cao , Yuvraj Sahni , Qianyi Chen , Shan Jiang , Tao Wu

Meeting the requirements of future services with time sensitivity and handling sudden load spikes of the services in Fog computing environments are challenging tasks due to the lack of publicly available Fog nodes and their characteristics.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-05 Sudheer Kumar Battula , Saurabh Garg , James Montgomery , Ranesh Naha

Serverless computing has recently experienced significant adoption by several applications, especially Internet of Things (IoT) applications. In serverless computing, rather than deploying and managing dedicated virtual machines, users are…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-27 Tarek Elgamal , Atul Sandur , Klara Nahrstedt , Gul Agha

High penetration from volatile renewable energy resources in the grid and the varying nature of loads raise the need for frequent line switching to ensure the efficient operation of electrical distribution networks. Operators must ensure…

Systems and Control · Electrical Eng. & Systems 2024-11-19 Richard Asiamah , Yuqi Zhou , Ahmed S. Zamzam

Serverless computing, or Function-as-a-Service (FaaS), enables a new way of building and scaling applications by allowing users to deploy fine-grained functions while providing fully-managed resource provisioning and auto-scaling. Custom…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-16 Ao Wang , Shuai Chang , Huangshi Tian , Hongqi Wang , Haoran Yang , Huiba Li , Rui Du , Yue Cheng

Federated learning (FL) is a distributed learning paradigm that enables multiple clients to learn a powerful global model by aggregating local training. However, the performance of the global model is often hampered by non-i.i.d.…

Machine Learning · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Nian Liu , Xinxing Xu , Salman Khan , Wangmeng Zuo

The exponential growth of Internet of Things (IoT) has given rise to a new wave of edge computing due to the need to process data on the edge, closer to where it is being produced and attempting to move away from a cloud-centric…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-15 Hamza Javed , Adel N. Toosi , Mohammad S. Aslanpour

Diffusion model deployment has been suffering from high energy consumption and inference latency despite its superior performance in visual generation tasks. Dynamic voltage and frequency scaling (DVFS) offers a promising solution to…

Hardware Architecture · Computer Science 2026-04-13 Jinqi Wen , Tong Xie , Runsheng Wang , Meng Li

As data-intensive applications grow, batch processing in limited-resource environments faces scalability and resource management challenges. Serverless computing offers a flexible alternative, enabling dynamic resource allocation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Amine Barrak , Emna Ksontini

Data are often accommodated on centralized storage servers. This is the case, for instance, in remote sensing and astronomy, where projects produce several petabytes of data every year. While machine learning models are often trained on…

Machine Learning · Computer Science 2022-01-20 Stefan Oehmcke , Fabian Gieseke

The inference-time resource costs of large language and vision models present a growing challenge in production deployments. We propose the use of foundation model programs, i.e., programs that can invoke foundation models with varying…

Machine Learning · Computer Science 2025-08-12 Lunyiu Nie , Zhimin Ding , Kevin Yu , Marco Cheung , Chris Jermaine , Swarat Chaudhuri

While providing low latency is a fundamental requirement in deploying recommendation services, achieving high resource utility is also crucial in cost-effectively maintaining the datacenter. Co-locating multiple workers of a model is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-24 Yujeong Choi , John Kim , Minsoo Rhu

Inference-time scaling has emerged as a powerful way to improve large language model (LLM) performance by generating multiple candidate responses and selecting among them. However, existing work on dynamic allocation for test-time compute…

Machine Learning · Computer Science 2025-09-15 Jenny Y. Huang , Mehul Damani , Yousef El-Kurdi , Ramon Astudillo , Wei Sun