English
Related papers

Related papers: MLLess: Achieving Cost Efficiency in Serverless Ma…

200 papers

Large language models (LLMs) have surged in popularity and are extensively used in commercial applications, where the efficiency of model serving is crucial for the user experience. Most current research focuses on optimizing individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-12 Yuhang Yao , Han Jin , Alay Dilipbhai Shah , Shanshan Han , Zijian Hu , Yide Ran , Dimitris Stripelis , Zhaozhuo Xu , Salman Avestimehr , Chaoyang He

Function-as-a-Service (FaaS) allows to directly submit function code to a cloud provider without the burden of managing infrastructure resources. Each cloud provider establishes execution time limits to their FaaS offerings, which impose…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-15 Rodrigo Landa Andraca , Mahdi Zareei

Fair machine learning is a thriving and vibrant research topic. In this paper, we propose Fairness as a Service (FaaS), a secure, verifiable and privacy-preserving protocol to computes and verify the fairness of any machine learning (ML)…

Cryptography and Security · Computer Science 2023-09-13 Ehsan Toreini , Maryam Mehrnezhad , Aad van Moorsel

Real-time machine learning has recently attracted significant interest due to its potential to support instantaneous learning, adaptation, and decision making in a wide range of application domains, including self-driving vehicles,…

Machine Learning · Computer Science 2023-01-27 Yong Xiao , Xiaohan Zhang , Guangming Shi , Marwan Krunz , Diep N. Nguyen , Dinh Thai Hoang

Serverless computing (also known as functions as a service) is a new cloud computing abstraction that makes it easier to write robust, large-scale web services. In serverless computing, programmers write what are called serverless…

Programming Languages · Computer Science 2021-03-12 Abhinav Jangda , Donald Pinckney , Yuriy Brun , Arjun Guha

Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw data distributed across edge devices. However, edge devices often struggle with high computational and communication costs imposed…

Machine Learning · Computer Science 2025-12-02 Ye Lin Tun , Chu Myaet Thwal , Huy Q. Le , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

We present a framework for dynamic management of structured parallel processing skeletons on serverless platforms. Our goal is to bring HPC-like performance and resilience to serverless and continuum environments while preserving the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Lanpei Li , Massimo Coppola , Malio Li , Valerio Besozzi , Jack Bell , Vincenzo Lomonaco

Function-as-a-Service (FaaS) is a growing cloud computing paradigm that is expected to reduce the user cost of service over traditional serverful approaches. However, the environmental impact of FaaS has not received much attention. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Sirui Qi , Hayden Moore , Ninad Hogade , Dejan Milojicic , Cullen Bash , Sudeep Pasricha

We are witnessing an increasing trend towardsusing Machine Learning (ML) based prediction systems, span-ning across different application domains, including productrecommendation systems, personal assistant devices, facialrecognition, etc.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-24 Jashwant Raj Gunasekaran , Prashanth Thinakaran , Cyan Subhra Mishra , Mahmut Taylan Kandemir , Chita R. Das

The usability and practicality of any machine learning (ML) applications are largely influenced by two critical but hard-to-attain factors: low latency and low cost. Unfortunately, achieving low latency and low cost is very challenging when…

Machine Learning · Computer Science 2019-10-22 Kevin Hsieh

Large Language Models (LLMs) have revolutionized numerous domains, driving the rise of Language-Model-as-a-Service (LMaaS) platforms that process millions of queries daily. These platforms must minimize latency and meet Service Level…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-21 Zhihan Jiang , Yujie Huang , Guangba Yu , Junjie Huang , Jiazhen Gu , Michael R. Lyu

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

AI deployment increasingly resembles a pipeline of data transformation, fine-tuning, and agent interactions rather than a monolithic LLM job; recent examples include RLHF/RLAIF training and agentic workflows. To cope with this shift, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-03 Junyi Shen , Noppanat Wadlom , Lingfeng Zhou , Dequan Wang , Xu Miao , Lei Fang , Yao Lu

Function-as-a-Service (FaaS) platforms and "serverless" cloud computing are becoming increasingly popular. Current FaaS offerings are targeted at stateless functions that do minimal I/O and communication. We argue that the benefits of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Vikram Sreekanti , Chenggang Wu , Xiayue Charles Lin , Johann Schleier-Smith , Jose M. Faleiro , Joseph E. Gonzalez , Joseph M. Hellerstein , Alexey Tumanov

The serverless computing model has evolved as one of the key solutions in the cloud for fast autoscaling and capacity planning. In edge computing environments, however, the serverless model is challenged by the system heterogeneity and…

Networking and Internet Architecture · Computer Science 2022-09-08 Francisco Carpio , Marc Michalke , Admela Jukan

Along with the wide-adoption of Serverless Computing, more and more applications are developed and deployed on cloud platforms. Major cloud providers present their serverless workflow services to orchestrate serverless functions, making it…

Software Engineering · Computer Science 2021-01-14 Jinfeng Wen , Yi Liu

Virtualization of network functions (as virtual routers, virtual firewalls, etc.) enables network owners to efficiently respond to the increasing dynamicity of network services. Virtual Network Functions (VNFs) are easy to deploy, update,…

Networking and Internet Architecture · Computer Science 2019-03-15 Sabidur Rahman , Tanjila Ahmed , Minh Huynh , Massimo Tornatore , Biswanath Mukherjee

The exponential growth of Internet of Things (IoT) has given rise to a new wave of edge computing due to the need to process data on the edge, closer to where it is being produced and attempting to move away from a cloud-centric…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-15 Hamza Javed , Adel N. Toosi , Mohammad S. Aslanpour

Federated Learning (FL) is a decentralized machine learning paradigm where models are trained on distributed devices and are aggregated at a central server. Existing FL frameworks assume simple two-tier network topologies where end devices…

Serverless computing is an approach to cloud computing that allows programmers to run serverless functions in response to external events. Serverless functions are priced at sub-second granularity, support transparent elasticity, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Emily Herbert , Arjun Guha