English

Green or Fast? Learning to Balance Cold Starts and Idle Carbon in Serverless Computing

Distributed, Parallel, and Cluster Computing 2026-03-02 v1 Artificial Intelligence Performance

Abstract

Serverless computing simplifies cloud deployment but introduces new challenges in managing service latency and carbon emissions. Reducing cold-start latency requires retaining warm function instances, while minimizing carbon emissions favors reclaiming idle resources. This balance is further complicated by time-varying grid carbon intensity and varying workload patterns, under which static keep-alive policies are inefficient. We present LACE-RL, a latency-aware and carbon-efficient management framework that formulates serverless pod retention as a sequential decision problem. LACE-RL uses deep reinforcement learning to dynamically tune keep-alive durations, jointly modeling cold-start probability, function-specific latency costs, and real-time carbon intensity. Using the Huawei Public Cloud Trace, we show that LACE-RL reduces cold starts by 51.69% and idle keep-alive carbon emissions by 77.08% compared to Huawei's static policy, while achieving better latency-carbon trade-offs than state-of-the-art heuristic and single-objective baselines, approaching Oracle performance.

Keywords

Cite

@article{arxiv.2602.23935,
  title  = {Green or Fast? Learning to Balance Cold Starts and Idle Carbon in Serverless Computing},
  author = {Bowen Sun and Christos D. Antonopoulos and Evgenia Smirni and Bin Ren and Nikolaos Bellas and Spyros Lalis},
  journal= {arXiv preprint arXiv:2602.23935},
  year   = {2026}
}
R2 v1 2026-07-01T10:55:28.886Z