English
Related papers

Related papers: Multi-stage Flow Scheduling for LLM Serving

200 papers

Distributed prefix caching has become a core technique for efficient LLM serving. However, for long-context requests with high cache hit ratios, retrieving reusable KVCache blocks from remote servers has emerged as a new performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Weiye Wang , Chen Chen , Junxue Zhang , Zhusheng Wang , Hui Yuan , Zixuan Guan , Xiaolong Zheng , Qizhen Weng , Yin Chen , Minyi Guo

Current end-to-end spoken language models (SLMs) have made notable progress, yet they still encounter considerable response latency. This delay primarily arises from the autoregressive generation of speech tokens and the reliance on complex…

Computation and Language · Computer Science 2025-11-14 Yuhao Wang , Ziyang Cheng , Heyang Liu , Ronghua Wu , Qunshan Gu , Yanfeng Wang , Yu Wang

Industrial 5G deployments using Time Division Duplex (TDD) networks face a critical challenge: existing schedulers rely on static configuration of Uplink (UL) to Downlink (DL) resource ratios, failing to adapt to dynamic asymmetric traffic…

Networking and Internet Architecture · Computer Science 2026-04-17 Leonard Kleinberger , Michael Gundall , Hans D. Schotten

Modern user-facing latency-sensitive web services include numerous distributed, intercommunicating microservices that promise to simplify software development and operation. However, multiplexing of compute resources across microservices is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Haoran Qiu , Subho S. Banerjee , Saurabh Jha , Zbigniew T. Kalbarczyk , Ravishankar K. Iyer

As technology scales, low power design has become a significant requirement for SOC designers. Among the existing techniques, Multiple-Supply Voltage (MSV) is a popular and effective method to reduce both dynamic and static power. Besides,…

Hardware Architecture · Computer Science 2014-02-13 Bei Yu , Sheqin Dong , Statoshi Goto

Multivariate time-series (MTS) forecasting is fundamental to applications ranging from urban mobility and resource management to climate modeling. While recent generative models based on denoising diffusion have advanced state-of-the-art…

Machine Learning · Computer Science 2025-11-21 Seyed Mohamad Moghadas , Bruno Cornelis , Adrian Munteanu

Low Power Design has become a significant requirement when the CMOS technology entered the nanometer era. Multiple-Supply Voltage (MSV) is a popular and effective method for both dynamic and static power reduction while maintaining…

Hardware Architecture · Computer Science 2014-02-14 Bei Yu , Sheqin Dong , Song Chen , Satoshi Goto

Multi-stage reasoning has emerged as an effective strategy for enhancing the reasoning capability of small language models by decomposing complex problems into sequential sub-stages. However, this comes at the cost of increased latency. We…

Computation and Language · Computer Science 2026-01-08 Beomseok Kang , Jiwon Song , Jae-Joon Kim

Current language model training commonly applies multi-task Supervised Fine-Tuning (SFT) using a homogeneous compute budget across all sub-datasets. This approach is fundamentally sub-optimal: heterogeneous learning dynamics cause…

Machine Learning · Computer Science 2026-03-30 Woosung Koh , Jeyoung Jeon , Youngjin Song , Yujin Cheon , Soowon Oh , Jaehyeong Choi , Se-Young Yun

Serverless computing that runs functions with auto-scaling is a popular task execution pattern in the cloud-native era. By connecting serverless functions into workflows, tenants can achieve complex functionality. Prior researches adopt the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-01 Zijun Li , Chuhao Xu , Quan Chen , Jieru Zhao , Chen Chen , Minyi Guo

The deployment and scaling of large language models (LLMs) have become critical as they permeate various applications, demanding high-throughput and low-latency serving systems. Existing frameworks struggle to balance these requirements,…

Large language models (LLMs) have become increasingly popular in various areas, traditional business gradually shifting from rule-based systems to LLM-based solutions. However, the inference of LLMs is resource-intensive or…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Wanyi Zheng , Minxian Xu , Shengye Song , Kejiang Ye

In this paper, we study the scheduling problem for downlink transmission in a multi-channel (e.g., OFDM-based) wireless network. We focus on a single cell, with the aim of developing a unifying framework for designing low-complexity…

Networking and Internet Architecture · Computer Science 2013-11-19 Bo Ji , Gagan R. Gupta , Xiaojun Lin , Ness B. Shroff

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. In co-flow scheduling, there are $m$ input ports and $m$ output ports. Each co-flow $j \in J$ can be…

Data Structures and Algorithms · Computer Science 2018-12-04 Sungjin Im , Manish Purohit

This paper investigates the problem of link scheduling to meet traffic demands with minimum airtime in a multi-transmit-receive (MTR) wireless network. MTR networks are a new class of networks, in which each node can simultaneously transmit…

Networking and Internet Architecture · Computer Science 2011-07-12 Hong-Ning Dai , Soung Chang Liew , Liqun Fu

As the last pivotal stage of Recommender System (RS), Multi-Task Fusion (MTF) is responsible for combining multiple scores outputted by Multi-Task Learning (MTL) model into a final score to maximize user satisfaction. Recently, to optimize…

Information Retrieval · Computer Science 2025-09-25 Peng Liu , Cong Xu , Ming Zhao , Jiawei Zhu , Bin Wang , Yi Ren

The pressing demands of improving energy efficiency for high performance scientific computing have motivated a large body of software-controlled hard- ware solutions using Dynamic Voltage and Frequency Scaling (DVFS) that strategically…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-03 Li Tan , Zizhong Chen

As demand for Large Language Models (LLMs) and AI agents grows rapidly, optimizing systems for efficient LLM inference becomes critical. While significant efforts have targeted system-level engineering, little has been explored from a…

Machine Learning · Statistics 2026-05-19 J. G. Dai , Tianze Deng , Yueying Li , Tianyi Peng

The integration of AI-assisted coding tools within development environments drastically reduces development time, and allows developers to focus more on creative and critical aspects of software engineering through the use of Code Large…

Software Engineering · Computer Science 2025-03-26 Kishanthan Thangarajah , Arthur Leung , Boyuan Chen , Ahmed E. Hassan

Reinforcement learning (RL) has become a pivotal technology in the post-training phase of large language models (LLMs). Traditional task-colocated RL frameworks suffer from significant scalability bottlenecks, while task-separated RL…