English
Related papers

Related papers: SMDP-Based Dynamic Batching for Improving Responsi…

200 papers

Reducing the average memory access time is crucial for improving the performance of applications running on multi-core architectures. With workload consolidation this becomes increasingly challenging due to shared resource contention.…

Hardware Architecture · Computer Science 2021-02-24 Nadja Ramhöj Holtryd , Madhavan Manivannan , Per Stenström , Miquel Pericàs

Batching has a fundamental influence on the efficiency of deep neural network (DNN) execution. However, for dynamic DNNs, efficient batching is particularly challenging as the dataflow graph varies per input instance. As a result,…

Machine Learning · Computer Science 2023-02-09 Siyuan Chen , Pratik Fegade , Tianqi Chen , Phillip B. Gibbons , Todd C. Mowry

In this paper, energy efficient power allocation for the uplink of a multi-cell massive MIMO system is investigated. With the simplified power consumption model, the problem of power allocation is formulated as a constrained Markov decision…

Information Theory · Computer Science 2017-03-22 Peng Li , Yanxiang Jiang , Wei Li , Fuchun Zheng , Xiaohu You

Renewable energy assisted heterogeneous networks can improve system capacity and reduce conventional energy consumption. In this paper, we propose a semi-Markov decision process (SMDP)-based downlink packet scheduling scheme for solar…

Networking and Internet Architecture · Computer Science 2018-03-28 Qizhen Li , Jie Gao , Jinming Wen , Xiaohu Tang , Lian Zhao , Limin Sun

Online planning in Markov Decision Processes (MDPs) enables agents to make sequential decisions by simulating future trajectories from the current state, making it well-suited for large-scale or dynamic environments. Sample-based methods…

Artificial Intelligence · Computer Science 2025-09-22 Tamir Shazman , Idan Lev-Yehudi , Ron Benchetit , Vadim Indelman

Joint pushing and caching is recognized as an efficient remedy to the problem of spectrum scarcity incurred by tremendous mobile data traffic. In this paper, by exploiting storage resources at end users and predictability of user demand…

Information Theory · Computer Science 2017-06-30 Yaping Sun , Ying Cui , Hui Liu

This paper presents a semi-Markov decision process (SMDP) formulation of the satellite task scheduling problem. This formulation can consider multiple operational objectives simultaneously and plan transitions between distinct functional…

Systems and Control · Electrical Eng. & Systems 2019-10-21 Duncan Eddy , Mykel Kochenderfer

This paper focuses on energy management in buildings with phase change material (PCM), which is primarily used to improve thermal performance, but can also serve as an energy storage system. In this setting, optimal scheduling of an HVAC…

Machine Learning · Computer Science 2019-12-11 Zahra Rahimpour , Gregor Verbic , Archie C. Chapman

Networking is considered a datacenter tax, and hyperscalers push hard to provide high-performance networking with minimal resource expenditure. To keep up with the ever-increasing network rates, many CPU cycles are spent on the networking…

Hardware Architecture · Computer Science 2025-03-11 Amin Mamandipoor , Huy Dinh Tran , Mohammad Alian

This paper presents LMStream, which ensures bounded latency while maximizing the throughput on the GPU-enabled micro-batch streaming systems. The main ideas behind LMStream's design can be summarized as two novel mechanisms: (1) dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-09 Suyeon Lee , Sungyong Park

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

Statistics Theory · Mathematics 2021-11-11 Zhengling Qi , Peng Liao

Often, machine learning applications have to cope with dynamic environments where data are collected in the form of continuous data streams with potentially infinite length and transient behavior. Compared to traditional (batch) data…

Machine Learning · Computer Science 2021-12-21 Guilherme Cassales , Heitor Gomes , Albert Bifet , Bernhard Pfahringer , Hermes Senger

We consider the problem of energy-efficient on-line scheduling for slice-parallel video decoders on multicore systems. We assume that each of the processors are Dynamic Voltage Frequency Scaling (DVFS) enabled such that they can…

Multimedia · Computer Science 2013-06-06 Nicholas Mastronarde , Karim Kanoun , David Atienza , Pascal Frossard , Mihaela van der Schaar

We present a simple dynamic batching approach applicable to a large class of dynamic architectures that consistently yields speedups of over 10x. We provide performance bounds when the architecture is not known a priori and a stronger bound…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Joseph Suarez , Clare Zhu

Wireless networks used for Internet of Things (IoT) are expected to largely involve cloud-based computing and processing. Softwarised and centralised signal processing and network switching in the cloud enables flexible network control and…

Artificial Intelligence · Computer Science 2020-10-13 Beiran Chen , Yi Zhang , George Iosifidis , Mingming Liu

This paper addresses the problem of planning under uncertainty in large Markov Decision Processes (MDPs). Factored MDPs represent a complex state space using state variables and the transition model using a dynamic Bayesian network. This…

Artificial Intelligence · Computer Science 2011-06-10 C. Guestrin , D. Koller , R. Parr , S. Venkataraman

Cloud computing has grown rapidly in recent years, mainly due to the sharp increase in data transferred over the internet. This growth makes load balancing a key part of cloud systems, as it helps distribute user requests across servers to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Shadman Sakib , Ajay Katangur , Rahul Dubey

Energy consumption has become a first-class optimization goal in design and implementation of data-intensive computing systems. This is particularly true in the design of database management systems (DBMS), which was found to be the major…

Databases · Computer Science 2017-03-09 Peyman Behzadnia , Yi-Cheng Tu , Bo Zeng , Wei Yuan

Developing an efficient server-based real-time scheduling solution that supports dynamic task-level parallelism is now relevant to even the desktop and embedded domains and no longer only to the high performance computing market niche. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-15 Luís Nogueira , Luís Miguel Pinho

We consider a dynamic server allocation problem over parallel queues with randomly varying connectivity and server switchover delay between the queues. At each time slot the server decides either to stay with the current queue or switch to…

Optimization and Control · Mathematics 2012-03-06 Güner D. Celik , Long B. Le , Eytan Modiano