English
Related papers

Related papers: Implementing Reinforcement Learning Datacenter Con…

200 papers

Congestion control plays a pivotal role in large-scale data centers, facilitating ultra-low latency, high bandwidth, and optimal utilization. Even with the deployment of data center congestion control mechanisms such as DCQCN and HPCC,…

Networking and Internet Architecture · Computer Science 2024-05-28 Jing Xu , Zhan Wang , Fan Yang , Ning Kang , Zhenlong Ma , Guojun Yuan , Guangming Tan , Ninghui Sun

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

We introduce a model of the Relentless Congestion Control proposed by Matt Mathis. Relentless Congestion Control (RCC) is a modification of the AIMD (Additive Increase Multiplicative Decrease) congestion control which consists in decreasing…

Networking and Internet Architecture · Computer Science 2012-11-26 Rémi Diana , Emmanuel Lochin

As Exascale computing becomes a reality, the energy needs of compute nodes in cloud data centers will continue to grow. A common approach to reducing this energy demand is to limit the power consumption of hardware components when workloads…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-17 Akhilesh Raj , Swann Perarnau , Aniruddha Gokhale

Recent advances in TCP congestion control (CC) have achieved tremendous success with deep reinforcement learning (RL) approaches, which use feedforward neural networks (NN) to learn complex environment conditions and make better decisions.…

Machine Learning · Computer Science 2022-11-01 S P Sharan , Wenqing Zheng , Kuo-Feng Hsu , Jiarong Xing , Ang Chen , Zhangyang Wang

The recent advancements in cloud services, Internet of Things (IoT) and Cellular networks have made cloud computing an attractive option for intelligent traffic signal control (ITSC). Such a method significantly reduces the cost of cables,…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Rusheng Zhang , Xinze Zhou , Ozan K. Tonguz

The proliferation of cloud data center applications and network function virtualization (NFV) boosts dynamic and QoS dependent traffic into the data centers network. Currently, lots of network routing protocols are requirement agnostic,…

In data centers, the nature of the composite bursty traffic along with the small bandwidth-delay product and switch buffers lead to several congestion problems that are not handled well by traditional congestion control mechanisms such as…

Networking and Internet Architecture · Computer Science 2020-12-02 Ahmed M. Abdelmoniem , Brahim Bensaou

Fast and efficient transport protocols are the foundation of an increasingly distributed world. The burden of continuously delivering improved communication performance to support next-generation applications and services, combined with the…

Machine Learning · Computer Science 2023-06-27 Raffaele Galliera , Alessandro Morelli , Roberto Fronteddu , Niranjan Suri

The increasingly complicated and diverse applications have distinct network performance demands, e.g., some desire high throughput while others require low latency. Traditional congestion controls (CC) have no perception of these demands.…

Networking and Internet Architecture · Computer Science 2021-07-20 Lei Zhang , Yong Cui , Mowei Wang , Kewei Zhu , Yibo Zhu , Yong Jiang

Resource-disaggregated data centres (RDDC) propose a resource-centric, and high-utilisation architecture for data centres (DC), avoiding resource fragmentation and enabling arbitrarily sized resource pools to be allocated to tasks, rather…

Machine Learning · Computer Science 2021-11-12 Zacharaya Shabka , Georgios Zervas

Conventional Congestion Control (CC) algorithms,such as TCP Cubic, struggle in tactical environments as they misinterpret packet loss and fluctuating network performance as congestion symptoms. Recent efforts, including our own MARLIN, have…

As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for…

Machine Learning · Computer Science 2025-04-25 Hans Rosenberger , Rodrigo Fischer , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

Traditional congestion control algorithms struggle to maintain the consistent and satisfactory data transmission performance over time-varying networking condition. Simultaneously, as video traffic becomes dominant, the loose coupling…

Networking and Internet Architecture · Computer Science 2025-02-25 Xianliang Jiang , Guanghui Gong , Guang Jin

The ongoing transition to renewable energy is increasing the share of fluctuating power sources like wind and solar, raising power grid volatility and making grid operation increasingly complex and costly. In our prior work, we have…

Artificial Intelligence · Computer Science 2023-02-16 Anton R. Fuxjäger , Kristian Kozak , Matthias Dorfer , Patrick M. Blies , Marcel Wasserer

TCP and its variants have suffered from surprisingly poor performance for decades. We argue the TCP family has little hope to achieve consistent high performance due to a fundamental architectural deficiency: hardwiring packet-level events…

Networking and Internet Architecture · Computer Science 2014-10-14 Mo Dong , Qingxi Li , Doron Zarchy , Brighten Godfrey , Michael Schapira

Network-on-chip (NoC) architectures rely on buffers to store flits to cope with contention for router resources during packet switching. Recently, reversible multi-function channel (RMC) buffers have been proposed to simultaneously reduce…

Hardware Architecture · Computer Science 2022-05-27 Kamil Khan , Sudeep Pasricha , Ryan Gary Kim

Effective network congestion control strategies are key to keeping the Internet (or any large computer network) operational. Network congestion control has been dominated by hand-crafted heuristics for decades. Recently,…