English
Related papers

Related papers: PPO-ABR: Proximal Policy Optimization based Deep R…

200 papers

With the dramatically increasing video streaming in the total network traffic, it is critical to develop effective algorithms to promote the content delivery service of high quality. Adaptive bitrate (ABR) control is the most essential…

Networking and Internet Architecture · Computer Science 2021-09-28 Bo Wei , Hang Song , Jiro Katto

Offline reinforcement learning (RL) is a challenging setting where existing off-policy actor-critic methods perform poorly due to the overestimation of out-of-distribution state-action pairs. Thus, various additional augmentations are…

Machine Learning · Computer Science 2023-02-23 Zifeng Zhuang , Kun Lei , Jinxin Liu , Donglin Wang , Yilang Guo

The diversity of video delivery pipeline poses a grand challenge to the evaluation of adaptive bitrate (ABR) streaming algorithms and objective quality-of-experience (QoE) models. Here we introduce so-far the largest subject-rated database…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Zhengfang Duanmu , Wentao Liu , Zhuoran Li , Diqi Chen , Zhou Wang , Yizhou Wang , Wen Gao

Recent advances in quality adaptation algorithms leave adaptive bitrate (ABR) streaming architectures at a crossroads: When determining the sustainable video quality one may either rely on the information gathered at the client vantage…

Multimedia · Computer Science 2019-01-18 Bastian Alt , Trevor Ballard , Ralf Steinmetz , Heinz Koeppl , Amr Rizk

Recent advances in unmanned aerial vehicle (UAV) technology have revolutionized a broad class of civil and military applications. However, the designs of wireless technologies that enable real-time streaming of high-definition video between…

Signal Processing · Electrical Eng. & Systems 2019-09-25 Xuedou Xiao , Wei Wang , Taobin Chen , Yang Cao , Tao Jiang , Qian Zhang

In video streaming over HTTP, the bitrate adaptation selects the quality of video chunks depending on the current network condition. Some previous works have applied deep reinforcement learning (DRL) algorithms to determine the chunk's…

Networking and Internet Architecture · Computer Science 2023-06-29 Phuong L. Vo , Nghia T. Nguyen , Long Luu , Canh T. Dinh , Nguyen H. Tran , Tuan-Anh Le

With the merit of containing full panoramic content in one camera, Virtual Reality (VR) and 360-degree videos have attracted more and more attention in the field of industrial cloud manufacturing and training. Industrial Internet of Things…

Multimedia · Computer Science 2020-03-24 Wei Quan , Yuxuan Pan , Bin Xiang , Lin Zhang

Quality of Experience~(QoE)-driven adaptive bitrate (ABR) algorithms are typically optimized using QoE models that are based on the mean opinion score~(MOS), while such principles may not account for user heterogeneity on rating scales,…

Multimedia · Computer Science 2023-08-11 Tianchi Huang , Rui-Xiao Zhang , Chenglei Wu , Lifeng Sun

Adapting holographic video streaming to fluctuating wireless channels is essential to maintain consistent and satisfactory Quality of Experience (QoE) for users, which, however, is a challenging task due to the dynamic and uncertain…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Wanli Wen , Jiping Yan , Yulu Zhang , Zhen Huang , Liang Liang , Yunjian Jia

Bitrate adaptation (also known as ABR) is a crucial technique to improve the quality of experience (QoE) for video streaming applications. However, existing ABR algorithms suffer from severe traffic wastage, which refers to the traffic cost…

Networking and Internet Architecture · Computer Science 2024-12-11 Hairong Su , Shibo Wang , Shusen Yang , Tianchi Huang , Xuebin Ren

The rapid growth in video consumption has introduced significant challenges to modern streaming architectures. Over-the-Top (OTT) video delivery now predominantly relies on Adaptive Bitrate (ABR) streaming, which dynamically adjusts bitrate…

Image and Video Processing · Electrical Eng. & Systems 2026-02-03 Esteban Pesnel , Julien Le Tanou , Michael Ropert , Thomas Maugey , Aline Roumy

Wirelessly streaming high quality 360 degree videos is still a challenging problem. When there are many users watching different 360 degree videos and competing for the computing and communication resources, the streaming algorithm at hand…

Machine Learning · Computer Science 2024-09-25 Anis Elgabli , Mohammed S. Elbamby , Cristina Perfecto , Mounssif Krouka , Mehdi Bennis , Vaneet Aggarwal

In the tile-based 360-degree video streaming, predicting user's future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user's quality of experience (QoE). Traditional single-user based viewpoint…

Multimedia · Computer Science 2020-09-30 Jun Fu , Zhibo Chen , Xiaoming Chen , Weiping Li

In this paper, we study offline preference-based reinforcement learning (PbRL), where learning is based on pre-collected preference feedback over pairs of trajectories. While offline PbRL has demonstrated remarkable empirical success,…

Machine Learning · Computer Science 2025-06-04 Hyungkyu Kang , Min-hwan Oh

Deep Reinforcement Learning (DRL) policies are highly susceptible to adversarial noise in observations, which poses significant risks in safety-critical scenarios. The challenge inherent to adversarial perturbations is that by altering the…

Machine Learning · Computer Science 2025-04-25 Roman Belaire , Arunesh Sinha , Pradeep Varakantham

The rapid adoption of QUIC as a transport protocol has transformed content delivery by reducing latency, enhancing congestion control (CC), and enabling more efficient multiplexing. With the advent of 5G networks, which support ultra-low…

Networking and Internet Architecture · Computer Science 2026-02-11 Jashanjot Singh Sidhu , Jorge Ignacio Sandoval , Abdelhak Bentaleb , Sandra Cespedes

The rapid development of multimedia and communication technology has resulted in an urgent need for high-quality video streaming. However, robust video streaming under fluctuating network conditions and heterogeneous client computing…

Systems and Control · Electrical Eng. & Systems 2022-01-21 Junyan Yang , Yang Jiang , Shuoyao Wang

State-of-the-art deep reinforcement learning (RL) methods have achieved remarkable performance in continuous control tasks, yet their computational complexity is often incompatible with the constraints of resource-limited hardware, due to…

Machine Learning · Computer Science 2026-05-12 Riccardo De Monte , Matteo Cederle , Gian Antonio Susto

This paper presents a deep reinforcement learning (DRL) framework for dynamic portfolio optimization under market uncertainty and risk. The proposed model integrates a Sharpe ratio-based reward function with direct risk control mechanisms,…

Portfolio Management · Quantitative Finance 2025-11-17 Emmanuel Lwele , Sabuni Emmanuel , Sitali Gabriel Sitali

Deep reinforcement learning (DRL) algorithms can suffer from modeling errors between the simulation and the real world. Many studies use adversarial learning to generate perturbation during training process to model the discrepancy and…

Machine Learning · Computer Science 2024-05-21 Qianmei Liu , Yufei Kuang , Jie Wang