English
Related papers

Related papers: DQ-Ladder: A Deep Reinforcement Learning-based Bit…

200 papers

Real-time video streaming relies on rate control mechanisms to adapt video bitrate to network capacity while maintaining high utilization and low delay. However, the current video rate controllers, such as Google Congestion Control (GCC),…

Networking and Internet Architecture · Computer Science 2024-02-27 Pantea Karimi , Sadjad Fouladi , Vibhaalakshmi Sivaraman , Mohammad Alizadeh

Infrastructure systems are critical in modern communities but are highly susceptible to various natural and man-made disasters. Efficient post-disaster recovery requires repair-scheduling approaches under the limitation of capped resources…

Computational Engineering, Finance, and Science · Computer Science 2025-06-24 Huangbin Liang , Beatriz Moya , Francisco Chinesta , Eleni Chatzi

Adaptive Bit Rate (ABR) decision plays a crucial role for ensuring satisfactory Quality of Experience (QoE) in video streaming applications, in which past network statistics are mainly leveraged for future network bandwidth prediction.…

Multimedia · Computer Science 2021-05-06 Jiaoyang Yin , Yiling Xu , Hao Chen , Yunfei Zhang , Steve Appleby , Zhan Ma

We propose a deep reinforcement learning (DRL) approach for a full-duplex (FD) transmission that predicts the phase shifts of the reconfigurable intelligent surface (RIS), base station (BS) active beamformers, and the transmit powers to…

Information Theory · Computer Science 2024-06-21 Nancy Nayak , Sheetal Kalyani , Himal A. Suraweera

This paper describes an adaptive Lagrange multiplier determination method for rate-quality optimisation in video compression. Inspired by the experimental results of a Lagrange multiplier selection test, the presented approach adaptively…

Image and Video Processing · Electrical Eng. & Systems 2021-06-16 Fan Zhang , David R. Bull

Video Quality Assessment (VQA) is a very challenging task due to its highly subjective nature. Moreover, many factors influence VQA. Compression of video content, while necessary for minimising transmission and storage requirements,…

Virtual Reality (VR) services delivered over 6G networks demand ultra-low latency and high bandwidth to ensure seamless user experiences. This paper presents an intelligent resource allocation and edge caching framework for 6G O-RAN…

Networking and Internet Architecture · Computer Science 2026-05-25 Khaled M. Naguib , Soumaya Cherkaoui , Mahmoud M. Elmessalawy , Ahmed M. Abd El-Haleem , Ibrahim I. Ibrahim

This paper introduces Q-learning with gradient target tracking, a novel reinforcement learning framework that provides a learned continuous target update mechanism as an alternative to the conventional hard update paradigm. In the standard…

Machine Learning · Computer Science 2025-07-21 Bum Geun Park , Taeho Lee , Donghwan Lee

In recent years, video streaming applications have proliferated the demand for Video Quality Assessment VQA). Reduced reference video quality assessment (RR-VQA) is a category of VQA where certain features (e.g., texture, edges) of the…

Learning rate scheduling has evolved from the single global fixed rate of early SGD to sophisticated layer-wise adaptive strategies. We systematize this evolution into five generations: (Gen1) global fixed learning rates, (Gen2) global…

Artificial Intelligence · Computer Science 2026-05-01 Ming-Hong Yao , Di Wang , Jian Cui , Jin-Yan Chen , Zi-Hao Cui , Fa Wang , Chen Wei , Qiu-Ye Yu

Owing to the openness of wireless channels, wireless communication systems are highly susceptible to malicious jamming. Most existing anti-jamming methods rely on the assumption of accurate sensing and optimize parameters on a single…

Information Theory · Computer Science 2025-11-06 Haoqin Zhao , Zan Li , Jiangbo Si , Rui Huang , Hang Hu , Tony Q. S. Quek , Naofal Al-Dhahir

Caching and rate allocation are two promising approaches to support video streaming over wireless network. However, existing rate allocation designs do not fully exploit the advantages of the two approaches. This paper investigates the…

Networking and Internet Architecture · Computer Science 2018-04-02 Zhengming Zhang , Yaru Zheng , Meng Hua , Yongming Huang , Luxi Yang

The explosion of user-generated videos stimulates a great demand for no-reference video quality assessment (NR-VQA). Inspired by our observation on the actions of human annotation, we put forward a Divide and Conquer Video Quality Estimator…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Zutong Li , Lei Yang

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

Machine Learning · Computer Science 2025-09-23 Aohan Li , Miyu Tsuzuki

Providing quality-constant streams can simultaneously guarantee user experience and prevent wasting bit-rate. In this paper, we propose a novel deep learning based two-pass encoder parameter prediction framework to decide rate factor (RF),…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Chunlei Cai , Yi Wang , Xiaobo Li , Tianxiao Ye

Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune…

Machine Learning · Computer Science 2021-07-08 Zhang Zhaoyang , Shao Wenqi , Gu Jinwei , Wang Xiaogang , Luo Ping

The deployment of deep neural networks on resource-constrained devices relies on quantization. While static, uniform quantization applies a fixed bit-width to all inputs, it fails to adapt to their varying complexity. Dynamic,…

Machine Learning · Computer Science 2026-03-24 Hazem Hesham Yousef Shalby , Fabrizio Pittorino , Francesca Palermo , Diana Trojaniello , Manuel Roveri

Deep reinforcement learning (DRL) has demonstrated impressive performance in various gaming simulators and real-world applications. In practice, however, a DRL agent may receive faulty observation by abrupt interferences such as black-out,…

Machine Learning · Computer Science 2022-01-26 Chao-Han Huck Yang , I-Te Danny Hung , Yi Ouyang , Pin-Yu Chen

Video compression plays a crucial role in video streaming and classification systems by maximizing the end-user quality of experience (QoE) at a given bandwidth budget. In this paper, we conduct the first systematic study for adversarial…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Jung-Woo Chang , Mojan Javaheripi , Seira Hidano , Farinaz Koushanfar

NDN has gained significant attention due to the appearance of several unforeseen design flaws that became evident with new communication scenarios. Among its many features, the two standard NDN forwarding strategies are not adaptive,…

Networking and Internet Architecture · Computer Science 2020-10-21 Ygor Amaral B. L. de Sena , Kelvin Lopes Dias , Cleber Zanchettin