English
Related papers

Related papers: Supervised Learning-enhanced Multi-Group Actor Cri…

200 papers

This paper introduces a novel reinforcement learning (RL) approach to scheduling mixed-criticality (MC) systems on processors with varying speeds. Building upon the foundation laid by [1], we extend their work to address the non-preemptive…

Machine Learning · Computer Science 2025-04-09 Muhammad El-Mahdy , Nourhan Sakr , Rodrigo Carrasco

Many existing reinforcement learning (RL) methods employ stochastic gradient iteration on the back end, whose stability hinges upon a hypothesis that the data-generating process mixes exponentially fast with a rate parameter that appears in…

Machine Learning · Computer Science 2023-02-02 Wesley A. Suttle , Amrit Singh Bedi , Bhrij Patel , Brian M. Sadler , Alec Koppel , Dinesh Manocha

6G wireless networks are expected to support diverse quality-of-service (QoS) demands while maintaining high energy efficiency. Weighted Minimum Mean Square Error (WMMSE) precoding with fixed user priorities and transmit power is widely…

Machine Learning · Computer Science 2025-06-23 Kexuan Wang , An Liu

In the tile-based 360-degree video streaming, predicting user's future viewpoints and developing adaptive bitrate (ABR) algorithms are essential for optimizing user's quality of experience (QoE). Traditional single-user based viewpoint…

Multimedia · Computer Science 2020-09-30 Jun Fu , Zhibo Chen , Xiaoming Chen , Weiping Li

Large Language Models (LLMs) have reshaped user profiling, yet current evaluations mainly focus on static data snapshots. This paradigm overlooks the reality of personalized systems, where User-Generated Content (UGC) arrives continuously…

Computation and Language · Computer Science 2026-05-27 Sizhe Wang , Feiyu Duan , Juelin Wang , Liwen Zhang , Zhongyu Wei

As an emerging paradigm of content creation, AI-Generated Content (AIGC) has been widely adopted by a large number of edge end users. However, the requests for generated content from AIGC users have obvious diversity, and there remains a…

Networking and Internet Architecture · Computer Science 2024-05-15 Yaju Liu , Xi Lin , Siyuan Li , Gaolei Li , Qinghua Mao , Jianhua Li

Long-term user engagement (LTE) optimization in sequential recommender systems (SRS) is shown to be suited by reinforcement learning (RL) which finds a policy to maximize long-term rewards. Meanwhile, RL has its shortcomings, particularly…

Information Retrieval · Computer Science 2023-05-09 Xiong-Hui Chen , Bowei He , Yang Yu , Qingyang Li , Zhiwei Qin , Wenjie Shang , Jieping Ye , Chen Ma

Dynamic treatment recommendation systems based on large-scale electronic health records (EHRs) become a key to successfully improve practical clinical outcomes. Prior relevant studies recommend treatments either use supervised learning…

Machine Learning · Computer Science 2018-09-18 Lu Wang , Wei Zhang , Xiaofeng He , Hongyuan Zha

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

Machine Learning · Computer Science 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Multi-access edge computing (MEC) is a promising solution to the computation-intensive, low-latency rendering tasks of the metaverse. However, how to optimally allocate limited communication and computation resources at the edge to a large…

Multimedia · Computer Science 2023-12-27 Zijian Long , Haiwei Dong , Abdulmotaleb El Saddik

Recommendation systems (RS) help users find interested content and connect authors with their target audience. Most research in RS tends to focus either on predicting users' immediate feedback (like click-through rate) accurately or…

Information Retrieval · Computer Science 2025-09-22 Yisha Li , Lexi Gao , Jingxin Liu , Xiang Gao , Xin Li , Haiyang Lu , Liyin Hong

The high-accuracy and resource-intensive deep neural networks (DNNs) have been widely adopted by live video analytics (VA), where camera videos are streamed over the network to resource-rich edge/cloud servers for DNN inference. Common…

Networking and Internet Architecture · Computer Science 2023-11-03 Duo Wu , Dayou Zhang , Miao Zhang , Ruoyu Zhang , Fangxin Wang , Shuguang Cui

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

Policy gradient methods have become popular in multi-agent reinforcement learning, but they suffer from high variance due to the presence of environmental stochasticity and exploring agents (i.e., non-stationarity), which is potentially…

Machine Learning · Computer Science 2021-12-21 Yuchen Xiao , Xueguang Lyu , Christopher Amato

The Click-Through Rate (CTR) prediction task is critical in industrial recommender systems, where models are usually deployed on dynamic streaming data in practical applications. Such streaming data in real-world recommender systems face…

Information Retrieval · Computer Science 2023-07-17 Qi-Wei Wang , Hongyu Lu , Yu Chen , Da-Wei Zhou , De-Chuan Zhan , Ming Chen , Han-Jia Ye

Model-based reinforcement learning (MBRL) and model-free reinforcement learning (MFRL) evolve along distinct paths but converge in the design of Dyna-Q [1]. However, modern RL methods still struggle with effective transferability across…

Machine Learning · Computer Science 2025-12-18 Quanxi Zhou , Wencan Mao , Manabu Tsukada , John C. S. Lui , Yusheng Ji

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

This paper introduces a dual-critic reinforcement learning (RL) framework to address the problem of frame-level bit allocation in HEVC/H.265. The objective is to minimize the distortion of a group of pictures (GOP) under a rate constraint.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yung-Han Ho , Guo-Lun Jin , Yun Liang , Wen-Hsiao Peng , Xiaobo Li

We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples. Our framework is motivated by actor-critic reinforcement learning, but can be applied to both reinforcement and supervised learning.…

Machine Learning · Computer Science 2017-06-30 Flood Sung , Li Zhang , Tao Xiang , Timothy Hospedales , Yongxin Yang

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar