English
Related papers

Related papers: Edge Caching Optimization with PPO and Transfer Le…

200 papers

In the classical Reinforcement Learning from Human Feedback (RLHF) framework, Proximal Policy Optimization (PPO) is employed to learn from sparse, sentence-level rewards -- a challenging scenario in traditional deep reinforcement learning.…

Machine Learning · Computer Science 2025-05-22 Han Zhong , Zikang Shan , Guhao Feng , Wei Xiong , Xinle Cheng , Li Zhao , Di He , Jiang Bian , Liwei Wang

Direct Preference Optimization (DPO) optimizes language models to align with human preferences. Utilizing on-policy samples, generated directly by the policy model, typically results in better performance due to its distribution consistency…

Machine Learning · Computer Science 2025-03-21 Yunan Wang , Jijie Li , Bo-Wen Zhang , Liangdong Wang , Guang Liu

With the growing demand for latency-critical and computation-intensive Internet of Things (IoT) services, the IoT-oriented network architecture, mobile edge computing (MEC), has emerged as a promising technique to reinforce the computation…

Information Theory · Computer Science 2022-08-09 Jiechen Chen , Hong Xing , Xiaohui Lin , Arumugam Nallanathan , Suzhi Bi

Model-free and reinforcement learning-based adaptive filtering methods are gaining traction for denoising in dynamic, non-stationary environments such as wireless signal channels. Traditional filters like LMS, RLS, Wiener, and Kalman are…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Abdullah Burkan Bereketoglu

With files proactively stored at base stations (BSs), mobile edge caching enables direct content delivery without remote file fetching, which can reduce the end-to-end delay while relieving backhaul pressure. To effectively utilize the…

Networking and Internet Architecture · Computer Science 2017-10-25 Shan Zhang , Peter He , Katsuya Suto , Peng Yang , Lian Zhao , Xuemin , Shen

In large language model (LLM)-based recommendation systems, direct preference optimization (DPO) effectively aligns recommendations with user preferences, requiring multi-negative objective functions to leverage abundant implicit-feedback…

Information Retrieval · Computer Science 2026-05-04 Xingyu Hu , Kai Zhang , Jiancan Wu , Shuli Wang , Chi Wang , Wenshuai Chen , Yinhua Zhu , Haitao Wang , Xingxing Wang , Xiang Wang

In this paper, we consider a goal-oriented communication problem for edge server monitoring, where jobs arrive intermittently at multiple dispatchers and must be assigned to shared edge servers with finite queues and time-varying…

Systems and Control · Electrical Eng. & Systems 2025-10-01 Samuel Chamoun , Christian McDowell , Robin Buchanan , Kevin Chan , Eric Graves , Yin Sun

Recently, test-time scaling Large Language Models (LLMs) have demonstrated exceptional reasoning capabilities across scientific and professional tasks by generating long chains-of-thought (CoT). As a crucial component for developing these…

Expressive generative models have advanced robotic manipulation by capturing complex, multi-modal action distributions over temporally extended trajectories. However, fine-tuning these policies via RL remains challenging due to instability…

Robotics · Computer Science 2026-04-03 Yuhui Chen , Haoran Li , Zhennan Jiang , Yuxing Qin , Yuxuan Wan , Weiheng Liu , Dongbin Zhao

Policy-based Reinforcement Learning (RL) has established itself as the dominant paradigm in generative recommendation for optimizing sequential user interactions. However, when applied to offline historical logs, these methods suffer a…

Machine Learning · Computer Science 2026-02-12 Jie Jiang , Yusen Huo , Xiangxin Zhan , Changping Wang , Jun Zhang

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

Machine Learning · Computer Science 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

Efficient truck dispatching via Reinforcement Learning (RL) in open-pit mining is often hindered by reliance on complex reward engineering and value-based methods. This paper introduces Curriculum-inspired Adaptive Direct Policy Guidance, a…

Machine Learning · Computer Science 2025-03-03 Shi Meng , Bin Tian , Xiaotong Zhang

Existing batch size selection approaches in distributed machine learning rely on static allocation or simplistic heuristics that fail to adapt to heterogeneous, dynamic computing environments. We present DYNAMIX, a reinforcement learning…

Machine Learning · Computer Science 2025-10-10 Yuanjun Dai , Keqiang He , An Wang

Pioneering companies such as Waymo have deployed robo-taxi services in several U.S. cities. These robo-taxis are electric vehicles, and their operations require the joint optimization of ride matching, vehicle repositioning, and charging…

Artificial Intelligence · Computer Science 2025-04-29 Jim Dai , Manxi Wu , Zhanhao Zhang

We consider caching in cellular networks in which each base station is equipped with a cache that can store a limited number of files. The popularity of the files is known and the goal is to place files in the caches such that the…

Networking and Internet Architecture · Computer Science 2017-11-27 Konstantin Avrachenkov , Jasper Goseling , Berksan Serbetci

In this paper, we design dynamic probabilistic caching for the scenario when the instantaneous content popularity may vary with time while it is possible to predict the average content popularity over a time window. Based on the average…

Networking and Internet Architecture · Computer Science 2020-02-18 Jie Gao , Shan Zhang , Lian Zhao , Xuemin , Shen

Many recent caching systems aim to improve miss ratios, but there is no good sense among practitioners of how much further miss ratios can be improved. In other words, should the systems community continue working on this problem?…

Performance · Computer Science 2018-07-09 Daniel S. Berger , Nathan Beckmann , Mor Harchol-Balter

In this paper we have proposed an adaptive dynamic cache replacement algorithm for a multimedia servers cache system. The goal is to achieve an effective utilization of the cache memory which stores the prefix of popular videos. A…

Multimedia · Computer Science 2016-09-08 P. Jayarekha , T. R. Gopalakrishnan Nair

Performance metrics-driven context caching has a profound impact on throughput and response time in distributed context management systems for real-time context queries. This paper proposes a reinforcement learning based approach to…

Systems and Control · Electrical Eng. & Systems 2023-02-10 Shakthi Weerasinghe , Arkady Zaslavsky , Seng W. Loke , Amin Abken , Alireza Hassani