English
Related papers

Related papers: Structured Reinforcement Learning for Delay-Optima…

200 papers

Defect dynamics in materials are of central importance to a broad range of technologies from catalysis to energy storage systems to microelectronics. Material functionality depends strongly on the nature and organization of defects, their…

We study the problem of deployment efficient reinforcement learning (RL) with linear function approximation under the \emph{reward-free} exploration setting. This is a well-motivated problem because deploying new policies is costly in…

Machine Learning · Computer Science 2023-02-23 Dan Qiao , Yu-Xiang Wang

Deep reinforcement learning (deep RL) has been successful in learning sophisticated behaviors automatically; however, the learning process requires a huge number of trials. In contrast, animals can learn new tasks in just a few trials,…

Artificial Intelligence · Computer Science 2016-11-11 Yan Duan , John Schulman , Xi Chen , Peter L. Bartlett , Ilya Sutskever , Pieter Abbeel

Reinforcement Learning (RL), bolstered by the expressive capabilities of Deep Neural Networks (DNNs) for function approximation, has demonstrated considerable success in numerous applications. However, its practicality in addressing various…

Machine Learning · Computer Science 2024-04-26 Aditya Mohan , Amy Zhang , Marius Lindauer

The millimeter wave (mmWave) multiuser multiple-input multiple-output (MU-MIMO) systems with discrete lens arrays (DLA) have received great attention due to their simple hardware implementation and excellent performance. In this work, we…

Information Theory · Computer Science 2021-01-06 Qiyu Hu , Yanzhen Liu , Yunlong Cai , Guanding Yu , Zhi Ding

In this paper, the distributed edge caching problem in fog radio access networks (F-RANs) is investigated. By considering the unknown spatio-temporal content popularity and user preference, a user request model based on hidden Markov…

Machine Learning · Computer Science 2019-02-28 Liuyang Lu , Yanxiang Jiang , Mehdi Bennis , Zhiguo Ding , Fu-Chun Zheng , Xiaohu You

The problem of resource constrained scheduling in a dynamic and heterogeneous wireless setting is considered here. In our setup, the available limited bandwidth resources are allocated in order to serve randomly arriving service demands,…

Machine Learning · Computer Science 2022-04-01 Apostolos Avranas , Marios Kountouris , Philippe Ciblat

The curse of dimensionality renders Reinforcement Learning (RL) impractical in many real-world settings with exponentially large state and action spaces. Yet, many environments exhibit exploitable structure that can accelerate learning. To…

Machine Learning · Computer Science 2025-10-16 Thomas van Vuren , Fiona Sloothaak , Maarten G. Wolf , Jaron Sanders

Machine-to-Machine (M2M) communication is crucial in developing Internet of Things (IoT). As it is well known that cellular networks have been considered as the primary infrastructure for M2M communications, there are several key issues to…

Networking and Internet Architecture · Computer Science 2023-01-02 Xuehua Li , Xing Wei , Shuo Chen , Lixin Sun

Introducing cooperative coded caching into small cell networks is a promising approach to reducing traffic loads. By encoding content via maximum distance separable (MDS) codes, coded fragments can be collectively cached at small-cell base…

Information Theory · Computer Science 2020-06-25 Xiongwei Wu , Jun Li , Ming Xiao , P. C. Ching , H. Vincent Poor

Media streaming is the dominant application over wireless edge (access) networks. The increasing softwarization of such networks has led to efforts at intelligent control, wherein application-specific actions may be dynamically taken to…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Archana Bura , Sarat Chandra Bobbili , Shreyas Rameshkumar , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

In virtualized radio access network (vRAN), the base station (BS) functions are decomposed into virtualized components that can be hosted at the centralized unit or distributed units through functional splits. Such flexibility has many…

Networking and Internet Architecture · Computer Science 2022-06-06 Fahri Wisnu Murti , Samad Ali , Matti Latva-aho

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

In future cell-free (or cell-less) wireless networks, a large number of devices in a geographical area will be served simultaneously in non-orthogonal multiple access scenarios by a large number of distributed access points (APs), which…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Yasser Al-Eryani , Mohamed Akrout , Ekram Hossain

Scheduling in multi-channel wireless communication system presents formidable challenges in effectively allocating resources. To address these challenges, we investigate a multi-resource restless matching bandit (MR-RMB) model for…

Machine Learning · Computer Science 2024-08-21 Nida Zamir , I-Hong Hou

In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Cailian Chen , Shi Jin , Zhu Han , H. Vincent Poor

Markov decision processes (MDPs) are a well studied framework for solving sequential decision making problems under uncertainty. Exact methods for solving MDPs based on dynamic programming such as policy iteration and value iteration are…

Artificial Intelligence · Computer Science 2015-09-09 Yanping Huang

Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Meng-Qian Alexander Wu , Tzu-Hsien Sang , Luisa Schuhmacher , Ming-Jie Guo , Khodr Hammoud , Sofie Pollin

Intelligent wireless networks have long been expected to have self-configuration and self-optimization capabilities to adapt to various environments and demands. In this paper, we develop a novel distributed hierarchical deep reinforcement…

Signal Processing · Electrical Eng. & Systems 2023-12-06 Kaiwen Yu , Chonghao Zhao , Gang Wu , Geoffrey Ye Li

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame