English
Related papers

Related papers: Context-aware Constrained Reinforcement Learning B…

200 papers

Many DNN-enabled vision applications constantly operate under severe energy constraints such as unmanned aerial vehicles, Augmented Reality headsets, and smartphones. Designing DNNs that can meet a stringent energy budget is becoming…

Machine Learning · Computer Science 2019-04-09 Haichuan Yang , Yuhao Zhu , Ji Liu

The low-altitude economy (LAE), driven by unmanned aerial vehicles (UAVs) and other aircraft, has revolutionized fields such as transportation, agriculture, and environmental monitoring. In the upcoming six-generation (6G) era, UAV-assisted…

Machine Learning · Computer Science 2025-01-14 Geng Sun , Weilong Ma , Jiahui Li , Zemin Sun , Jiacheng Wang , Dusit Niyato , Shiwen Mao

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

Machine Learning · Computer Science 2026-02-13 Mehrdad Moghimi , Hyejin Ku

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

Adaptive Mixed-Criticality (AMC) is a fixed-priority preemptive scheduling algorithm for mixed-criticality hard real-time systems. It dominates many other scheduling algorithms for mixed-criticality systems, but does so at the cost of…

Operating Systems · Computer Science 2024-11-04 Bruno Mendes , Pedro F. Souto , Pedro C. Diniz

An emerging public health application of connected and automated vehicle (CAV) technologies is to reduce response times of emergency medical service (EMS) by indirectly coordinating traffic. Therefore, in this work we study the CAV-assisted…

Robotics · Computer Science 2023-12-19 Dajiang Suo , Vindula Jayawardana , Cathy Wu

In this paper, we tackle the task of adaptive time allocation in integrated sensing and communication systems equipped with radar and communication units. The dual-functional radar-communication system's task involves allocating dwell times…

Machine Learning · Computer Science 2025-06-27 Ziyang Lu , M. Cenk Gursoy , Chilukuri K. Mohan , Pramod K. Varshney

With the increasing penetration of distributed energy resources, distributed optimization algorithms have attracted significant attention for power systems applications due to their potential for superior scalability, privacy, and…

Systems and Control · Electrical Eng. & Systems 2022-05-09 Sihan Zeng , Alyssa Kody , Youngdae Kim , Kibaek Kim , Daniel K. Molzahn

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

Robust Markov Decision Processes (RMDPs) have received significant research interest, offering an alternative to standard Markov Decision Processes (MDPs) that often assume fixed transition probabilities. RMDPs address this by optimizing…

Machine Learning · Computer Science 2024-05-06 Xinyi Ni , Lifeng Lai

Wireless sensor networks (WSNs) with energy harvesting (EH) are expected to play a vital role in intelligent 6G systems, especially in industrial sensing and control, where continuous operation and sustainable energy use are critical. Given…

Signal Processing · Electrical Eng. & Systems 2025-08-26 Hossein Mohammadi Firouzjaei , Rafaela Scaciota , Sumudu Samarakoon , Beatriz Lorenzo

Collaborative Edge Computing (CEC) is an effective method that improves the performance of Mobile Edge Computing (MEC) systems by offloading computation tasks from busy edge servers (ESs) to idle ones. However, ESs usually belong to…

Networking and Internet Architecture · Computer Science 2022-11-15 Xingqiu He , Yuhang Shen , Hongxi Zhu , Sheng Wang , Chaoqun You , Tony Q. S. Quek

This paper investigates goal-oriented communication for remote estimation of multiple Markov sources in resource-constrained networks. An agent decides the updating times of the sources and transmits the packet to a remote destination over…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Jiping Luo , Nikolaos Pappas

An inverse reinforcement learning (IRL) agent learns to act intelligently by observing expert demonstrations and learning the expert's underlying reward function. Although learning the reward functions from demonstrations has achieved great…

Artificial Intelligence · Computer Science 2022-02-28 Wei Gao , David Hsu , Wee Sun Lee

Meeting the strict Quality of Service (QoS) requirements of terminals has imposed a signiffcant challenge on Multiaccess Edge Computing (MEC) systems, due to the limited multidimensional resources. To address this challenge, we propose a…

Networking and Internet Architecture · Computer Science 2024-04-29 Qianqian Liu , Haixia Zhang , Xin Zhang , Dongfeng Yuan

This paper studies the allocation of shared resources between vehicle-to-infrastructure (V2I) and vehicle-to-vehicle (V2V) links in vehicle-to-everything (V2X) communications. In existing algorithms, dynamic vehicular environments and…

Information Theory · Computer Science 2021-10-18 Yi Yuan , Gan Zheng , Kai-Kit Wong , Khaled B. Letaief

The Open Radio Access Network (O-RAN) architecture empowers intelligent and automated optimization of the RAN through applications deployed on the RAN Intelligent Controller (RIC) platform, enabling capabilities beyond what is achievable…

Networking and Internet Architecture · Computer Science 2025-04-01 Chuanneng Sun , Gueyoung Jung , Tuyen Xuan Tran , Dario Pompili

We consider primal-dual-based reinforcement learning (RL) in episodic constrained Markov decision processes (CMDPs) with non-stationary objectives and constraints, which plays a central role in ensuring the safety of RL in time-varying…

Machine Learning · Computer Science 2022-11-22 Yuhao Ding , Javad Lavaei

Mobile edge computing (MEC) networks bring computing and storage capabilities closer to edge devices, which reduces latency and improves network performance. However, to further reduce transmission and computation costs while satisfying…

Information Theory · Computer Science 2023-09-28 Xiangyu Gao , Yaping Sun , Hao Chen , Xiaodong Xu , Shuguang Cui

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

Artificial Intelligence · Computer Science 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham