English
Related papers

Related papers: Adaptive Contention Window Design using Deep Q-lea…

200 papers

Reinforcement learning (RL) is attracting attention as an effective way to solve sequential optimization problems that involve high dimensional state/action space and stochastic uncertainties. Many such problems involve constraints…

Machine Learning · Computer Science 2021-04-01 Haeun Yoo , Victor M. Zavala , Jay H. Lee

In automotive applications, frequency modulated continuous wave (FMCW) radar is an established technology to determine the distance, velocity and angle of objects in the vicinity of the vehicle. The quality of predictions might be seriously…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Christian Oswald , Mate Toth , Paul Meissner , Franz Pernkopf

Deep Reinforcement Learning (DRL) agents frequently face challenges in adapting to tasks outside their training distribution, including issues with over-fitting, catastrophic forgetting and sample inefficiency. Although the application of…

Artificial Intelligence · Computer Science 2023-11-21 Yizhao Jin , Greg Slabaugh , Simon Lucas

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

In this paper, we place deep Q-learning into a control-oriented perspective and study its learning dynamics with well-established techniques from robust control. We formulate an uncertain linear time-invariant model by means of the neural…

Machine Learning · Computer Science 2022-11-08 Balazs Varga , Balazs Kulcsar , Morteza Haghir Chehreghani

This paper presents a method for optimizing wireless networks by adjusting cell parameters that affect both the performance of the cell being optimized and the surrounding cells. The method uses multiple reinforcement learning agents that…

Systems and Control · Electrical Eng. & Systems 2023-05-25 Adriano Mendo , Jose Outes-Carnero , Yak Ng-Molina , Juan Ramiro-Moreno

Due to the high variability of the traffic in the radio access network (RAN), fixed network configurations are not flexible enough to achieve optimal performance. Our vendors provide several settings of the eNodeB to optimize the RAN…

Networking and Internet Architecture · Computer Science 2021-01-20 Yu Chen , Jie Chen , Ganesh Krishnamurthi , Huijing Yang , Huahui Wang , Wenjie Zhao

In this paper, a method for predicting the resources required for an intelligent vehicle client using a three-layer vehicular computing architecture is proposed. This method leverages Q-Learning to optimize resource allocation and enhance…

Networking and Internet Architecture · Computer Science 2026-02-17 Bahar Mojtabaei Ranani , Mahmood Ahmadi , Sajad Ahmadian

We consider a joint uplink and downlink scheduling problem of a fully distributed wireless networked control system (WNCS) with a limited number of frequency channels. Using elements of stochastic systems theory, we derive a sufficient…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Gaoyang Pang , Kang Huang , Daniel E. Quevedo , Branka Vucetic , Yonghui Li , Wanchun Liu

Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand. This also limits the applicability of RL in real-world…

Machine Learning · Computer Science 2025-03-04 Théo Vincent , Fabian Wahren , Jan Peters , Boris Belousov , Carlo D'Eramo

Systems for heating, ventilation and air-conditioning (HVAC) of buildings are traditionally controlled by a rule-based approach. In order to reduce the energy consumption and the environmental impact of HVAC systems more advanced control…

Multiagent Systems · Computer Science 2023-09-14 Daniel Bayer , Marco Pruckner

Scalability is the key roadstone towards the application of cooperative intelligent algorithms in large-scale networks. Reinforcement learning (RL) is known as model-free and high efficient intelligent algorithm for communication problems…

Signal Processing · Electrical Eng. & Systems 2021-11-08 Fenghe Hu , Yansha Deng , A. Hamid Aghvami

The field of quickest change detection (QCD) concerns design and analysis of algorithms to estimate in real time the time at which an important event takes place, and identify properties of the post-change behavior. It is shown in this…

Optimization and Control · Mathematics 2024-09-16 Austin Cooper , Sean Meyn

With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control policy is of…

Performance · Computer Science 2022-04-08 Bai Liu , Qiaomin Xie , Eytan Modiano

The growing demand on high-quality and low-latency multimedia services has led to much interest in edge caching techniques. Motivated by this, we in this paper consider edge caching at the base stations with unknown content popularity…

Information Theory · Computer Science 2019-05-15 Chen Zhong , M. Cenk Gursoy , Senem Velipasalar

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning…

Networking and Internet Architecture · Computer Science 2023-12-05 Mohammed Jouhari , Khalil Ibrahimi , Jalel Ben Othman , El Mehdi Amhoud

Structural model pruning is a prominent approach used for reducing the computational cost of Convolutional Neural Networks (CNNs) before their deployment on resource-constrained devices. Yet, the majority of proposed ideas require a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Alireza Ganjdanesh , Shangqian Gao , Heng Huang

The integration of Generative AI models into AI-native network systems offers a transformative path toward achieving autonomous and adaptive control. However, the application of such models to continuous control tasks is impeded by…

Artificial Intelligence · Computer Science 2026-03-12 Yuanhao Li , Haozhe Wang , Geyong Min , Nektarios Georgalas , Wang Miao

End-to-end deep learning improves breast cancer classification on diffusion-weighted MR images (DWI) using a convolutional neural network (CNN) architecture. A limitation of CNN as opposed to previous model-based approaches is the…