English
Related papers

Related papers: Deep Reinforcement Learning-Based Beam Tracking fo…

200 papers

Deploying ultra-dense networks that operate on millimeter wave (mmWave) band is a promising way to address the tremendous growth on mobile data traffic. However, one key challenge of ultra-dense mmWave network (UDmmN) is beam management due…

Information Theory · Computer Science 2022-11-01 Qing Xue , Yi-Jing Liu , Yao Sun , Jian Wang , Li Yan , Gang Feng , Shaodan Ma

In this paper, the problem of joint power and resource allocation (JPRA) for ultra-reliable low-latency communication (URLLC) in vehicular networks is studied. Therein, the network-wide power consumption of vehicular users (VUEs) is…

Information Theory · Computer Science 2019-12-06 Sumudu Samarakoon , Mehdi Bennis , Walid Saad , Merouane Debbah

Deep reinforcement learning (DRL) has been applied to a variety of problems during the past decade, and has provided effective control strategies in high-dimensional and non-linear situations that are challenging to traditional methods.…

Fluid Dynamics · Physics 2023-04-07 Colin Vignon , Jean Rabault , Ricardo Vinuesa

Latest technological improvements increased the quality of transportation. New data-driven approaches bring out a new research direction for all control-based systems, e.g., in transportation, robotics, IoT and power systems. Combining…

Machine Learning · Computer Science 2020-05-05 Ammar Haydari , Yasin Yilmaz

Link adaptation (LA) is an essential function in modern wireless communication systems that dynamically adjusts the transmission rate of a communication link to match time- and frequency-varying radio link conditions. However, factors such…

Machine Learning · Computer Science 2024-12-02 Samuele Peri , Alessio Russo , Gabor Fodor , Pablo Soldati

Autonomous vehicles have the potential to revolutionize transportation, but they must be able to navigate safely in traffic before they can be deployed on public roads. The goal of this project is to train autonomous vehicles to make…

Artificial Intelligence · Computer Science 2023-11-21 Ghadi Nehme , Tejas Y. Deo

Collision avoidance algorithms are essential for safe and efficient robot operation among pedestrians. This work proposes using deep reinforcement (RL) learning as a framework to model the complex interactions and cooperation with nearby,…

Robotics · Computer Science 2021-01-26 Michael Everett , Yu Fan Chen , Jonathan P. How

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

The escalating interests on underwater exploration/reconnaissance applications have motivated high-rate data transmission from underwater to airborne relaying platforms, especially under high-sea scenarios. Thanks to its broad bandwidth and…

Signal Processing · Electrical Eng. & Systems 2024-09-06 Jiayue Liu , Tianqi Mao , Dongxuan He , Yang Yang , Zhen Gao , Dezhi Zheng , Jun Zhang

We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Junya Ikemoto , Toshimitsu Ushio

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

In the last decade, Reinforcement Learning (RL) has achieved remarkable success in the control and decision-making of complex dynamical systems. However, most RL algorithms rely on the Markov Decision Process assumption, which is violated…

Machine Learning · Statistics 2026-02-03 Armando Alves Neto

In this letter, we analyze the achievable rate of ultra-reliable low-latency communications (URLLC) in a randomly modeled wireless network. We use two mathematical tools to properly characterize the considered system: i) stochastic geometry…

Information Theory · Computer Science 2019-10-31 Jeonghun Park

With the growing need to reduce energy consumption and greenhouse gas emissions, Eco-driving strategies provide a significant opportunity for additional fuel savings on top of other technological solutions being pursued in the…

Systems and Control · Electrical Eng. & Systems 2022-12-16 Lindsey Kerbel , Beshah Ayalew , Andrej Ivanco , Keith Loiselle

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

This paper discusses the feasibility of beam tracking against dynamics in millimeter wave (mmWave) nodes placed on overhead messenger wires, including wind-forced perturbations and disturbances caused by impulsive forces to wires. Our main…

Networking and Internet Architecture · Computer Science 2020-12-03 Yusuke Koda , Masao Shinzaki , Koji Yamamoto , Takayuki Nishio , Masahiro Morikura , Yushi Shirato , Daisei Uchida , Naoki Kita

Today, human operators primarily perform voltage control of the electric transmission system. As the complexity of the grid increases, so does its operation, suggesting additional automation could be beneficial. A subset of machine learning…

Machine Learning · Computer Science 2020-10-19 Brandon L. Thayer , Thomas J. Overbye

Optimized control of quantum networks is essential for enabling distributed quantum applications with strict performance requirements. In near-term architectures with constrained hardware, effective control may determine the feasibility of…

Autonomous vehicles are expected to emerge as a main trend in vehicle development over the next decade. To support autonomous vehicles, ultra-reliable low-latency communications (URLLC) is required between autonomous vehicles and…

Networking and Internet Architecture · Computer Science 2019-03-06 Xiaohu Ge