English
Related papers

Related papers: Q-Learning for 3D Coverage in VCSEL-based Optical …

200 papers

Real-time multi-view 3D reconstruction is a mission-critical application for key edge-native use cases, such as fire rescue, where timely and accurate 3D scene modeling enables situational awareness and informed decision-making. However,…

Machine Learning · Computer Science 2025-10-13 Motahare Mounesan , Sourya Saha , Houchao Gan , Md. Nurul Absur , Saptarshi Debroy

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

Millimeter wave communications are essential for modern wireless networks. It supports high data rates but suffers from severe path loss, which requires precise beam alignment to maintain reliable links. This beam management is particularly…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Ailton Oliveira , Amir Khatibi , Daniel Suzuki , Ilan Correa , José Rezende , Aldebaro Klautau

In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence. Therefore, a…

Signal Processing · Electrical Eng. & Systems 2018-06-14 Philip Soeffker , Dimitri Block , Nico Wiebusch , Uwe Meier

We propose a deep reinforcement learning (DRL) approach for a full-duplex (FD) transmission that predicts the phase shifts of the reconfigurable intelligent surface (RIS), base station (BS) active beamformers, and the transmit powers to…

Information Theory · Computer Science 2024-06-21 Nancy Nayak , Sheetal Kalyani , Himal A. Suraweera

Deploying visual reinforcement learning (RL) policies in real-world manipulation is often hindered by camera viewpoint changes. A policy trained from a fixed front-facing camera may fail when the camera is shifted -- an unavoidable…

Robotics · Computer Science 2026-03-13 Zheng Li , Pei Qu , Yufei Jia , Shihui Zhou , Haizhou Ge , Jiahang Cao , Jinni Zhou , Guyue Zhou , Jun Ma

Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT)…

Information Theory · Computer Science 2022-02-07 Omid Esrafilian , Harald Bayerlein , David Gesbert

Multiple-input multiple-output (MIMO) wireless systems conventionally use high-resolution analog-to-digital converters (ADCs) at the receiver side to faithfully digitize received signals prior to digital signal processing. However, the…

Information Theory · Computer Science 2025-04-29 Marian Temprana Alonso , Dongsheng Luo , Farhad Shirani

6G networks are composed of subnetworks expected to meet ultra-reliable low-latency communication (URLLC) requirements for mission-critical applications such as industrial control and automation. An often-ignored aspect in URLLC is…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Fateme Salehi , Aamir Mahmood , Sarder Fakhrul Abedin , Kyi Thar , Mikael Gidlund

Dynamic radio resource management (RRM) in wireless networks presents significant challenges, particularly in the context of Radio Access Network (RAN) slicing. This technology, crucial for catering to varying user requirements, often…

Information Theory · Computer Science 2023-12-19 Kun Yang , Shu-ping Yeh , Menglei Zhang , Jerry Sydir , Jing Yang , Cong Shen

In this work, deep reinforcement learning (DRL) is applied to active flow control (AFC) over a threedimensional SD7003 wing at a Reynolds number of Re = 60,000 and angle of attack of AoA = 14 degrees. In the uncontrolled baseline case, the…

Computational Engineering, Finance, and Science · Computer Science 2025-09-15 R. Montalà , B. Font , P. Suárez , J. Rabault , O. Lehmkuhl , R. Vinuesa , I. Rodriguez

Wireless support of virtual reality (VR) has challenges when a network has multiple users, particularly for 3D VR gaming, digital AI avatars, and remote team collaboration. This work addresses these challenges through investigation of the…

Networking and Internet Architecture · Computer Science 2025-07-28 Muhammad Ahmed Mohsin , Sagnik Bhattacharya , Abhiram Gorle , Muhammad Ali Jamshed , John M. Cioffi

Deep learning (DL) has seen great success in the computer vision (CV) field, and related techniques have been used in security, healthcare, remote sensing, and many other fields. As a parallel development, visual data has become universal…

Signal Processing · Electrical Eng. & Systems 2020-12-03 Yu Tian , Gaofeng Pan , Mohamed-Slim Alouini

Optical wireless communication is an effective potential solution for enabling high speed next generation cellular networks. In this paper, laser sources, in particular, vertical-cavity surface-emitting (VCSEL) lasers are used for data…

Signal Processing · Electrical Eng. & Systems 2021-05-26 Khulood Alazwary , Ahmad Adnan Qidan , Taisir El-Gorashi , Jaafar M. H. Elmirghani

Although two-stage object detectors have continuously advanced the state-of-the-art performance in recent years, the training process itself is far from crystal. In this work, we first point out the inconsistency problem between the fixed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Hongkai Zhang , Hong Chang , Bingpeng Ma , Naiyan Wang , Xilin Chen

The growing performance demands and higher deployment densities of next-generation wireless systems emphasize the importance of adopting strategies to manage the energy efficiency of mobile networks. In this demo, we showcase a framework…

Networking and Internet Architecture · Computer Science 2026-01-07 Matteo Bordin , Andrea Lacava , Michele Polese , Francesca Cuomo , Tommaso Melodia

We introduce a novel deep reinforcement learning (DRL) approach to jointly optimize transmit beamforming and reconfigurable intelligent surface (RIS) phase shifts in a multiuser multiple input single output (MU-MISO) system to maximize the…

Networking and Internet Architecture · Computer Science 2023-03-30 Baturay Saglam , Doga Gurgunoglu , Suleyman S. Kozat

This paper addresses the problem of traversing through unknown, tilted, and narrow gaps for quadrotors using Deep Reinforcement Learning (DRL). Previous learning-based methods relied on accurate knowledge of the environment, including the…

Robotics · Computer Science 2023-07-03 Yuhan Xie , Minghao Lu , Rui Peng , Peng Lu

The ongoing energy transition drives the development of decentralised renewable energy sources, which are heterogeneous and weather-dependent, complicating their integration into energy systems. This study tackles this issue by introducing…

Machine Learning · Computer Science 2024-07-01 Marine Cauz , Adrien Bolland , Nicolas Wyrsch , Christophe Ballif

Reconfigurable intelligent surface (RIS) technology is receiving significant attention as a key enabling technology for 6G communications, with much attention given to coverage infill and wireless power transfer. However, relatively little…

Signal Processing · Electrical Eng. & Systems 2023-12-27 Wei Wang , Peizheng Li , Angela Doufexi , Mark A Beach