English
Related papers

Related papers: Doubly-Dynamic ISAC Precoding for Vehicular Networ…

200 papers

Integrated sensing and communication (ISAC) is a promising technology for 6G, with the goal of providing end-to-end information processing and inherent perception capabilities for future communication systems. Within ISAC emerging…

Signal Processing · Electrical Eng. & Systems 2024-03-04 Zhengyu Zhang , Ruisi He , Bo Ai , Mi Yang , Xuejian Zhang , Ziyi Qi , Yuan Yuan

This paper introduces an approach to harness digital twin (DT) technology in the realm of integrated sensing and communications (ISAC) in the sixth-generation (6G) Internet-of-everything (IoE) applications. We consider moving targets in a…

Systems and Control · Electrical Eng. & Systems 2024-08-02 Weihang Ding , Zhaohui Yang , Mingzhe Chen , Yuchen Liu , Mohammad Shikh-Bahaei

This letter presents a deep reinforcement learning (DRL) approach for transmission design to optimize the energy efficiency in vehicle-to-vehicle (V2V) communication links. Considering the dynamic environment of vehicular communications,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Zhengpeng Wang , Yanqun Tang , Yingzhe Mao , Tao Wang , Xiunan Huang

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

This paper considers a joint communication and sensing technique for enhancing situational awareness in practical battlefield scenarios. In particular, we propose an aerial reconfigurable intelligent surface (ARIS)-assisted integrated…

Systems and Control · Electrical Eng. & Systems 2025-02-04 Hyunsang Cho , Seonghoon Yoo , Bang Chul Jung , Joonhyuk Kang

We study the problem of Distributionally Robust Constrained RL (DRC-RL), where the goal is to maximize the expected reward subject to environmental distribution shifts and constraints. This setting captures situations where training and…

Machine Learning · Computer Science 2024-06-25 Zhengfei Zhang , Kishan Panaganti , Laixi Shi , Yanan Sui , Adam Wierman , Yisong Yue

Constrained multi-agent reinforcement learning offers the framework to design scalable and almost surely feasible solutions for teams of agents operating in dynamic environments to carry out conflicting tasks. We address the challenges of…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Leopoldo Agorio , Sean Van Alen , Santiago Paternain , Miguel Calvo-Fullana , Juan Andres Bazerque

Distributed integrated sensing and communication (D-ISAC) enables multiple spatially distributed nodes to cooperatively perform sensing and communication. However, achieving coherent cooperation across distributed nodes is challenging due…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Seonghoon Yoo , Seulhyun Kwon , Kawon Han , Elaheh Ataeebojd , Mehdi Rasti , Joonhyuk Kang

Overtaking on two-lane roads is a great challenge for autonomous vehicles, as oncoming traffic appearing on the opposite lane may require the vehicle to change its decision and abort the overtaking. Deep reinforcement learning (DRL) has…

Robotics · Computer Science 2023-08-21 Jinxiong Lu , Gokhan Alcan , Ville Kyrki

Integrated sensing and communication (ISAC) and intelligent reflecting surface (IRS) are viewed as promising technologies for future generations of wireless networks. This paper investigates the channel estimation problem in an IRS-assisted…

Signal Processing · Electrical Eng. & Systems 2024-04-09 Yu Liu , Ibrahim Al-Nahhal , Octavia A. Dobre , Fanggang Wang

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

Integrated sensing and communication (ISAC) has been recognized as a key technology in sixth-generation wireless networks, and the additional spatial degrees of freedom obtained by movable antenna (MA) technology can significantly improve…

Signal Processing · Electrical Eng. & Systems 2025-12-05 Luyang Sun , Zhiqing Wei , Haotian Liu , Kan Yu , Zhendong Li , Zhiyong Feng

Green hydrogen has multiple use cases and is produced from renewable energy, such as solar or wind energy. It can be stored in large quantities, decoupling renewable energy generation from its use, and is therefore considered essential for…

Optimization and Control · Mathematics 2026-01-01 Umur Hasturk , Albert H. Schrotenboer , Kees Jan Roodbergen , Evrim Ursavas

Integrated sensing and communication (ISAC) is a promising technology to fully utilize the precious spectrum and hardware in wireless systems, which has attracted significant attentions recently. This paper studies ISAC for the important…

Signal Processing · Electrical Eng. & Systems 2021-08-17 Zhiqiang Xiao , Yong Zeng

Continuous reinforcement learning such as DDPG and A3C are widely used in robot control and autonomous driving. However, both methods have theoretical weaknesses. While DDPG cannot control noises in the control process, A3C does not satisfy…

Machine Learning · Computer Science 2019-08-09 Tianhao Chen , Limei Cheng , Yang Liu , Wenchuan Jia , Shugen Ma

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

This paper presents a Digital Twin (DT) framework for the remote control of an Autonomous Guided Vehicle (AGV) within a Network Control System (NCS). The AGV is monitored and controlled using Integrated Sensing and Communications (ISAC). In…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Van-Phuc Bui , Pedro Maia de Sant Ana , Soheil Gherekhloo , Shashi Raj Pandey , Petar Popovski

Integrated sensing and communication (ISAC) systems promise efficient spectrum utilization by jointly supporting radar sensing and wireless communication. This paper presents a deep learning-driven framework for enhancing physical-layer…

Real-time path planning in constrained environments remains a fundamental challenge for autonomous systems. Traditional classical planners, while effective under perfect perception assumptions, are often sensitive to real-world perception…

Robotics · Computer Science 2026-02-02 Feng Tao , Luca Paparusso , Chenyi Gu , Robin Koehler , Chenxu Wu , Xinyu Huang , Christian Juette , David Paz , Ren Liu

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

Machine Learning · Computer Science 2025-09-23 Aohan Li , Miyu Tsuzuki