English
Related papers

Related papers: Robust Beam Codebooks for mmWave/THz Systems: Towa…

200 papers

Directional beamforming is a crucial component for realizing robust wireless communication systems using millimeter wave (mmWave) technology. Beam alignment using brute-force search of the space introduces time overhead while location aided…

Signal Processing · Electrical Eng. & Systems 2021-02-23 Vishnu Raj , Nancy Nayak , Sheetal Kalyani

Visual Model-Based Reinforcement Learning (MBRL) promises to encapsulate agent's knowledge about the underlying dynamics of the environment, enabling learning a world model as a useful planner. However, top MBRL agents such as Dreamer often…

Machine Learning · Computer Science 2024-05-31 Ruixiang Sun , Hongyu Zang , Xin Li , Riashat Islam

We introduce robustness in \textit{restless multi-armed bandits} (RMABs), a popular model for constrained resource allocation among independent stochastic processes (arms). Nearly all RMAB techniques assume stochastic dynamics are precisely…

Machine Learning · Computer Science 2022-06-23 Jackson A. Killian , Lily Xu , Arpita Biswas , Milind Tambe

Reinforcement Learning (RL) techniques have been increasingly applied in optimizing control systems. However, their application in quantum systems is hampered by the challenge of performing closed-loop control due to the difficulty in…

Quantum Physics · Physics 2024-02-08 Tanmay Neema , Susmit Jha , Tuhin Sahai

In extremely large-scale multiple input multiple output (XL-MIMO) systems for future sixth-generation (6G) communications, codebook-based beam training stands out as a promising technology to acquire channel state information (CSI). Despite…

Information Theory · Computer Science 2024-03-07 Tianyue Zheng , Jieao Zhu , Qiumo Yu , Yongli Yan , Linglong Dai

Reinforcement learning (RL) policies are prone to high-frequency oscillations, especially undesirable when deploying to hardware in the real-world. In this paper, we identify, categorize, and compare methods from the literature that aim to…

Robotics · Computer Science 2024-10-23 Guilherme Christmann , Ying-Sheng Luo , Hanjaya Mandala , Wei-Chao Chen

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems. Most of the current…

Mathematical Finance · Quantitative Finance 2022-05-31 Huifang Huang , Ting Gao , Yi Gui , Jin Guo , Peng Zhang

Millimeter-wave vehicular networks incur enormous beam-training overhead to enable narrow-beam communications. This paper proposes a learning and adaptation framework in which the dynamics of the communication beams are learned and then…

Machine Learning · Computer Science 2021-10-27 Muddassar Hussain , Nicolo Michelusi

Protecting intellectual property on LLM-generated code necessitates effective watermarking systems that can operate within code's highly structured, syntactically constrained nature. In this work, we introduce CodeTracer, an innovative…

Cryptography and Security · Computer Science 2026-05-26 Zhimeng Guo , Huaisheng Zhu , Siyuan Xu , Hangfan Zhang , Teng Xiao , Minhao Cheng

Reinforcement learning (RL) algorithms have become indispensable tools in artificial intelligence, empowering agents to acquire optimal decision-making policies through interactions with their environment and feedback mechanisms. This study…

Machine Learning · Computer Science 2024-03-28 Ergon Cugler de Moraes Silva

Model Predictive Control (MPC)-based Reinforcement Learning (RL) offers a structured and interpretable alternative to Deep Neural Network (DNN)-based RL methods, with lower computational complexity and greater transparency. However,…

Systems and Control · Electrical Eng. & Systems 2025-07-15 Hossein Nejatbakhsh Esfahani , Javad Mohammadpour Velni

In pursuance of the unused spectrum in higher frequencies, millimeter wave (mmWave) bands have a pivotal role. However, the high path-loss and poor scattering associated with mmWave communications highlight the necessity of employing…

Information Theory · Computer Science 2022-02-09 Nariman Torkzaban , Mohamamd A. , Khojastepour , John S. Baras

Medical Multi-modal Large Language Models (MLLMs) have shown promising clinical performance. However, their sensitivity to real-world input perturbations, such as imaging artifacts and textual errors, critically undermines their clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Dunyuan XU , Xikai Yang , Yaoqian Li , Juzheng Miao , Jinpeng Li , Pheng-Ann Heng

In this paper, we design robust beamforming to guarantee the physical layer security for a multiuser beam division multiple access (BDMA) massive multiple-input multiple-output (MIMO) system, when the channel estimation errors are taken…

Information Theory · Computer Science 2017-11-30 Fengchao Zhu , Feifei Gao , Hai Lin , Shi Jin , Junhui Zhao

In this letter, we investigate a robust beamforming problem for localization-aided millimeter wave (mmWave) communication systems. To handle this problem, we propose a novel restriction and relaxation (R&R) method. The proposed R&R method…

Information Theory · Computer Science 2022-04-01 Junchang Sun , Shuai Ma , Shiyin Li , Ruixin Yang , Minghui Min , Gonzalo Seco-Granados

Wireless applications that use high-reliability low-latency links depend critically on the capability of the system to predict link quality. This dependence is especially acute at the high carrier frequencies used by mmWave and THz systems,…

Information Theory · Computer Science 2021-10-06 Anders E. Kalør , Osvaldo Simeone , Petar Popovski

Multimodal Large Language Models struggle to maintain reliable performance under extreme real-world visual degradations, which impede their practical robustness. Existing robust MLLMs predominantly rely on implicit training/adaptation that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jiaqi Tang , Jianmin Chen , Wei Wei , Xiaogang Xu , Runtao Liu , Xiangyu Wu , Qipeng Xie , Jiafei Wu , Lei Zhang , Qifeng Chen

In this paper, we study the use of robust model independent bounded extremum seeking (ES) feedback control to improve the robustness of deep reinforcement learning (DRL) controllers for a class of nonlinear time-varying systems. DRL has the…

Machine Learning · Computer Science 2026-03-11 Shaifalee Saxena , Alan Williams , Rafael Fierro , Alexander Scheinker

This paper proposes a model-driven deep learning (MDDL)-based channel estimation and feedback scheme for wideband millimeter-wave (mmWave) massive hybrid multiple-input multiple-output (MIMO) systems, where the angle-delay domain channels'…

Information Theory · Computer Science 2022-01-20 Xisuo Ma , Zhen Gao , Feifei Gao , Marco Di Renzo

In this paper, the problem of enhancing the quality of virtual reality (VR) services is studied for an indoor terahertz (THz)/visible light communication (VLC) wireless network. In the studied model, small base stations (SBSs) transmit…

Networking and Internet Architecture · Computer Science 2022-03-29 Yining Wang , Mingzhe Chen , Zhaohui Yang , Walid Saad , Tao luo , Shuguang Cui , H. Vincent Poor