English
Related papers

Related papers: Multi-Modal Transformer and Reinforcement Learning…

200 papers

Millimeter wave communications are essential for modern wireless networks. It supports high data rates but suffers from severe path loss, which requires precise beam alignment to maintain reliable links. This beam management is particularly…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Ailton Oliveira , Amir Khatibi , Daniel Suzuki , Ilan Correa , José Rezende , Aldebaro Klautau

With the increase in demand for Internet of Things (IoT) applications, the number of IoT devices has drastically grown, making spectrum resources seriously insufficient. Transmission collisions and retransmissions increase power…

Networking and Internet Architecture · Computer Science 2025-01-23 Ryotai Airiyoshi , Mikio Hasegawa , Tomoaki Ohtsuki , Aohan Li

Beam selection for joint transmission in cell-free massive multi-input multi-output systems faces the problem of extremely high training overhead and computational complexity. The traffic-aware quality of service additionally complicates…

Information Theory · Computer Science 2023-09-21 Chenyang Wang , Cheng Zhang , Fan Meng , Yongming Huang , Wei Zhang

From out-competing grandmasters in chess to informing high-stakes healthcare decisions, emerging methods from artificial intelligence are increasingly capable of making complex and strategic decisions in diverse, high-dimensional, and…

Computers and Society · Computer Science 2024-03-05 Melissa Chapman , Lily Xu , Marcus Lapeyrolerie , Carl Boettiger

Learning modality-fused representations and processing unaligned multimodal sequences are meaningful and challenging in multimodal emotion recognition. Existing approaches use directional pairwise attention or a message hub to fuse…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ziwang Fu , Feng Liu , Hanyang Wang , Siyuan Shen , Jiahao Zhang , Jiayin Qi , Xiangling Fu , Aimin Zhou

The use of Machine Learning (ML) and Artificial Intelligence (AI) in smart transportation networks has increased significantly in the last few years. Among these ML and AI approaches, Reinforcement Learning (RL) has been shown to be a very…

Artificial Intelligence · Computer Science 2025-09-22 Federico Taschin , Abderrahmane Lazaraq , Ozan K. Tonguz , Inci Ozgunes

Beam management (BM) protocols are critical for establishing and maintaining connectivity between network radio nodes and User Equipments (UEs). In Distributed Multiple Input Multiple Output systems (D-MIMO), a number of access points…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Karthik R M , Dhiraj Nagaraja Hegde , Muris Sarajlic , Abhishek Sarkar

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopted, is not well…

Artificial Intelligence · Computer Science 2022-01-03 Cathy Wu , Aboudy Kreidieh , Kanaad Parvate , Eugene Vinitsky , Alexandre M Bayen

While quadruped robots usually have good stability and load capacity, bipedal robots offer a higher level of flexibility / adaptability to different tasks and environments. A multi-modal legged robot can take the best of both worlds. In…

Robotics · Computer Science 2022-02-25 Chen Yu , Andre Rosendo

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

Reinforcement learning (RL) has proven effective in incentivizing the reasoning abilities of large language models (LLMs), but suffers from severe efficiency challenges due to its trial-and-error nature. While the common practice employs…

Computation and Language · Computer Science 2025-10-17 Liang Chen , Xueting Han , Li Shen , Jing Bai , Kam-Fai Wong

Millimeter-wave (mmWave) hybrid analog-digital beamforming is a promising approach to satisfy the low-latency constraint in multiple unmanned aerial vehicles (UAVs) systems, which serve as network infrastructure for flexible deployment.…

Information Theory · Computer Science 2019-10-31 Hsiao-Lan Chiang , Kwang-Cheng Chen , Wolfgang Rave , Mostafa Khalili Marandi , Gerhard Fettweis

One of the most critical aspects of multimodal Reinforcement Learning (RL) is the effective integration of different observation modalities. Having robust and accurate representations derived from these modalities is key to enhancing the…

Robotics · Computer Science 2024-06-21 Fotios Lygerakis , Vedant Dave , Elmar Rueckert

Recent advances in multimodal reward modeling have been largely driven by a paradigm shift from discriminative to generative approaches. Building on this progress, recent studies have further employed reinforcement learning from verifiable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chenglong Wang , Yifu Huo , Yang Gan , Qiaozhi He , Qi Meng , Bei Li , Yan Wang , Junfu Liu , Tianhua Zhou , Jingbo Zhu , Tong Xiao

In this work, we first describe a framework for the application of Reinforcement Learning (RL) control to a radar system that operates in a congested spectral setting. We then compare the utility of several RL algorithms through a…

Machine Learning · Computer Science 2020-06-24 Charles E. Thornton , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

Active perception describes a broad class of techniques that couple planning and perception systems to move the robot in a way to give the robot more information about the environment. In most robotic systems, perception is typically…

Advancements in 6G wireless technology have elevated the importance of beamforming, especially for attaining ultra-high data rates via millimeter-wave (mmWave) frequency deployment. Although promising, mmWave bands require substantial beam…

Networking and Internet Architecture · Computer Science 2024-07-31 Avi Deb Raha , Kitae Kim , Apurba Adhikary , Mrityunjoy Gain , Zhu Han , Choong Seon Hong

Restricted Boltzmann machines (RBMs) are a powerful class of generative models, but their training requires computing a gradient that, unlike supervised backpropagation on typical loss functions, is notoriously difficult even to…

Machine Learning · Computer Science 2020-11-03 Haik Manukian , Yan Ru Pei , Sean R. B. Bearden , Massimiliano Di Ventra

In this letter, we study an efficient multi-beam training method for multiuser millimeter-wave communication systems. Unlike the conventional single-beam training method that relies on exhaustive search, multi-beam training design faces a…

Signal Processing · Electrical Eng. & Systems 2026-01-08 Weijia Wang , Changsheng You , Xiaodan Shao , Rui Zhang