English
Related papers

Related papers: BeamLLM: Vision-Empowered mmWave Beam Prediction w…

200 papers

Achieving deep alignment between vision and language remains a central challenge for Multimodal Large Language Models (MLLMs). These models often fail to fully leverage visual input, defaulting to strong language priors. Our approach first…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Aarti Ghatkesar , Ganesh Venkatesh

Large language models (LLMs) can already identify patterns and reason effectively, yet their variable accuracy hampers adoption in high-stakes decision-making applications. In this paper, we study this issue from a venture capital…

Artificial Intelligence · Computer Science 2025-10-28 Rick Chen , Joseph Ternasky , Aaron Ontoyin Yin , Xianling Mu , Fuat Alican , Yigit Ihlamur

Beam prediction is critical for reducing beam-training overhead in millimeter-wave (mmWave) systems, especially in high-mobility vehicular scenarios. This paper presents a BEV-Fusion based framework that unifies camera, LiDAR, radar, and…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Jiaming Zeng , Cunhua Pan , Haoyang Weng , Ruijing Liu , Hong Ren , Jiangzhou Wang

Millimeter-wave (mmWave) sensing technology holds significant value in human-centric applications, yet the high costs associated with data acquisition and annotation limit its widespread adoption in our daily lives. Concurrently, the rapid…

Machine Learning · Computer Science 2025-09-23 Yifan Yan , Shuai Yang , Xiuzhen Guo , Xiangguang Wang , Wei Chow , Yuanchao Shu , Shibo He

Recent advances in Multi-Modal Large Language Models (M-LLMs) show promising results in video reasoning. Popular Multi-Modal Large Language Model (M-LLM) frameworks usually apply naive uniform sampling to reduce the number of video frames…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Kai Hu , Feng Gao , Xiaohan Nie , Peng Zhou , Son Tran , Tal Neiman , Lingyun Wang , Mubarak Shah , Raffay Hamid , Bing Yin , Trishul Chilimbi

Millimeter-wave (mmWave) and terahertz (THz) communication systems typically deploy large antenna arrays to guarantee sufficient receive signal power. The beam training overhead associated with these arrays, however, make it hard for these…

Signal Processing · Electrical Eng. & Systems 2022-05-25 Gouranga Charan , Andrew Hredzak , Christian Stoddard , Benjamin Berrey , Madhav Seth , Hector Nunez , Ahmed Alkhateeb

We propose LightLLM, a model that fine tunes pre-trained large language models (LLMs) for light-based sensing tasks. It integrates a sensor data encoder to extract key features, a contextual prompt to provide environmental information, and…

Machine Learning · Computer Science 2024-11-26 Jiawei Hu , Hong Jia , Mahbub Hassan , Lina Yao , Brano Kusy , Wen Hu

Millimeter wave (mmWave) and terahertz (THz) drones have the potential to enable several futuristic applications such as coverage extension, enhanced security monitoring, and disaster management. However, these drones need to deploy large…

Signal Processing · Electrical Eng. & Systems 2022-11-15 Gouranga Charan , Andrew Hredzak , Ahmed Alkhateeb

Accurately aligning millimeter-wave (mmWave) and terahertz (THz) narrow beams is essential to satisfy reliability and high data rates of 5G and beyond wireless communication systems. However, achieving this objective is difficult,…

Information Theory · Computer Science 2023-08-22 Tawfik Osman , Gouranga Charan , Ahmed Alkhateeb

This work investigates the use of machine learning applied to the beam tracking problem in 5G networks and beyond. The goal is to decrease the overhead associated to MIMO millimeter wave beamforming. In comparison to beam selection (also…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Ailton Oliveira , Daniel Suzuki , Sávio Bastos , Ilan Correa , Aldebaro Klautau

The rapid evolution of wireless technologies and the growing complexity of network infrastructures necessitate a paradigm shift in how communication networks are designed, configured, and managed. Recent advancements in Large Language…

Networking and Internet Architecture · Computer Science 2024-06-18 Jiawei Shao , Jingwen Tong , Qiong Wu , Wei Guo , Zijian Li , Zehong Lin , Jun Zhang

Beamforming techniques are considered as essential parts to compensate the severe path loss in millimeter-wave (mmWave) communications by adopting large antenna arrays and formulating narrow beams to obtain satisfactory received powers.…

Networking and Internet Architecture · Computer Science 2024-02-05 Muhammad Baqer Mollah , Honggang Wang , Hua Fang

This research introduces a transformative framework for integrating Vision-Enhanced Large Language Models (LLMs) with advanced transformer-based architectures to tackle challenges in high-resolution image synthesis and multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Karthikeya KV

Millimeter-wave communication faces two critical challenges: propagation losses requiring costly narrow-beam alignment, and penetration losses causing link failures from blocked line-of-sight paths. We address propagation loss through a…

Signal Processing · Electrical Eng. & Systems 2026-05-07 Sachira Karunasena , Erfan Khordad , Tom Drummond , Rajitha Senanayake

Large language models (LLMs) have been widely adopted due to their remarkable performance across various applications, driving the accelerated development of a large number of diverse models. However, these individual LLMs show limitations…

Computation and Language · Computer Science 2025-06-13 Kaushal Kumar Maurya , KV Aditya Srivatsa , Ekaterina Kochmar

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Multispectral pedestrian detection is a crucial component in various critical applications. However, a significant challenge arises due to the misalignment between these modalities, particularly under real-world conditions where data often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Taeheon Kim , Sangyun Chung , Youngjoon Yu , Yong Man Ro

Large language model (LLM) has recently been considered a promising technique for many fields. This work explores LLM-based wireless network optimization via in-context learning. To showcase the potential of LLM technologies, we consider…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xue Liu , Charlie Zhang

Fast and precise beam alignment is crucial to support high-quality data transmission in millimeter wave (mmWave) communication systems. In this work, we propose a novel deep learning based hierarchical beam alignment method that learns two…

Signal Processing · Electrical Eng. & Systems 2022-09-09 Junyi Yang , Weifeng Zhu , Meixia Tao

Beam management (BM) protocols are critical for establishing and maintaining connectivity between network radio nodes and User Equipments (UEs). In Distributed Multiple Input Multiple Output systems (D-MIMO), a number of access points…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Karthik R M , Dhiraj Nagaraja Hegde , Muris Sarajlic , Abhishek Sarkar