English
Related papers

Related papers: Multimodal LLM Integrated Semantic Communications …

200 papers

Emerging services such as augmented reality (AR) and virtual reality (VR) have increased the volume of data transmitted in wireless communication systems, revealing the limitations of traditional Shannon theory. To address these…

Networking and Internet Architecture · Computer Science 2025-04-15 Shavbo Salehi , Melike Erol-Kantarci , Dusit Niyato

Semantic communication is an emerging paradigm that focuses on understanding and delivering semantics, or meaning of messages. Most existing semantic communication solutions define semantic meaning as the meaning of object labels recognized…

Networking and Internet Architecture · Computer Science 2022-03-17 Jingming Liang , Yong Xiao , Yingyu Li , Guangming Shi , Mehdi Bennis

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

Computation and Language · Computer Science 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

The transition to 6G networks promises unprecedented advancements in wireless communication, with increased data rates, ultra-low latency, and enhanced capacity. However, the complexity of managing and optimizing these next-generation…

Networking and Internet Architecture · Computer Science 2024-12-16 Asmaa Abdallah , Abdullatif Albaseer , Abdulkadir Celik , Mohamed Abdallah , Ahmed M. Eltawil

Large Language Model (LLM)-based autonomous agents are expected to play a vital role in the evolution of 6G networks, by empowering real-time decision-making related to management and service provisioning to end-users. This shift…

Artificial Intelligence · Computer Science 2025-09-04 Ilias Chatzistefanidis , Navid Nikaein

People with blindness and low vision (pBLV) face significant challenges, struggling to navigate environments and locate objects due to limited visual cues. Spatial reasoning is crucial for these individuals, as it enables them to understand…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Alexey Magay , Dhurba Tripathi , Yu Hao , Yi Fang

The growing adoption of augmented and virtual reality (AR and VR) technologies in industrial training and on-the-job assistance has created new opportunities for intelligent, context-aware support systems. As workers perform complex tasks…

Human-Computer Interaction · Computer Science 2025-11-18 Mahya Qorbani , Kamran Paynabar , Mohsen Moghaddam

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Semantic communication is a novel communication paradigm which draws inspiration from human communication focusing on the delivery of the meaning of a message to the intended users. It has attracted significant interest recently due to its…

Networking and Internet Architecture · Computer Science 2022-03-17 Yong Xiao , Yingyu Li , Guangming Shi , H. Vincent Poor

In the past year, Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in tasks such as visual question answering, visual understanding and reasoning. However, the extensive model size and high training and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yizhang Jin , Jian Li , Yexin Liu , Tianjun Gu , Kai Wu , Zhengkai Jiang , Muyang He , Bo Zhao , Xin Tan , Zhenye Gan , Yabiao Wang , Chengjie Wang , Lizhuang Ma

Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Tilahun M. Getu , Georges Kaddoum , Mehdi Bennis

Strong Artificial Intelligence (Strong AI) or Artificial General Intelligence (AGI) with abstract reasoning ability is the goal of next-generation AI. Recent advancements in Large Language Models (LLMs), along with the emerging field of…

Computation and Language · Computer Science 2024-01-19 Yiqi Wang , Wentao Chen , Xiaotian Han , Xudong Lin , Haiteng Zhao , Yongfei Liu , Bohan Zhai , Jianbo Yuan , Quanzeng You , Hongxia Yang

Agent communication protocols are becoming critical infrastructure for large language model (LLM) systems that must use tools, coordinate with other agents, and operate across heterogeneous environments. This work presents a human-inspired…

Networking and Internet Architecture · Computer Science 2026-04-14 Dun Yuan , Fuyuan Lyu , Ye Yuan , Weixu Zhang , Bowei He , Jiayi Geng , Linfeng Du , Zipeng Sun , Yankai Chen , Changjiang Han , Jikun Kang , Xi Chen , Haolun Wu , Xue Liu

While semantic communications have shown the potential in the case of single-modal single-users, its applications to the multi-user scenario remain limited. In this paper, we investigate deep learning (DL) based multi-user semantic…

Signal Processing · Electrical Eng. & Systems 2021-12-21 Huiqiang Xie , Zhijin Qin , Xiaoming Tao , Khaled B. Letaief

Most of the existing multi-modal models, hindered by their incapacity to adeptly manage interleaved image-and-text inputs in multi-image, multi-round dialogues, face substantial constraints in resource allocation for training and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Zhewei Yao , Xiaoxia Wu , Conglong Li , Minjia Zhang , Heyang Qin , Olatunji Ruwase , Ammar Ahmad Awan , Samyam Rajbhandari , Yuxiong He

Large Language Models (LLMs) demonstrate substantial potential across a diverse array of domains via request serving. However, as trends continue to push for expanding context sizes, the autoregressive nature of LLMs results in highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-08 Bin Lin , Chen Zhang , Tao Peng , Hanyu Zhao , Wencong Xiao , Minmin Sun , Anmin Liu , Zhipeng Zhang , Lanbo Li , Xiafei Qiu , Shen Li , Zhigang Ji , Tao Xie , Yong Li , Wei Lin

The emergence of GPT-4o-like large multimodal models (LMMs) has raised the exploration of integrating text, vision, and speech modalities to support more flexible multimodal interaction. Existing LMMs typically concatenate representation of…

Artificial Intelligence · Computer Science 2025-06-24 Shaolei Zhang , Shoutao Guo , Qingkai Fang , Yan Zhou , Yang Feng

Millimeter-wave (mmWave) and terahertz (THz) communication systems require large antenna arrays and use narrow directive beams to ensure sufficient receive signal power. However, selecting the optimal beams for these large antenna arrays…

Information Theory · Computer Science 2024-02-23 Shoaib Imran , Gouranga Charan , Ahmed Alkhateeb

Large Language Models (LLMs) are being employed widely to automate tasks across the software development life-cycle. It is, however, unclear whether these tasks are performed consistently with respect to the semantics of the artefacts being…

Software Engineering · Computer Science 2026-05-15 Mohammad Reza Mousavi