English
Related papers

Related papers: Multimodal LLM Integrated Semantic Communications …

200 papers

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Multimodal large language models (MLLMs) have been integrated into visual interpretation applications to support Blind and Low Vision (BLV) users because of their accuracy and ability to provide rich, human-like interpretations. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Ricardo Gonzalez Penuela , Felipe Arias-Russi , Victor Capriles

The rapid advancement toward sixth-generation (6G) wireless networks has significantly intensified the complexity and scale of optimization problems, including resource allocation and trajectory design, often formulated as combinatorial…

Networking and Internet Architecture · Computer Science 2025-09-09 Bisheng Wei , Ruihong Jiang , Ruichen Zhang , Yinqiu Liu , Dusit Niyato , Yaohua Sun , Yang Lu , Yonghui Li , Shiwen Mao , Chau Yuen , Marco Di Renzo , Mugen Peng

Large Language Models(LLMs) have revolutionized text generation and multimodal perception,but their capabilities in 3D content generation remain underexplored. Existing methods compromise by producing either low-resolution meshes or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Junming Huang , Chi Wang , Letian Li , Guangkai Xu , Donglin Huang , Hao Chen , Qiang Dai , Weiwei Xu

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading…

Machine Learning · Computer Science 2026-04-30 Cyril Shih-Huan Hsu , Wig Yuan-Cheng Cheng , Chrysa Papagianni

Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Qiyuan Chen , Xianhao Chen , Zhe Chen , Kaibin Huang

Semantic-oriented communication has been considered as a promising to boost the bandwidth efficiency by only transmitting the semantics of the data. In this paper, we propose a multi-level semantic aware communication system for wireless…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Mingyang Sun , Jiming Chen

Large language models (LLMs) hold significant promise in advancing network management and orchestration in 6G and beyond networks. However, existing LLMs are limited in domain-specific knowledge and their ability to handle multi-modal…

Networking and Internet Architecture · Computer Science 2024-10-25 Ahmad M. Nazar , Abdulkadir Celik , Mohamed Y. Selim , Asmaa Abdallah , Daji Qiao , Ahmed M. Eltawil

With the bloom of Large Language Models (LLMs), Multimodal Large Language Models (MLLMs) that incorporate LLMs with pre-trained vision models have recently demonstrated impressive performance across diverse vision-language tasks. However,…

Computation and Language · Computer Science 2026-01-13 Ziyue Wang , Chi Chen , Yiqi Zhu , Fuwen Luo , Peng Li , Ming Yan , Ji Zhang , Fei Huang , Maosong Sun , Yang Liu

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

The rapid evolution of communication networks in recent decades has intensified the need for advanced Network and Service Management (NSM) strategies to address the growing demands for efficiency, scalability, enhanced performance, and…

With the exponential surge in traffic data and the pressing need for ultra-low latency in emerging intelligence applications, it is envisioned that 6G networks will demand disruptive communication technologies to foster ubiquitous…

Information Theory · Computer Science 2024-08-12 Youlong Wu , Yuanmin Shi , Shuai Ma , Chunxiao Jiang , Wei Zhang , Khaled B. Letaief

Embodied agents operating in smart homes must understand human behavior through diverse sensory inputs and communicate via natural language. While Vision-Language Models (VLMs) have enabled impressive language-grounded perception, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chuhao Zhou , Jianfei Yang

The telecommunications and networking domain stands at the precipice of a transformative era, driven by the necessity to manage increasingly complex, hierarchical, multi administrative domains (i.e., several operators on the same path) and…

Networking and Internet Architecture · Computer Science 2025-06-30 Viswanath Kumarskandpriya , Abdulhalim Dandoush , Abbas Bradai , Ali Belgacem

Traditional single-modal sensing systems-based solely on either radio frequency (RF) or visual data-struggle to cope with the demands of complex and dynamic environments. Furthermore, single-device systems are constrained by limited…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Yubo Peng , Luping Xiang , Bingxin Zhang , Kun Yang

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Large Language Models (LLMs) have emerged as powerful tools for automating complex reasoning and decision-making tasks. In telecommunications, they hold the potential to transform network optimization, automate troubleshooting, enhance…

Large language models (LLMs) have received considerable attention recently due to their outstanding comprehension and reasoning capabilities, leading to great progress in many fields. The advancement of LLM techniques also offers promising…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Hao Zhou , Chengming Hu , Ye Yuan , Yufei Cui , Yili Jin , Can Chen , Haolun Wu , Dun Yuan , Li Jiang , Di Wu , Xue Liu , Charlie Zhang , Xianbin Wang , Jiangchuan Liu