English
Related papers

Related papers: Multimodal LLM Integrated Semantic Communications …

200 papers

The integration of Artificial Intelligence (AI), particularly Large Language Model (LLM)-based systems, in education has shown promise in enhancing teaching and learning experiences. However, the advent of Multimodal Large Language Models…

Semantic communication (SC) is an emerging intelligent paradigm, offering solutions for various future applications like metaverse, mixed reality, and the Internet of Everything. However, in current SC systems, the construction of the…

Artificial Intelligence · Computer Science 2024-08-06 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Semantic-aware communication is a novel paradigm that draws inspiration from human communication focusing on the delivery of the meaning of messages. It has attracted significant interest recently due to its potential to improve the…

Networking and Internet Architecture · Computer Science 2023-09-06 Yong Xiao , Yiwei Liao , Yingyu Li , Guangming Shi , H. Vincent Poor , Walid Saad , Merouane Debbah , Mehdi Bennis

AI agents based on multimodal large language models (LLMs) are expected to revolutionize human-computer interaction and offer more personalized assistant services across various domains like healthcare, education, manufacturing, and…

Artificial Intelligence · Computer Science 2024-02-20 Minrui Xu , Dusit Niyato , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han , Dong In Kim , Khaled B. Letaief

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

The forthcoming 6G systems are expected to address a wide range of non-stationary tasks. This poses challenges to traditional medium access control (MAC) protocols that are static and predefined. In response, data-driven MAC protocols have…

Information Theory · Computer Science 2023-10-17 Jihong Park , Seung-Woo Ko , Jinho Choi , Seong-Lyun Kim , Mehdi Bennis

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

As communication systems transition from symbol transmission to conveying meaningful information, sixth-generation (6G) networks emphasize semantic communication. This approach prioritizes high-level semantic information, improving…

Signal Processing · Electrical Eng. & Systems 2025-01-27 Zhe Xiang , Fei Yu , Quan Deng , Yuandi Li , Zhiguo Wan

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

The mainstream paradigm of remote sensing image interpretation has long been dominated by vision-centered models, which rely on visual features for semantic understanding. However, these models face inherent limitations in handling…

Artificial Intelligence · Computer Science 2026-01-28 Haifeng Li , Wang Guo , Haiyang Wu , Mengwei Wu , Jipeng Zhang , Qing Zhu , Yu Liu , Xin Huang , Chao Tao

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in representing and understanding diverse modalities. However, they typically focus on modality alignment in a pairwise manner while overlooking structural…

Machine Learning · Computer Science 2025-06-13 Jiajin Liu , Dongzhe Fan , Jiacheng Shen , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Semantic Communication (SemCom) is a promising new paradigm for next-generation communication systems, emphasizing the transmission of core information, particularly in environments characterized by uncertainty, noise, and bandwidth…

Information Theory · Computer Science 2025-02-25 Feibo Jiang , Siwei Tu , Li Dong , Kezhi Wang , Kun Yang , Ruiqi Liu , Cunhua Pan , Jiangzhou Wang

Large Multimodal Models (LMMs) have achieved significant progress by extending large language models. Building on this progress, the latest developments in LMMs demonstrate the ability to generate dense pixel-wise segmentation through the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Li Zhou , Xu Yuan , Zenghui Sun , Zikun Zhou , Jingsong Lan

Inspirational search, the process of exploring designs to inform and inspire new creative work, is pivotal in mobile user interface (UI) design. However, exploring the vast space of UI references remains a challenge. Existing AI-based UI…

Human-Computer Interaction · Computer Science 2025-02-18 Seokhyeon Park , Yumin Song , Soohyun Lee , Jaeyoung Kim , Jinwook Seo

Semantic communication has recently attracted significant interest from both industry and academia due to its potential to transform the existing data-focused communication architecture towards a more generally intelligent and goal-oriented…

Artificial Intelligence · Computer Science 2023-01-16 Yong Xiao , Zijian Sun , Guangming Shi , Dusit Niyato

While Multimodal Large Language Models (MLLMs) show immense promise for achieving truly human-like interactions, progress is hindered by the lack of fine-grained evaluation frameworks for human-centered scenarios, encompassing both the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zheng Qin , Ruobing Zheng , Yabing Wang , Tianqi Li , Yi Yuan , Jingdong Chen , Le Wang

The emergence of sixth-generation networks heralds an intelligent communication ecosystem driven by the rapid proliferation of intelligent services and increasingly complex communication scenarios. However, current physical-layer…

Human-Computer Interaction · Computer Science 2026-04-06 Zhaoyang Li , Shangzhuo Xie , Qianqian Yang

While multimodal large language models (MLLMs) have made significant strides in natural image understanding, their ability to perceive and reason over hyperspectral image (HSI) remains underexplored, which is a vital modality in remote…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xinyu Zhang , Zurong Mai , Qingmei Li , Zjin Liao , Yibin Wen , Yuhang Chen , Xiaoya Fan , Chan Tsz Ho , Bi Tianyuan , Haoyuan Liang , Ruifeng Su , Zihao Qian , Juepeng Zheng , Jianxi Huang , Yutong Lu , Haohuan Fu

The growth of social media, characterized by its multimodal nature, has led to the emergence of diverse phenomena and challenges, which calls for an effective approach to uniformly solve automated tasks. The powerful Large Vision Language…

Computation and Language · Computer Science 2024-10-11 Xinnong Zhang , Haoyu Kuang , Xinyi Mou , Hanjia Lyu , Kun Wu , Siming Chen , Jiebo Luo , Xuanjing Huang , Zhongyu Wei

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across a wide range of vision-language tasks. However, their performance as embodied agents, which requires multi-round dialogue spatial reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xunyi Zhao , Gengze Zhou , Qi Wu