English
Related papers

Related papers: Multimodal LLM Integrated Semantic Communications …

200 papers

Multimodal signals, including text, audio, image, and video, can be integrated into Semantic Communication (SC) systems to provide an immersive experience with low latency and high quality at the semantic level. However, the multimodal SC…

Artificial Intelligence · Computer Science 2024-08-06 Feibo Jiang , Li Dong , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

The surge in connected devices in 6G with typical complex tasks requiring multi-user cooperation, such as smart agriculture and smart cities, poses significant challenges to unsustainable traditional communication. Fortunately, the booming…

Networking and Internet Architecture · Computer Science 2025-02-24 Wanting Yang , Zehui Xiong , Shiwen Mao , Tony Q. S. Quek , Ping Zhang , Merouane Debbah , Rahim Tafazolli

Multi-modal Large Language Models (MLLMs) are capable of precisely extracting high-level semantic information from multi-modal data, enabling multi-task understanding and generation. This capability facilitates more efficient and…

Information Theory · Computer Science 2025-02-25 Feibo Jiang , Siwei Tu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan

Large language models (LLMs) and large multimodal models (LMMs) have achieved unprecedented breakthrough, showcasing remarkable capabilities in natural language understanding, generation, and complex reasoning. This transformative potential…

Machine Learning · Computer Science 2025-10-24 Hyun Jong Yang , Hyunsoo Kim , Hyeonho Noh , Seungnyun Kim , Byonghyo Shim

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

Large language models (LLMs) have recently demonstrated state-of-the-art performance across various natural language processing (NLP) tasks, achieving near-human levels in multiple language understanding challenges and aligning closely with…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Zhenyi Wang , Li Zou , Shengyun Wei , Kai Li , Feifan Liao , Haibo Mi , Rongxuan Lai

The remarkable success of Large Language Models (LLMs) in understanding and generating various data types, such as images and text, has demonstrated their ability to process and extract semantic information across diverse domains. This…

Signal Processing · Electrical Eng. & Systems 2025-01-23 Soheyb Ribouh , Osama Saleem

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissions with stringent latency and reliability requirements.…

Networking and Internet Architecture · Computer Science 2022-12-15 Jihong Park , Jinho Choi , Seong-Lyun Kim , Mehdi Bennis

Emerging intelligent service scenarios in 6G communication impose stringent requirements for low latency, high reliability, and privacy preservation. Generative large language models (LLMs) are gradually becoming key enablers for the…

Networking and Internet Architecture · Computer Science 2025-05-21 Pengyan Zhu , Tingting Yang

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

Task-oriented semantic communication has emerged as a fundamental approach for enhancing performance in various communication scenarios. While recent advances in Generative Artificial Intelligence (GenAI), such as Large Language Models…

Artificial Intelligence · Computer Science 2025-05-06 Baoxia Du , Hongyang Du , Dusit Niyato , Ruidong Li

Conventional 5G network management mechanisms, that operate in isolated silos across different network segments, will experience significant limitations in handling the unprecedented hyper-complexity and massive scale of the sixth…

Networking and Internet Architecture · Computer Science 2025-02-10 Abdelaali Chaoub , Muslim Elkotob

Semantic Communication (SC) has emerged as a novel communication paradigm in recent years, successfully transcending the Shannon physical capacity limits through innovative semantic transmission concepts. Nevertheless, extant Image Semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Feibo Jiang , Chuanguo Tang , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan

The next generation of wireless communications seeks to deeply integrate artificial intelligence (AI) with user-centric communication networks, with the goal of developing AI-native networks that more accurately address user requirements.…

Networking and Internet Architecture · Computer Science 2025-04-17 Kuiyuan Ding , Caili Guo , Yang Yang , Wuxia Hu , Yonina C. Eldar

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang

This paper introduces SA-OOSC, a multimodal large language models (MLLM)-distilled semantic communication framework that achieves efficient semantic coding with scenario-aware importance allocations. This approach addresses a critical…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Feifan Zhang , Yuyang Du , Yifan Xiang , Xiaoyan Liu , Soung Chang Liew

In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic…

Networking and Internet Architecture · Computer Science 2025-05-30 Guangyuan Liu , Yinqiu Liu , Jiacheng Wang , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Abbas Jamalipour
‹ Prev 1 2 3 10 Next ›