中文
相关论文

相关论文: Visual Language Model based Cross-modal Semantic C…

200 篇论文

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

This paper studies the problem of the lightweight image semantic communication system that is deployed on Internet of Things (IoT) devices. In the considered system model, devices must use semantic communication techniques to support user…

神经与进化计算 · 计算机科学 2024-01-17 Guoxin Ma , Haonan Tong , Nuocheng Yang , Changchuan Yin

The "style trap" poses a significant challenge for Large Vision-Language Models (LVLMs), hindering robust semantic understanding across diverse visual styles, especially in in-context learning (ICL). Existing methods often fail to…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Aya Nakayama , Brian Wong , Yuji Nishimura , Kaito Tanaka

Semantic communication, an intelligent communication paradigm that aims to transmit useful information in the semantic domain, is facilitated by deep learning techniques. Robust semantic features can be learned and transmitted in an analog…

信号处理 · 电气工程与系统科学 2024-01-05 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai

Traditional communication systems focus on the transmission process, and the context-dependent meaning has been ignored. The fact that 5G system has approached Shannon limit and the increasing amount of data will cause communication…

信号处理 · 电气工程与系统科学 2022-02-22 Chen Dong , Haotai Liang , Xiaodong Xu , Shujun Han , Bizhu Wang , Ping Zhang

Semantic communication (SC) aims to reduce transmission overhead by conveying task-relevant information rather than raw data. However, existing SC approaches for video largely focus on pixel-level reconstruction or rely on complex…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Phuc H. Nguyen , Trung T. Nguyen , Quy N. Duong , Van-Dinh Nguyen

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

信号处理 · 电气工程与系统科学 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

This paper introduces SA-OOSC, a multimodal large language models (MLLM)-distilled semantic communication framework that achieves efficient semantic coding with scenario-aware importance allocations. This approach addresses a critical…

信号处理 · 电气工程与系统科学 2025-09-10 Feifan Zhang , Yuyang Du , Yifan Xiang , Xiaoyan Liu , Soung Chang Liew

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3) Uncertain channel…

信息论 · 计算机科学 2024-03-12 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Vision-dialog navigation posed as a new holy-grail task in vision-language disciplinary targets at learning an agent endowed with the capability of constant conversation for help with natural language and navigating according to human…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Yi Zhu , Fengda Zhu , Zhaohuan Zhan , Bingqian Lin , Jianbin Jiao , Xiaojun Chang , Xiaodan Liang

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

信号处理 · 电气工程与系统科学 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

Vision-language models (VLMs) achieve remarkable success in single-image tasks. However, real-world scenarios often involve intricate multi-image inputs, leading to a notable performance decline as models struggle to disentangle critical…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Juntian Zhang , Chuanqi cheng , Yuhan Liu , Wei Liu , Jian Luan , Rui Yan

With the emergence of diverse and massive data in the upcoming sixth-generation (6G) networks, the task-agnostic semantic communication system is regarded to provide robust intelligent services. In this paper, we propose a task-agnostic…

信息论 · 计算机科学 2025-09-16 Shiyao Jiang , Jian Jiao , Xingjian Zhang , Ye Wang , Dusit Niyato , Qinyu Zhang

Semantic communication has emerged as a promising approach for improving efficient transmission in the next generation of wireless networks. Inspired by the success of semantic communication in different areas, we aim to provide a new…

图像与视频处理 · 电气工程与系统科学 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Jiming Chen

Semantic communication (SC) can achieve superior coding and transmission performance based on the knowledge contained in the semantic knowledge base (KB). However, conventional KBs consist of source KBs and channel KBs, which are often…

信号处理 · 电气工程与系统科学 2026-04-08 Wuxia Hu , Caili Guo , Yang Yang , Chunyan Feng , Kuiyuan Ding , Shiwen Mao

Semantic communication (SemCom) emerges as a transformative paradigm for traffic-intensive visual data transmission, shifting focus from raw data to meaningful content transmission and relieving the increasing pressure on communication…

图像与视频处理 · 电气工程与系统科学 2026-02-02 Runze Cheng , Yao Sun , Ahmad Taha , Xuesong Liu , David Flynn , Muhammad Ali Imran

The state-of-the-art semantic communication (SC) schemes typically rely on end-to-end deep learning frameworks that lack interpretability and struggle with robust semantic selection and reconstruction under noisy conditions. To address this…

信号处理 · 电气工程与系统科学 2025-09-08 Dayu Fan , Rui Meng , Song Gao , Xiaodong Xu

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques. Distinct from the well investigated physical channel…

信号处理 · 电气工程与系统科学 2024-03-15 Xiang Peng , Zhijin Qin , Xiaoming Tao , Jianhua Lu , Khaled B. Letaief

In this paper, we propose a cross-layer encrypted semantic communication (CLESC) framework for panoramic video transmission, incorporating feature extraction, encoding, encryption, cyclic redundancy check (CRC), and retransmission processes…

图像与视频处理 · 电气工程与系统科学 2024-11-21 Haixiao Gao , Mengying Sun , Xiaodong Xu , Bingxuan Xu , Shujun Han , Bizhu Wang , Sheng Jiang , Chen Dong , Ping Zhang

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

机器学习 · 计算机科学 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus