中文
相关论文

相关论文: Multimodal generative semantic communication based…

200 篇论文

Recent advances in generative modeling have positioned diffusion models as state-of-the-art tools for sampling from complex data distributions. While these models have shown remarkable success across single-modality domains such as images…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Nimrod Berman , Omkar Joglekar , Eitan Kosman , Dotan Di Castro , Omri Azencot

The latest advances in artificial intelligence (AI) present many unprecedented opportunities to achieve much improved bandwidth saving in communications. Unlike conventional communication systems focusing on packet transport, rich datasets…

机器学习 · 计算机科学 2023-12-07 Achintha Wijesinghe , Songyang Zhang , Suchinthaka Wanninayaka , Weiwei Wang , Zhi Ding

A novel accelerated mobile edge generation (MEG) framework is proposed for generating high-resolution images on mobile devices. Exploiting a large-scale latent diffusion model (LDM) distributed across edge server (ES) and user equipment…

系统与控制 · 电气工程与系统科学 2024-08-08 Xiaoxia Xu , Yuanwei Liu , Xidong Mu , Hong Xing , Arumugam Nallanathan

Autoregressive language models dominate modern text generation, yet their sequential nature introduces fundamental limitations: decoding is slow, and maintaining global coherence remains challenging. Diffusion models offer a promising…

计算与语言 · 计算机科学 2026-01-06 Viacheslav Meshchaninov , Egor Chimbulatov , Alexander Shabalin , Aleksandr Abramov , Dmitry Vetrov

Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which makes pure…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Yiyang Ma , Huan Yang , Wenjing Wang , Jianlong Fu , Jiaying Liu

To achieve continuous massive data transmission with significantly reduced data payload, the users can adopt semantic communication techniques to compress the redundant information by transmitting semantic features instead. However, current…

信号处理 · 电气工程与系统科学 2024-01-30 Youcheng Zeng , Xinxin He , Xu Chen , Haonan Tong , Zhaohui Yang , Yijun Guo , Jianjun Hao

Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic…

信息论 · 计算机科学 2024-08-20 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Chuan Heng Foh , Pei Xiao , Mehdi Bennis

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

机器学习 · 计算机科学 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

机器学习 · 计算机科学 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Remote sensing semantic segmentation must address both what the ground objects are within an image and where they are located. Consequently, segmentation models must ensure not only the semantic correctness of large-scale patches…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Hao Wang , Keyan Hu , Xin Guo , Haifeng Li , Chao Tao

Recent years have witnessed astonishing advances in the field of multimodal representation learning, with contrastive learning being the cornerstone for major breakthroughs. Latest works delivered further improvements by incorporating…

计算机视觉与模式识别 · 计算机科学 2023-02-22 Chaerin Kong , Nojun Kwak

Efficiently capturing consistent and complementary semantic features in a multimodal conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC). Existing methods mainly use graph structures to model dialogue…

计算与语言 · 计算机科学 2024-05-06 Tao Meng , Fuchen Zhang , Yuntao Shou , Wei Ai , Nan Yin , Keqin Li

Medical image segmentation is a critical step in computer-aided diagnosis, and convolutional neural networks are popular segmentation networks nowadays. However, the inherent local operation characteristics make it difficult to focus on the…

计算机视觉与模式识别 · 计算机科学 2023-05-18 Fenghe Tang , Jianrui Ding , Lingtao Wang , Min Xian , Chunping Ning

While learned image compression (LIC) focuses on efficient data transmission, generative image compression (GIC) extends this framework by integrating generative modeling to produce photo-realistic reconstructed images. In this paper, we…

图像与视频处理 · 电气工程与系统科学 2025-05-28 Minghao Han , Weiyi You , Jinhua Zhang , Leheng Zhang , Ce Zhu , Shuhang Gu

With the booming development of generative artificial intelligence (GAI), semantic communication (SemCom) has emerged as a new paradigm for reliable and efficient communication. This paper considers a multi-user downlink SemCom system,…

网络与互联网体系结构 · 计算机科学 2025-07-03 Jiayi Lu , Wanting Yang , Zehui Xiong , Rahim Tafazolli , Tony Q. S. Quek , Mérouane Debbah , Dong In Kim

Language-driven image segmentation is a fundamental task in vision-language understanding, requiring models to segment regions of an image corresponding to natural language expressions. Traditional methods approach this as a discriminative…

计算机视觉与模式识别 · 计算机科学 2025-08-28 Yuhao Chen , Shubin Chen , Liang Lin , Guangrun Wang

Multimodal generative models have recently gained significant attention for their ability to learn representations across various modalities, enhancing joint and cross-generation coherence. However, most existing works use standard Gaussian…

机器学习 · 计算机科学 2024-10-01 Shiyu Yuan , Jiali Cui , Hanao Li , Tian Han

The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives…

Semantic communications mark a paradigm shift from bit-accurate transmission toward meaning-centric communication, essential as wireless systems approach theoretical capacity limits. The emergence of generative AI has catalyzed generative…

信号处理 · 电气工程与系统科学 2026-05-08 Hai-Long Qin , Jincheng Dai , Guo Lu , Shuo Shao , Sixian Wang , Tongda Xu , Wenjun Zhang , Ping Zhang , Khaled B. Letaief

In this paper, a novel semantic communication framework empowered by generative artificial intelligence (GAI) is proposed, to enhance the robustness against both channel noise and transmission data distribution shifts. A theoretical…

机器学习 · 计算机科学 2025-07-18 Xiucheng Wang , Honggang Jia , Nan Cheng