中文
相关论文

相关论文: Semantic-Preserving Image Coding based on Conditio…

200 篇论文

Image compression techniques typically focus on compressing rectangular images for human consumption, however, resulting in transmitting redundant content for downstream applications. To overcome this limitation, some previous works propose…

图像与视频处理 · 电气工程与系统科学 2025-03-04 Ruoyu Feng , Yixin Gao , Xin Jin , Runsen Feng , Zhibo Chen

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the…

信号处理 · 电气工程与系统科学 2024-04-01 Shunpu Tang , Qianqian Yang , Deniz Gündüz , Zhaoyang Zhang

Semantic Communication (SC) is an emerging technology aiming to surpass the Shannon limit. Traditional SC strategies often minimize signal distortion between the original and reconstructed data, neglecting perceptual quality, especially in…

机器学习 · 计算机科学 2024-08-12 Kexin Zhang , Lixin Li , Wensheng Lin , Yuna Yan , Rui Li , Wenchi Cheng , Zhu Han

Semantic communication (SC) offers promising advancements in data transmission efficiency and reliability by focusing on delivering true meaning rather than solely binary bits of messages. However, privacy concerns in SC might become…

密码学与安全 · 计算机科学 2024-11-26 Xuesong Liu , Yao Sun , Runze Cheng , Le Xia , Hanaa Abumarshoud , Lei Zhang , Muhammad Ali Imran

Latent diffusion models such as Stable Diffusion achieve state-of-the-art results on text-to-image generation tasks. However, the extent to which these models have a semantic understanding of the images they generate is not well understood.…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Cameron Braunstein , Mariya Toneva , Eddy Ilg

With the help of powerful generative models, Semantic Image Compression (SIC) has achieved impressive performance at ultra-low bitrate. However, due to coarse-grained visual-semantic alignment and inherent randomness, the reliability of SIC…

图像与视频处理 · 电气工程与系统科学 2025-06-03 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Mingzhou He , King Ngi Ngan , Fanman Meng , Hongliang Li

Denoising diffusion models achieved impressive results on several image generation tasks often outperforming GAN based models. Recently, the generative capabilities of diffusion models have been employed for perceptual image compression,…

图像与视频处理 · 电气工程与系统科学 2025-05-20 Jonas Brenig , Radu Timofte

Modern video codecs and learning-based approaches struggle for semantic reconstruction at extremely low bit-rates due to reliance on low-level spatiotemporal redundancies. Generative models, especially diffusion models, offer a new paradigm…

图像与视频处理 · 电气工程与系统科学 2026-02-06 Maojun Zhang , Haotian Wu , Richeng Jin , Deniz Gunduz , Krystian Mikolajczyk

We propose a hybrid joint source-channel coding (JSCC) scheme, in which the conventional digital communication scheme is complemented with a generative refinement component to improve the perceptual quality of the reconstruction. The input…

信息论 · 计算机科学 2023-08-17 Xueyan Niu , Xu Wang , Deniz Gündüz , Bo Bai , Weichao Chen , Guohua Zhou

The sixth-generation mobile communication system proposes the vision of smart interconnection of everything, which requires accomplishing communication tasks while ensuring the performance of intelligent tasks. A joint source-channel coding…

图像与视频处理 · 电气工程与系统科学 2023-02-07 Qizheng Sun , Caili Guo , Yang Yang , Jiujiu Chen , Rui Tang , Chuanhong Liu

Semantic communications have shown great potential to boost the end-to-end transmission performance. To further improve the system efficiency, in this paper, we propose a class of novel semantic coded transmission (SCT) schemes over…

信息论 · 计算机科学 2022-11-01 Shengshi Yao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Text-to-image diffusion models are now capable of generating images that are often indistinguishable from real images. To generate such images, these models must understand the semantics of the objects they are asked to generate. In this…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Eric Hedlin , Gopal Sharma , Shweta Mahajan , Hossam Isack , Abhishek Kar , Andrea Tagliasacchi , Kwang Moo Yi

Semantic communication has emerged as the breakthrough beyond the Shannon theorem by transmitting and receiving semantic information instead of data bits or symbols regardless of its content. This paper proposes a two-stage reconstruction…

信息论 · 计算机科学 2022-09-13 Trinh Van Chien , Le Hong Phong , Dao Xuan Phuc , Nguyen Tien Hoa

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing…

图像与视频处理 · 电气工程与系统科学 2024-10-25 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Jun Zhang

Semantic communication (SC) aims to reduce transmission overhead by conveying task-relevant information rather than raw data. However, existing SC approaches for video largely focus on pixel-level reconstruction or rely on complex…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Phuc H. Nguyen , Trung T. Nguyen , Quy N. Duong , Van-Dinh Nguyen

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

Many visual monitoring systems operate under strict communication constraints, where transmitting full-resolution images is impractical and often unnecessary. In such settings, visual data is often used for object presence, spatial…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Damir Assylbek , Nurmukhammed Aitymbetov , Marko Ristin , Dimitrios Zorbas

Along with the prosperity of recurrent neural network in modelling sequential data and the power of attention mechanism in automatically identify salient information, image captioning, a.k.a., image description, has been remarkably advanced…

计算机视觉与模式识别 · 计算机科学 2016-12-16 Hao Liu , Yang Yang , Fumin Shen , Lixin Duan , Heng Tao Shen

While recent neural codecs achieve strong performance at low bitrates when optimized for perceptual quality, their effectiveness deteriorates significantly under ultra-low bitrate conditions. To mitigate this, generative compression methods…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Chuqin Zhou , Xiaoyue Ling , Yunuo Chen , Jincheng Dai , Guo Lu , Wenjun Zhang

This paper outlines an end-to-end optimized lossy image compression framework using diffusion generative models. The approach relies on the transform coding paradigm, where an image is mapped into a latent space for entropy coding and, from…

图像与视频处理 · 电气工程与系统科学 2024-01-03 Ruihan Yang , Stephan Mandt