English
Related papers

Related papers: Language-Oriented Semantic Latent Representation f…

200 papers

Latent diffusion models such as Stable Diffusion achieve state-of-the-art results on text-to-image generation tasks. However, the extent to which these models have a semantic understanding of the images they generate is not well understood.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Cameron Braunstein , Mariya Toneva , Eddy Ilg

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Adversarial diffusion and diffusion-inversion methods have advanced unpaired image-to-image translation, but each faces key limitations. Adversarial approaches require target-domain adversarial loss during training, which can limit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Jiaming Liu , Felix Petersen , Yunhe Gao , Yabin Zhang , Hyojin Kim , Akshay S. Chaudhari , Yu Sun , Stefano Ermon , Sergios Gatidis

Traditional communication systems focus on the transmission process, and the context-dependent meaning has been ignored. The fact that 5G system has approached Shannon limit and the increasing amount of data will cause communication…

Signal Processing · Electrical Eng. & Systems 2022-02-22 Chen Dong , Haotai Liang , Xiaodong Xu , Shujun Han , Bizhu Wang , Ping Zhang

The rapid development of generative artificial intelligence (AI) has introduced significant opportunities for enhancing the efficiency and accuracy of image transmission within semantic communication systems. Despite these advancements,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qiyu Ma , Wanli Ni , Zhijin Qin

In this paper, a semantic communication framework for image transmission is developed. In the investigated framework, a set of servers cooperatively transmit images to a set of users utilizing semantic communication techniques. To evaluate…

Artificial Intelligence · Computer Science 2023-01-03 Wenjing Zhang , Yining Wang , Mingzhe Chen , Tao Luo , Dusit Niyato

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques. Distinct from the well investigated physical channel…

Signal Processing · Electrical Eng. & Systems 2024-03-15 Xiang Peng , Zhijin Qin , Xiaoming Tao , Jianhua Lu , Khaled B. Letaief

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone

A large body of recent work targets semantically conditioned image generation. Most such methods focus on the narrower task of pose transfer and ignore the more challenging task of subject transfer that consists in not only transferring the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicolas Dufour , David Picard , Vicky Kalogeiton

In this work, we propose a realistic semantic network called seq2seq-SC, designed to be compatible with 5G NR and capable of working with generalized text datasets using a pre-trained language model. The goal is to achieve unprecedented…

Signal Processing · Electrical Eng. & Systems 2023-10-19 Ju-Hyung Lee , Dong-Ho Lee , Eunsoo Sheen , Thomas Choi , Jay Pujara

Recent advances in semantic communication (SC) have introduced neural network (NN)-based transceivers that convey semantic representation (SR) of signals such as images. However, these NNs are trained over diverse image distributions and…

Signal Processing · Electrical Eng. & Systems 2025-07-24 Hyelin Nam , Jihong Park , Jinho Choi , Seong-Lyun Kim

In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringing significant…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

Transformers, known for their attention mechanisms, have proven highly effective in focusing on critical elements within complex data. This feature can effectively be used to address the time-varying channels in wireless communication…

Machine Learning · Computer Science 2024-12-03 Matin Mortaheb , Mohammad A. Amir Khojastepour , Sennur Ulukus

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

This paper studies the problem of the lightweight image semantic communication system that is deployed on Internet of Things (IoT) devices. In the considered system model, devices must use semantic communication techniques to support user…

Neural and Evolutionary Computing · Computer Science 2024-01-17 Guoxin Ma , Haonan Tong , Nuocheng Yang , Changchuan Yin

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

Semantic communications represent a new paradigm of next-generation networking that shifts bit-wise data delivery to conveying the semantic meanings for bandwidth efficiency. To effectively accommodate various potential downstream tasks at…

Computation and Language · Computer Science 2025-05-14 Fupei Guo , Achintha Wijesinghe , Songyang Zhang , Zhi Ding

The rapid development of artificial intelligence has driven smart health with next-generation wireless communication technologies, stimulating exciting applications in remote diagnosis and intervention. To enable a timely and effective…

Machine Learning · Computer Science 2025-08-04 Fupei Guo , Hao Zheng , Xiang Zhang , Li Chen , Yue Wang , Songyang Zhang

Semantic communication has undergone considerable evolution due to the recent rapid development of artificial intelligence (AI), significantly enhancing both communication robustness and efficiency. Despite these advancements, most current…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Jiarun Ding , Peiwen Jiang , Chao-Kai Wen , Shi Jin