English
Related papers

Related papers: Energy-Efficient Downlink Semantic Generative Comm…

200 papers

Despite astonishing progress, generating realistic images of complex scenes remains a challenging problem. Recently, layout-to-image synthesis approaches have attracted much interest by conditioning the generator on a list of bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Stanislav Frolov , Prateek Bansal , Jörn Hees , Andreas Dengel

Text-based communication is expected to be prevalent in 6G applications such as wireless AI-generated content (AIGC). Motivated by this, this paper addresses the challenges of transmitting text prompts over erasure channels for a…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Seunghun Lee , Jihong Park , Jinho Choi , Hyuncheol Park

The rapid development of generative artificial intelligence (AI) has introduced significant opportunities for enhancing the efficiency and accuracy of image transmission within semantic communication systems. Despite these advancements,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qiyu Ma , Wanli Ni , Zhijin Qin

Semantic communications, aiming at ensuring the successful delivery of the meaning of information, are expected to be one of the potential techniques for the next generation communications. However, the knowledge forming and synchronizing…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yuan Zheng , Fengyu Wang , Wenjun Xu , Miao Pan , Ping Zhang

An estimated half of the world's languages do not have a written form, making it impossible for these languages to benefit from any existing text-based technologies. In this paper, a speech-to-image generation (S2IG) framework is proposed…

Machine Learning · Computer Science 2020-09-16 Xinsheng Wang , Tingting Qiao , Jihua Zhu , Alan Hanjalic , Odette Scharenborg

Semantic communication is widely touted as a key technology for propelling the sixth-generation (6G) wireless networks. However, providing effective semantic representation is quite challenging in practice. To address this issue, this…

Information Theory · Computer Science 2024-06-18 Jinke Ren , Zezhong Zhang , Jie Xu , Guanying Chen , Yaping Sun , Ping Zhang , Shuguang Cui

In this paper, we propose a multi-user green semantic communication system facilitated by a probabilistic knowledge graph (PKG). By integrating probability into the knowledge graph, we enable probabilistic semantic communication (PSC) and…

Emerging Technologies · Computer Science 2024-08-22 Ruopeng Xu , Zhaohui Yang , Yijie Mao , Chongwen Huang , Qianqian Yang , Lexi Xu , Wei Xu , Zhaoyang Zhang

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Neural image classifiers are known to undergo severe performance degradation when exposed to inputs that are sampled from environmental conditions that differ from their training data. Given the recent progress in Text-to-Image (T2I)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jianhao Yuan , Francesco Pinto , Adam Davies , Philip Torr

A large amount of User Generated Content (UGC) is uploaded to the Internet daily and displayed to people world-widely through the client side (e.g., mobile and PC). This requires the cropping algorithms to produce the aesthetic thumbnail…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yukun Su , Yiwen Cao , Jingliang Deng , Fengyun Rao , Qingyao Wu

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

Signal Processing · Electrical Eng. & Systems 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Task-Oriented Semantic Communication (TOSC) has been regarded as a promising communication framework, serving for various Artificial Intelligence (AI) task driven applications. The existing TOSC frameworks focus on extracting the full…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Jingqing Wang , Liuguo Yin , Wei Zhang

In this paper, the problem of wireless resource allocation and semantic information extraction for energy efficient semantic communications over wireless networks with rate splitting is investigated. In the considered model, a base station…

Information Theory · Computer Science 2023-01-06 Zhaohui Yang , Mingzhe Chen , Zhaoyang Zhang , Chongwen Huang

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yibin Liu , Jianyu Zhang , Li Zhang , Shijian Li , Gang Pan

In this work, we propose and assess the potential of generative artificial intelligence (AI) to generate public engagement around potential clean energy sources. Such an application could increase energy literacy -- an awareness of…

Computers and Society · Computer Science 2023-12-05 Veda Joynt , Jacob Cooper , Naman Bhargava , Katie Vu , O Hwang Kwon , Todd R. Allen , Aditi Verma , Majdi I. Radaideh

Goal-oriented semantic communication (SC) aims to revolutionize communication systems by transmitting only task-essential information. However, current approaches face challenges such as joint training at transceivers, leading to redundant…

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

The goal of Image-to-image (I2I) translation is to transfer an image from a source domain to a target domain, which has recently drawn increasing attention. One major branch of this research is to formulate I2I translation based on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yuanjiang Cao , Lina Yao , Le Pan , Quan Z. Sheng , Xiaojun Chang