English
Related papers

Related papers: Language-oriented Semantic Communication for Image…

200 papers

Semantic communication, due to its focus on the transmitting meaning rather than the raw bit data, poses unique security challenges compared to the traditional communication systems. In particular, semantic communication systems are…

Information Theory · Computer Science 2025-05-12 Boxiang He , Zihan Chen , Junshan Luo , Chuanhong Liu , Shilian Wang , Fanggang Wang , Tony Q. S. Quek

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

The latest advances in artificial intelligence (AI) present many unprecedented opportunities to achieve much improved bandwidth saving in communications. Unlike conventional communication systems focusing on packet transport, rich datasets…

Machine Learning · Computer Science 2023-12-07 Achintha Wijesinghe , Songyang Zhang , Suchinthaka Wanninayaka , Weiwei Wang , Zhi Ding

Text-based communication is expected to be prevalent in 6G applications such as wireless AI-generated content (AIGC). Motivated by this, this paper addresses the challenges of transmitting text prompts over erasure channels for a…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Seunghun Lee , Jihong Park , Jinho Choi , Hyuncheol Park

Learning-based semantic communication (SemCom) has recently emerged as a promising paradigm for improving the transmission efficiency of wireless networks. However, existing methods typically rely on extensive end-to-end training, which is…

Information Theory · Computer Science 2026-03-19 Shunpu Tang , Qianqian Yang , Jihong Park , Zhaoyang Zhang , Kaibin Huang , Deniz Gunduz

Recent text-to-image diffusion models are able to generate convincing results of unprecedented quality. However, it is nearly impossible to control the shapes of different regions/objects or their layout in a fine-grained fashion. Previous…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Omri Avrahami , Thomas Hayes , Oran Gafni , Sonal Gupta , Yaniv Taigman , Devi Parikh , Dani Lischinski , Ohad Fried , Xi Yin

The impressive capacity shown by recent text-to-image diffusion models to generate high-quality pictures from textual input prompts has leveraged the debate about the very definition of art. Nonetheless, these models have been trained using…

Computation and Language · Computer Science 2022-10-20 Ricardo Kleinlein , Cristina Luna-Jiménez , Fernando Fernández-Martínez

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Millimeter-wave (mmWave) and terahertz (THz) communication systems require large antenna arrays and use narrow directive beams to ensure sufficient receive signal power. However, selecting the optimal beams for these large antenna arrays…

Information Theory · Computer Science 2024-02-23 Shoaib Imran , Gouranga Charan , Ahmed Alkhateeb

In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success…

Multimedia · Computer Science 2025-07-18 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Rahim Tafazolli , Mehdi Bennis , Dusit Niyato

A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly employing conventional image generation techniques is…

Computation and Language · Computer Science 2024-02-09 Xiaowen Sun , Jiazhan Feng , Yuxuan Wang , Yuxuan Lai , Xingyu Shen , Dongyan Zhao

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo

The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu

While semantic communications have shown the potential in the case of single-modal single-users, its applications to the multi-user scenario remain limited. In this paper, we investigate deep learning (DL) based multi-user semantic…

Signal Processing · Electrical Eng. & Systems 2021-12-21 Huiqiang Xie , Zhijin Qin , Xiaoming Tao , Khaled B. Letaief

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Wireless goal-oriented semantic communication (GSC) has emerged as a promising paradigm by directly optimizing task performance. However, existing GSC frameworks typically operate on entire images and rely on labeled data for classification…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Zhitong Ni , Yansha Deng , Jinhong Yuan

The rapid advancement of generative artificial intelligence has spurred innovative approaches to semantic communication, giving rise to a new paradigm known as generative semantic communication (GSC). The integration of flexible cross-modal…

Signal Processing · Electrical Eng. & Systems 2025-11-03 Yiru Wang , Wanting Yang , Fangli Mou , Zehui Xiong , Zide Fan , Shiwen Mao , Tony Q. S. Quek

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Task-oriented image semantic communication is a new communication paradigm, which aims to transmit semantics for artificial intelligent (AI) tasks while ignoring the reconstruction quality of the images. However, in some applications, such…

Information Theory · Computer Science 2022-12-05 Fangfang Liu , Wanjie Tong , Yang Yang , Zhengfen Sun , Caili Guo

Remote sensing image change captioning (RSICC) aims at generating human-like language to describe the semantic changes between bi-temporal remote sensing image pairs. It provides valuable insights into environmental dynamics and land…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Xiaofei Yu , Yitong Li , Jie Ma
‹ Prev 1 8 9 10 Next ›