中文
相关论文

相关论文: Large Generative Model-assisted Talking-face Seman…

200 篇论文

Semantic Communication (SC) is an emerging technology aiming to surpass the Shannon limit. Traditional SC strategies often minimize signal distortion between the original and reconstructed data, neglecting perceptual quality, especially in…

机器学习 · 计算机科学 2024-08-12 Kexin Zhang , Lixin Li , Wensheng Lin , Yuna Yan , Rui Li , Wenchi Cheng , Zhu Han

Semantic communication (SemCom) has emerged as a promising technique for the next-generation communication systems, in which the generation at the receiver side is allowed with semantic features' recovery. However, the majority of existing…

图像与视频处理 · 电气工程与系统科学 2025-07-08 Chengyang Liang , Dong Li

Existing speech semantic communication systems mainly based on Joint Source-Channel Coding (JSCC) architectures have demonstrated impressive performance, but their effectiveness remains limited by model structures specifically designed for…

声音 · 计算机科学 2025-12-05 Yun Tian , Zhijin Qin , Guocheng Lv , Ye Jin , Kaibin Huang , Zhu Han

Millions of people worldwide rely on alternative and augmentative communication devices to communicate. Visual scene displays (VSDs) can enhance communication for these individuals by embedding communication options within contextualized…

Language Model (LM)-based generative modeling has emerged as a promising direction for TSE, offering potential for improved generalization and high-fidelity speech. We present GenTSE, a two-stage decoder-only generative LM approach for TSE:…

音频与语音处理 · 电气工程与系统科学 2025-12-25 Haoyang Li , Xuyi Zhuang , Azmat Adnan , Ye Ni , Wei Rao , Shreyas Gopal , Eng Siong Chng

Semantic communication (SemCom) has recently emerged as a promising paradigm for next-generation wireless systems. Empowered by advanced artificial intelligence (AI) technologies, SemCom has achieved significant improvements in transmission…

信息论 · 计算机科学 2026-01-12 Shunpu Tang , Yuanyuan Jia , Qianqian Yang , Ruichen Zhang , Jihong Park , Dusit Niyato

In the swiftly advancing realm of communication technologies, Semantic Communication (SemCom), which emphasizes knowledge understanding and processing, has emerged as a hot topic. By integrating artificial intelligence technologies, SemCom…

计算与语言 · 计算机科学 2024-02-07 Fei Ni , Bingyan Wang , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

信号处理 · 电气工程与系统科学 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

信息论 · 计算机科学 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

Large Language Models (LLMs) have demonstrated a remarkable ability to capture extensive world knowledge, yet how this is achieved without direct sensorimotor experience remains a fundamental puzzle. This study proposes a novel theoretical…

人工智能 · 计算机科学 2025-07-17 Tadahiro Taniguchi , Ryo Ueda , Tomoaki Nakamura , Masahiro Suzuki , Akira Taniguchi

With the advent of Fifth Generation (5G) and Sixth Generation (6G) communication technologies, as well as the Internet of Things (IoT), semantic communication is gaining attention among researchers as current communication technologies are…

网络与互联网体系结构 · 计算机科学 2024-07-31 Alakesh Kalita

In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic…

网络与互联网体系结构 · 计算机科学 2025-05-30 Guangyuan Liu , Yinqiu Liu , Jiacheng Wang , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Abbas Jamalipour

The rapid advancement of generative artificial intelligence has spurred innovative approaches to semantic communication, giving rise to a new paradigm known as generative semantic communication (GSC). The integration of flexible cross-modal…

信号处理 · 电气工程与系统科学 2025-11-03 Yiru Wang , Wanting Yang , Fangli Mou , Zehui Xiong , Zide Fan , Shiwen Mao , Tony Q. S. Quek

Multimodal signals, including text, audio, image, and video, can be integrated into Semantic Communication (SC) systems to provide an immersive experience with low latency and high quality at the semantic level. However, the multimodal SC…

人工智能 · 计算机科学 2024-08-06 Feibo Jiang , Li Dong , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Recently, generative semantic communication models have proliferated as they are revolutionizing semantic communication frameworks, improving their performance, and opening the way to novel applications. Despite their impressive ability to…

信号处理 · 电气工程与系统科学 2026-05-18 Giovanni Pignata , Eleonora Grassucci , Giordano Cicchetti , Danilo Comminiello

The burgeoning generative artificial intelligence technology offers novel insights into the development of semantic communication (SemCom) frameworks. These frameworks hold the potential to address the challenges associated with the…

多媒体 · 计算机科学 2023-10-25 Wanting Yang , Zehui Xiong , Hongyang Du , Yanli Yuan , Tony Q. S. Quek

Generative artificial intelligence (GAI) has emerged as a rapidly burgeoning field demonstrating significant potential in creating diverse contents intelligently and automatically. To support such artificial intelligence-generated content…

信号处理 · 电气工程与系统科学 2024-01-09 Chengsi Liang , Hongyang Du , Yao Sun , Dusit Niyato , Jiawen Kang , Dezong Zhao , Muhammad Ali Imran

Semantic communication is expected to be one of the cores of next-generation AI-based communications. One of the possibilities offered by semantic communication is the capability to regenerate, at the destination side, images or videos…

人工智能 · 计算机科学 2026-05-18 Eleonora Grassucci , Sergio Barbarossa , Danilo Comminiello

Traditional single-modal sensing systems-based solely on either radio frequency (RF) or visual data-struggle to cope with the demands of complex and dynamic environments. Furthermore, single-device systems are constrained by limited…

信号处理 · 电气工程与系统科学 2025-06-02 Yubo Peng , Luping Xiang , Bingxin Zhang , Kun Yang

Large Language Models (LLMs) have revolutionized AI systems by enabling communication with machines using natural language. Recent developments in Generative AI (GenAI) like Vision-Language Models (GPT-4V) and Gemini have shown great…

计算与语言 · 计算机科学 2024-07-17 Jakub M. Tomczak