English
Related papers

Related papers: ESC-MVQ: End-to-End Semantic Communication With Mu…

200 papers

Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Marc Delcroix , Naohiro Tawara , Mireia Diez , Federico Landini , Anna Silnova , Atsunori Ogawa , Tomohiro Nakatani , Lukas Burget , Shoko Araki

As video transmission increasingly serves machine vision systems (MVS) instead of human vision systems (HVS), video coding for machines (VCM) has become a critical research topic. Existing VCM methods often bind codecs to specific…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Yuxiao Sun , Meiqin Liu , Chao Yao , Qi Tang , Jian Jin , Weisi Lin , Frederic Dufaux , Yao Zhao

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

Although semantic communication (SC) has shown its potential in efficiently transmitting multimodal data such as texts, speeches and images, SC for videos has focused primarily on pixel-level reconstruction. However, these SC systems may be…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jiangyuan Guo , Wei Chen , Yuxuan Sun , Jialong Xu , Bo Ai

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading…

Machine Learning · Computer Science 2026-04-30 Cyril Shih-Huan Hsu , Wig Yuan-Cheng Cheng , Chrysa Papagianni

Deep learning has brought significant improvements to the field of cross-modal representation learning. For tasks such as text-to-speech (TTS), voice conversion (VC), and automatic speech recognition (ASR), a cross-modal fine-grained…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-29 Chunyu Qiang , Wang Geng , Yi Zhao , Ruibo Fu , Tao Wang , Cheng Gong , Tianrui Wang , Qiuyu Liu , Jiangyan Yi , Zhengqi Wen , Chen Zhang , Hao Che , Longbiao Wang , Jianwu Dang , Jianhua Tao

Conventional automatic speech recognition (ASR) models typically produce outputs as normalized texts lacking punctuation and capitalization, necessitating post-processing models to enhance readability. This approach, however, introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-23 Jian You , Xiangfeng Li , Erwan Zerhouni

This paper presents QCommE2E as an open-source simulation framework for end-to-end quantum communication systems, with explicit tutorial emphasis. The primary objective is to develop a comprehensive framework that includes transmitters,…

Quantum Physics · Physics 2026-05-26 Omar Alnaseri

Semantic communications have shown great potential to boost the end-to-end transmission performance. To further improve the system efficiency, in this paper, we propose a class of novel semantic coded transmission (SCT) schemes over…

Information Theory · Computer Science 2022-11-01 Shengshi Yao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Emotional voice conversion (EVC) focuses on converting a speech utterance from a source to a target emotion; it can thus be a key enabling technology for human-computer interaction applications and beyond. However, EVC remains an unsolved…

Recent advances in deep learning (DL)-based joint source-channel coding (JSCC) have enabled efficient semantic communication in dynamic wireless environments. Among these approaches, vector quantization (VQ)-based JSCC effectively maps…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Eunsoo Kim , Yoon Huh , Wan Choi

Semantic communications (SCs) aim to transmit only the essential information required to perform given tasks, thereby improving communication efficiency. Deep learning-based joint source-channel coding (deep JSCC) has emerged as a promising…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Eunhye Hong , Taewoo Park , Yongjune Kim

Vector Quantized Variational Autoencoders (VQ-VAEs) are fundamental models that compress continuous visual data into discrete tokens. Existing methods have tried to improve the quantization strategy for better reconstruction quality,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mingkai Jia , Wei Yin , Xiaotao Hu , Jiaxin Guo , Xiaoyang Guo , Qian Zhang , Xiao-Xiao Long , Ping Tan

Multimodal semantic communication, which integrates various data modalities such as text, images, and audio, significantly enhances communication efficiency and reliability. It has broad application prospects in fields such as artificial…

Sound · Computer Science 2024-12-10 Fei Yu , Zhe Xiang , Nan Che , Zhuoran Zhang , Yuandi Li , Junxiao Xue , Zhiguo Wan

Due to the current standard of Security Credential Management System (SCMS) for Vehicle-to-Everything (V2X) communications using asymmetric cryptography, specifically Elliptic-Curve Cryptography (ECC), which may be vulnerable to quantum…

Cryptography and Security · Computer Science 2025-01-14 Abel C. H. Chen , Bon-Yeh Lin

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

Mainstream image and video coding standards -- including state-of-the-art codecs like H.266/VVC, AVS3, and AV1 -- adopt a block-based hybrid coding framework. While this framework facilitates straightforward optimization for Peak…

Image and Video Processing · Electrical Eng. & Systems 2025-10-17 Runyu Yang , Ivan V. Bajić

Semantic communication (SC) is emerging as a pivotal innovation within the 6G framework, aimed at enabling more intelligent transmission. This development has led to numerous studies focused on designing advanced systems through powerful…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Guangyi Zhang , Kequan Zhou , Yunlong Cai , Qiyu Hu , Guanding Yu

Recently, the end-to-end approach has proven its efficacy in monaural multi-speaker speech recognition. However, high word error rates (WERs) still prevent these systems from being used in practical applications. On the other hand, the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Xuankai Chang , Wangyou Zhang , Yanmin Qian , Jonathan Le Roux , Shinji Watanabe

Emotional support conversation (ESC) aims to alleviate the emotional distress of individuals through effective conversations. Although large language models (LLMs) have obtained remarkable progress on ESC, most of these studies might not…

Computation and Language · Computer Science 2025-08-28 Xiaoyu Wang , Yue Zhao , Qingqing Gu , Zhonglin Jiang , Xiaokai Chen , Yong Chen , Luo Ji