English
Related papers

Related papers: PhoenixCodec: Taming Neural Speech Coding for Extr…

200 papers

Speech compression is commonly used to send voice over radio channels in applications such as mobile telephony and two-way push-to-talk (PTT) radio. In classical systems, the speech codec is combined with forward error correction,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-29 David Rowe , Jean-Marc Valin

This report describes the UNISOUND submission for Track1 and Track2 of VoxCeleb Speaker Recognition Challenge 2023 (VoxSRC 2023). We submit the same system on Track 1 and Track 2, which is trained with only VoxCeleb2-dev. Large-scale ResNet…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-25 Yu Zheng , Yajun Zhang , Chuanying Niu , Yibin Zhan , Yanhua Long , Dongxing Xu

Tokenization remains a fundamental yet underexplored bottleneck in natural language processing, with strategies largely static despite remarkable progress in model architectures. We present SupraTok, a novel tokenization architecture that…

Computation and Language · Computer Science 2025-08-26 Andrei-Valentin Tănase , Elena Pelican

Neural audio codecs have revolutionized audio processing by enabling speech tasks to be performed on highly compressed representations. Recent work has shown that speech separation can be achieved within these compressed domains, offering…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Jia Qi Yip , Chin Yuen Kwok , Bin Ma , Eng Siong Chng

This paper presents a new method for training sequence-to-sequence models for speech recognition and translation tasks. Instead of the traditional approach of training models on short segments containing only lowercase or partial…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Nithin Rao Koluguri , Travis Bartley , Hainan Xu , Oleksii Hrinchuk , Jagadeesh Balam , Boris Ginsburg , Georg Kucsko

There has been a growing trend in compressing and transmitting videos from terminals for machine vision tasks. Nevertheless, most video coding optimization method focus on minimizing distortion according to human perceptual metrics,…

Multimedia · Computer Science 2025-12-18 Fei Zhao , Mengxi Guo , Shijie Zhao , Junlin Li , Li Zhang , Xiaodong Xie

Quantum error correction is an essential technique for constructing a scalable quantum computer. In order to implement quantum error correction with near-term quantum devices, a fast and near-optimal decoding method is demanded. A decoder…

Quantum Physics · Physics 2020-09-16 Amarsanaa Davaasuren , Yasunari Suzuki , Keisuke Fujii , Masato Koashi

This paper describes the systems developed by the HCCL team for the NIST 2021 speaker recognition evaluation (NIST SRE21).We first explore various state-of-the-art speaker embedding extractors combined with a novel circle loss to obtain…

Sound · Computer Science 2022-07-12 Zhuo Li , Runqiu Xiao , Hangting Chen , Zhenduo Zhao , Zihan Zhang , Wenchao Wang

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication reliability over…

Information Theory · Computer Science 2023-06-09 Junghoon Kim , Taejoon Kim , David Love , Christopher Brinton

Speech coding facilitates the transmission of speech over low-bandwidth networks with minimal distortion. Neural-network based speech codecs have recently demonstrated significant improvements in quality over traditional approaches. While…

Sound · Computer Science 2022-07-07 Ali Siahkoohi , Michael Chinen , Tom Denton , W. Bastiaan Kleijn , Jan Skoglund

We introduce a new zero resource code-switched speech benchmark designed to directly assess the code-switching capabilities of self-supervised speech encoders. We showcase a baseline system of language modeling on discrete units to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-19 Kuan-Po Huang , Chih-Kai Yang , Yu-Kuan Fu , Ewan Dunbar , Hung-yi Lee

In recent years, large language models have achieved significant success in generative tasks related to speech, audio, music, and other signal domains. A crucial element of these models is the discrete acoustic codecs, which serve as an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-05 Shengpeng Ji , Minghui Fang , Jialong Zuo , Ziyue Jiang , Dingdong Wang , Hanting Wang , Hai Huang , Zhou Zhao

We propose \textbf{U-Codec}, an \textbf{U}ltra low frame-rate neural speech \textbf{Codec} that achieves high-fidelity reconstruction and fast speech generation at an extremely low frame-rate of 5Hz (5 frames per second). Extreme…

Sound · Computer Science 2025-10-21 Xusheng Yang , Long Zhou , Wenfu Wang , Kai Hu , Shulin Feng , Chenxing Li , Meng Yu , Dong Yu , Yuexian Zou

Convolutional recurrent networks (CRN) integrating a convolutional encoder-decoder (CED) structure and a recurrent structure have achieved promising performance for monaural speech enhancement. However, feature representation across…

Sound · Computer Science 2024-12-02 Shengkui Zhao , Bin Ma , Karn N. Watcharasupat , Woon-Seng Gan

In recent years, the introduction of neural networks (NNs) into the field of speech enhancement has brought significant improvements. However, many of the proposed methods are quite demanding in terms of computational complexity and memory…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-19 Ernst Seidel , Pejman Mowlaee , Tim Fingscheidt

Speech tokenizers are foundational to speech language models, yet existing approaches face two major challenges: (1) balancing trade-offs between encoding semantics for understanding and acoustics for reconstruction, and (2) achieving low…

Speech codecs that convert continuous speech signals into discrete tokens have become essential for speech language models. However, existing codecs struggle to balance high-quality reconstruction with semantically rich representations,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Wenxi Chen , Xinsheng Wang , Ruiqi Yan , Yushen Chen , Zhikang Niu , Ziyang Ma , Xiquan Li , Yuzhe Liang , Hanlin Wen , Shunshun Yin , Ming Tao , Xie Chen

The selective fixed-filter active noise control (SFANC) method selecting the best pre-trained control filters for various types of noise can achieve a fast response time. However, it may lead to large steady-state errors due to inaccurate…

Systems and Control · Electrical Eng. & Systems 2023-03-13 Zhengding Luo , Dongyuan Shi , Woon-Seng Gan

Existing deep learning based speech enhancement mainly employ a data-driven approach, which leverage large amounts of data with a variety of noise types to achieve noise removal from noisy signal. However, the high dependence on the data…

Sound · Computer Science 2024-01-24 Huaying Xue , Xiulian Peng , Yan Lu

Real-time decoding of quantum error correction (QEC) is essential for enabling fault-tolerant quantum computation. A practical decoder must operate with high accuracy at low latency, while remaining robust to spatial and temporal variations…

Quantum Physics · Physics 2026-01-23 Samuel Stein , Shuwen Kan , Chenxu Liu , Adrian Harkness , Sean Garner , Zefan Du , Yufei Ding , Ying Mao , Ang Li