Towards audio language modeling -- an overview
Audio and Speech Processing
2024-02-21 v1 Sound
Abstract
Neural audio codecs are initially introduced to compress audio data into compact codes to reduce transmission latency. Researchers recently discovered the potential of codecs as suitable tokenizers for converting continuous audio into discrete codes, which can be employed to develop audio language models (LMs). Numerous high-performance neural audio codecs and codec-based LMs have been developed. The paper aims to provide a thorough and systematic overview of the neural audio codec models and codec-based LMs.
Cite
@article{arxiv.2402.13236,
title = {Towards audio language modeling -- an overview},
author = {Haibin Wu and Xuanjun Chen and Yi-Cheng Lin and Kai-wei Chang and Ho-Lam Chung and Alexander H. Liu and Hung-yi Lee},
journal= {arXiv preprint arXiv:2402.13236},
year = {2024}
}