English
Related papers

Related papers: DAC-JAX: A JAX Implementation of the Descript Audi…

200 papers

Neural audio codecs have recently gained traction for their ability to compress high-fidelity audio and provide discrete tokens for generative modeling. However, leading approaches often rely on resource-intensive models and complex…

Sound · Computer Science 2025-08-18 Linwei Zhai , Han Ding , Cui Zhao , fei wang , Ge Wang , Wang Zhi , Wei Xi

Neural audio codecs have recently gained popularity because they can represent audio signals with high fidelity at very low bitrates, making it feasible to use language modeling approaches for audio generation and understanding. Residual…

Sound · Computer Science 2024-10-21 Hubert Siuzdak , Florian Grötschla , Luca A. Lanzendörfer

While beam search improves speech recognition quality over greedy decoding, standard implementations are slow, often sequential, and CPU-bound. To fully leverage modern hardware capabilities, we present a novel open-source FlexCTC toolkit…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-14 Lilit Grigoryan , Vladimir Bataev , Nikolay Karpov , Andrei Andrusenko , Vitaly Lavrukhin , Boris Ginsburg

Neural audio codecs have been widely adopted in audio-generative tasks because their compact and discrete representations are suitable for both large-language-model-style and regression-based generative models. However, most neural codecs…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Yi-Chiao Wu , Dejan Marković , Steven Krenn , Israel D. Gebru , Alexander Richard

Neural audio codecs are widely used for audio compression and can be integrated into token-based language models. Traditional codecs preserve acoustic details well but lack semantic information. Recent hybrid codecs attempt to incorporate…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-09 Kaiyuan Zhang , Mohan Shi , Eray Eren , Natarajan Balaji Shankar , Zilai Wang , Abeer Alwan

Speech codecs are traditionally optimized for waveform fidelity, allocating bits to preserve acoustic detail even when much of it can be inferred from linguistic structure. This leads to inefficient compression and suboptimal performance on…

Sound · Computer Science 2025-12-29 Liuyang Bai , Weiyi Lu , Li Guo

The Abstraction and Reasoning Corpus (ARC) tests AI systems' ability to perform human-like inductive reasoning from a few demonstration pairs. Existing Gymnasium-based RL environments severely limit experimental scale due to computational…

Artificial Intelligence · Computer Science 2026-01-27 Aadam , Monu Verma , Mohamed Abdel-Mottaleb

Query auto-completion (QAC) has been widely studied in the context of web search, yet remains underexplored for in-document search, which we term DocQAC. DocQAC aims to enhance search productivity within long documents by helping users…

Information Retrieval · Computer Science 2026-04-21 Rahul Mehta , Kavin R , Indrajit Pal , Tushar Abhishek , Pawan Goyal , Manish Gupta

Globalization and multiculturalism continue to produce increasingly diverse speech varieties. Yet current spoken dialogue systems frequently fail on under-represented dialects and accents, often misidentifying the input language and causing…

Machine Learning · Computer Science 2026-05-25 Miria Feng , William Tan , Mert Pilanci

We propose FlowDec, a neural full-band audio codec for general audio sampled at 48 kHz that combines non-adversarial codec training with a stochastic postfilter based on a novel conditional flow matching method. Compared to the prior work…

Speech codecs that convert continuous speech signals into discrete tokens have become essential for speech language models. However, existing codecs struggle to balance high-quality reconstruction with semantically rich representations,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Wenxi Chen , Xinsheng Wang , Ruiqi Yan , Yushen Chen , Zhikang Niu , Ziyang Ma , Xiquan Li , Yuzhe Liang , Hanlin Wen , Shunshun Yin , Ming Tao , Xie Chen

Perceptual quality of audio is the combination of aural accuracy and listener-perceived sound fidelity. It is how humans respond to the accuracy, intelligibility, and fidelity of aural media. Today this fidelity is also heavily influenced…

Sound · Computer Science 2026-03-12 Thien T. Duong , Jan P. Springer

Large Language Models (LLMs) have advanced audio generation through discrete representation learning. However, most existing neural codecs focus on speech and emphasize reconstruction fidelity, overlooking unified low frame rate modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-24 Jingbin Hu , Haoyu Zhang , Dake Guo , Qirui Zhan , Wenhao Li , Huakang Chen , Guobin Ma , Hanke Xie , Chengyou Wang , Pengyuan Xie , Chuan Xie , Qiang Zhang , Lei Xie

This paper presents FunCodec, a fundamental neural speech codec toolkit, which is an extension of the open-source speech processing toolkit FunASR. FunCodec provides reproducible training recipes and inference scripts for the latest neural…

Sound · Computer Science 2023-10-10 Zhihao Du , Shiliang Zhang , Kai Hu , Siqi Zheng

CXL (Compute Express Link) enables multiple hosts to share byte-addressable memory with hardware cache coherence, but no existing filesystem exploits this for lock-free multi-host coordination. We present DaxFS, a Linux filesystem for CXL…

Operating Systems · Computer Science 2026-04-03 Cong Wang , Yiwei Yang , Yusheng Zheng

SymJAX is a symbolic programming version of JAX simplifying graph input/output/updates and providing additional functionalities for general machine learning and deep learning applications. From an user perspective SymJAX provides a la…

Mathematical Software · Computer Science 2020-05-22 Randall Balestriero

Speech codecs serve as bridges between speech signals and large language models. An ideal codec for speech language models should not only preserve acoustic information but also capture rich semantic information. However, existing speech…

Neural audio codecs (NACs) typically encode the short-term energy (gain) and normalized structure (shape) of speech/audio signals jointly within the same latent space. As a result, they are poorly robust to a global variation of the input…

Sound · Computer Science 2026-02-18 Samir Sadok , Laurent Girin , Xavier Alameda-Pineda

Heterogeneous programming has started becoming the norm in order to achieve better performance by running portions of code on the most appropriate hardware resource. Currently, significant engineering efforts are undertaken in order to…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-28 James Clarkson , Christos Kotselidis , Gavin Brown , Mikel Luján

Discrete audio tokenizers are fundamental to empowering large language models with native audio processing and generation capabilities. Despite recent progress, existing approaches often rely on pretrained encoders, semantic distillation,…