English
Related papers

Related papers: FlowMAC: Conditional Flow Matching for Audio Codin…

200 papers

High-quality speech corpora are essential foundations for most speech applications. However, such speech data are expensive and limited since they are collected in professional recording environments. In this work, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-11 Haoyu Li , Yang Ai , Junichi Yamagishi

Diffusion and flow matching (FM) models have achieved remarkable progress in speech enhancement (SE), yet their dependence on multi-step generation is computationally expensive and vulnerable to discretization errors. Recent advances in…

Sound · Computer Science 2025-09-23 Gang Yang , Yue Lei , Wenxin Tai , Jin Wu , Jia Chen , Ting Zhong , Fan Zhou

In this paper, we propose MDCTCodec, an efficient lightweight end-to-end neural audio codec based on the modified discrete cosine transform (MDCT). The encoder takes the MDCT spectrum of audio as input, encoding it into a continuous latent…

Sound · Computer Science 2024-11-04 Xiao-Hang Jiang , Yang Ai , Rui-Chen Zheng , Hui-Peng Du , Ye-Xin Lu , Zhen-Hua Ling

This paper proposes a novel neural audio codec, named APCodec+, which is an improved version of APCodec. The APCodec+ takes the audio amplitude and phase spectra as the coding object, and employs an adversarial training strategy.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-31 Hui-Peng Du , Yang Ai , Rui-Chen Zheng , Zhen-Hua Ling

Generating audio that is acoustically consistent with a scene is essential for immersive virtual environments. Recent neural acoustic field methods enable spatially continuous sound rendering but remain scene-specific, requiring dense audio…

Sound · Computer Science 2026-03-20 Amandine Brunetto

In bandwidth-constrained communication such as satellite and underwater channels, speech must often be transmitted at ultra-low bitrates where intelligibility is the primary objective. At such extreme compression levels, codecs trained with…

Sound · Computer Science 2026-04-21 Junyi Wang , Chi Zhang , Jing Qian , Haifeng Luo , Hao Wang , Zengrui Jin , Chao Zhang

We propose DeFloMat (Detection with Flow Matching), a novel generative object detection framework that addresses the critical latency bottleneck of diffusion-based detectors, such as DiffusionDet, by integrating Conditional Flow Matching…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Hansang Lee , Chaelin Lee , Nieun Seo , Joon Seok Lim , Helen Hong

While existing audio watermarking techniques have achieved strong robustness against traditional digital signal processing (DSP) attacks, they remain vulnerable to neural resynthesis. This occurs because modern neural audio codecs act as…

This paper introduces PeriodWave-Turbo, a high-fidelity and high-efficient waveform generation model via adversarial flow matching optimization. Recently, conditional flow matching (CFM) generative models have been successfully adopted for…

Sound · Computer Science 2024-08-16 Sang-Hoon Lee , Ha-Yeong Choi , Seong-Whan Lee

Speech compression is commonly used to send voice over radio channels in applications such as mobile telephony and two-way push-to-talk (PTT) radio. In classical systems, the speech codec is combined with forward error correction,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-29 David Rowe , Jean-Marc Valin

The emerging conditional coding-based neural video codec (NVC) shows superiority over commonly-used residual coding-based codec and the latest NVC already claims to outperform the best traditional codec. However, there still exist critical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jiahao Li , Bin Li , Yan Lu

Synthetic electrocardiogram generation serves medical AI applications requiring privacy-preserving data sharing and training dataset augmentation. Current diffusion-based methods achieve high generation quality but require hundreds of…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Vitalii Bondar , Serhii Semenov , Vira Babenko , Dmytro Holovniak

Neural Speech Codecs face a fundamental trade-off at low bitrates: preserving acoustic fidelity often compromises semantic richness. To address this, we introduce SACodec, a novel codec built upon an asymmetric dual-quantizer that employs…

Sound · Computer Science 2025-12-25 Zhongren Dong , Bin Wang , Jing Han , Haotian Guo , Xiaojun Mo , Yimin Cao , Zixing Zhang

Deep generative models that produce novel molecular structures have the potential to facilitate chemical discovery. Flow matching is a recently proposed generative modeling framework that has achieved impressive performance on a variety of…

Machine Learning · Computer Science 2024-11-26 Ian Dunn , David R. Koes

Generating synthetic CT (sCT) from MRI or CBCT plays a crucial role in enabling MRI-only and CBCT-based adaptive radiotherapy, improving treatment precision while reducing patient radiation exposure. To address this task, we adopt a fully…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Arnela Hadzic , Simon Johannes Joham , Martin Urschler

Video compression is indispensable to most video analysis systems. Despite saving transportation bandwidth, it also deteriorates downstream video understanding tasks, especially at low-bitrate settings. To systematically investigate this…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Yuan Tian , Guo Lu , Yichao Yan , Guangtao Zhai , Li Chen , Zhiyong Gao

Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient ODE-based sampling without relying on stochastic diffusion processes. While generative modeling has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhi Chen , Runze Hu , Le Zhang

This paper presents LongCat-Audio-Codec, an audio tokenizer and detokenizer solution designed for industrial grade end-to-end speech large language models. By leveraging a decoupled model architecture and a multistage training strategy,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-20 Xiaohan Zhao , Hongyu Xiang , Shengze Ye , Song Li , Zhengkun Tian , Guanyu Chen , Ke Ding , Guanglu Wan

Recent studies in long video understanding have harnessed the advanced visual-language reasoning capabilities of Large Multimodal Models (LMMs), driving the evolution of video-LMMs specialized for processing extended video sequences.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Janghoon Cho , Jungsoo Lee , Munawar Hayat , Kyuwoong Hwang , Fatih Porikli , Sungha Choi

Biomedical audio signals, such as phonocardiograms (PCG), are inherently rhythmic and contain diagnostic information in both their spectral (tonal) and temporal domains. Standard 2D spectrograms provide rich spectral features but compromise…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Md. Saiful Bari Siddiqui , Utsab Saha