English
Related papers

Related papers: Adversarial Audio Synthesis with Complex-valued Po…

200 papers

This paper addresses the extraction of multiple F0 values from polyphonic and a cappella vocal performances using convolutional neural networks (CNNs). We address the major challenges of ensemble singing, i.e., all melodic sources are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-10 Helena Cuesta , Brian McFee , Emilia Gómez

Accompaniment arrangement is a difficult music generation task involving intertwined constraints of melody, harmony, texture, and music structure. Existing models are not yet able to capture all these constraints effectively, especially for…

Sound · Computer Science 2021-08-26 Jingwei Zhao , Gus Xia

Infinite impulse response filters are an essential building block of many time-varying audio systems, such as audio effects and synthesisers. However, their recursive structure impedes end-to-end training of these systems using automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Christopher Mitcheltree , Alistair Carson , Stefan Bilbao , Joshua D. Reiss , György Fazekas

With the advent of modern AI architectures, a shift has happened towards end-to-end architectures. This pivot has led to neural architectures being trained without domain-specific biases/knowledge, optimized according to the task. We in…

Sound · Computer Science 2025-05-08 Prateek Verma

This paper introduces PeriodWave-Turbo, a high-fidelity and high-efficient waveform generation model via adversarial flow matching optimization. Recently, conditional flow matching (CFM) generative models have been successfully adopted for…

Sound · Computer Science 2024-08-16 Sang-Hoon Lee , Ha-Yeong Choi , Seong-Whan Lee

Large language models (LLMs) are notoriously memory-intensive during training, particularly with the popular AdamW optimizer. This memory burden necessitates using more or higher-end GPUs or reducing batch sizes, limiting training…

Machine Learning · Computer Science 2025-02-18 Hanqing Zhu , Zhenyu Zhang , Wenyan Cong , Xi Liu , Sem Park , Vikas Chandra , Bo Long , David Z. Pan , Zhangyang Wang , Jinwon Lee

Generative adversarial networks have seen rapid development in recent years and have led to remarkable improvements in generative modelling of images. However, their application in the audio domain has received limited attention, and…

Adversarial attacks pose a severe threat to the reliability of deep learning models in remote sensing (RS) image classification. Most existing methods rely on direct pixel-wise perturbations, failing to exploit the inherent atmospheric…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Weiwei Zhuang , Wangze Xie , Qi Zhang , Xia Du , Zihan Lin , Zheng Lin , Hanlin Cai , Jizhe Zhou , Zihan Fang , Chi-man Pun , Wei Ni , Jun Luo

Existing stereo matching networks typically rely on either cost-volume construction based on 3D convolutions or deformation methods based on iterative optimization. The former incurs significant computational overhead during cost…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Ao Xu , Rujin Zhao , Xiong Xu , Boceng Huang , Yujia Jia , Hongfeng Long , Fuxuan Chen , Zilong Cao , Fangyuan Chen

A sound field synthesis method enhancing perceptual quality is proposed. Sound field synthesis using multiple loudspeakers enables spatial audio reproduction with a broad listening area; however, synthesis errors at high frequencies called…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-27 Keisuke Kimura , Shoichi Koyama , Hiroshi Saruwatari

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

We present AlphaApollo, an agentic reasoning system that targets two bottlenecks in foundation-model reasoning: (1) limited reasoning capacity for complex, long-horizon problem solving and (2) unreliable test-time evolution without…

Sound synthesizers are widespread in modern music production but they increasingly require expert skills to be mastered. This work focuses on interpolation between presets, i.e., sets of values of all sound synthesis parameters, to enable…

Sound · Computer Science 2023-03-10 Gwendal Le Vaillant , Thierry Dutoit

Advances in AIGC technologies have enabled the synthesis of highly realistic audio deepfakes capable of deceiving human auditory perception. Although numerous audio deepfake detection (ADD) methods have been developed, most rely on local…

Sound · Computer Science 2026-02-06 Qing Wen , Haohao Li , Zhongjie Ba , Peng Cheng , Miao He , Li Lu , Kui Ren

Recent advances in large language models have highlighted the critical need for precise control over model outputs through predefined constraints. While existing methods attempt to achieve this through either direct instruction-response…

Computation and Language · Computer Science 2025-03-27 Zhouhong Gu , Xingzhou Chen , Xiaoran Shi , Tao Wang , Suhang Zheng , Tianyu Li , Hongwei Feng , Yanghua Xiao

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings. Based on the sequence-to-sequence singing model, we design a multi-singer framework to leverage all the existing singing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-19 Jie Wu , Jian Luan

This study explores the design and application of Complex-Valued Convolutional Neural Networks (CVCNNs) in audio signal processing, with a focus on preserving and utilizing phase information often neglected in real-valued networks. We begin…

Machine Learning · Computer Science 2025-10-14 Naman Agrawal

Vision transformers have delivered tremendous success in representation learning. This is primarily due to effective token mixing through self attention. However, this scales quadratically with the number of pixels, which becomes infeasible…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 John Guibas , Morteza Mardani , Zongyi Li , Andrew Tao , Anima Anandkumar , Bryan Catanzaro

Automatic Speaker Verification (ASV) suffers from performance degradation in noisy conditions. To address this issue, we propose a novel adversarial learning framework that incorporates noise-disentanglement to establish a noise-independent…

Sound · Computer Science 2024-09-27 Xujiang Xing , Mingxing Xu , Thomas Fang Zheng