English
Related papers

Related papers: Toward Complex-Valued Neural Networks for Waveform…

200 papers

We present a modification to the spectrum differential based direct waveform modification for voice conversion (DIFFVC) so that it can be directly applied as a waveform generation module to voice conversion models. The recently proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-30 Wen-Chin Huang , Yi-Chiao Wu , Kazuhiro Kobayashi , Yu-Huai Peng , Hsin-Te Hwang , Patrick Lumban Tobing , Yu Tsao , Hsin-Min Wang , Tomoki Toda

GAN vocoders are currently one of the state-of-the-art methods for building high-quality neural waveform generative models. However, most of their architectures require dozens of billion floating-point operations per second (GFLOPS) to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Ahmed Mustafa , Jean-Marc Valin , Jan Büthe , Paris Smaragdis , Mike Goodwin

Neural source-filter (NSF) models are deep neural networks that produce waveforms given input acoustic features. They use dilated-convolution-based neural filter modules to filter sine-based excitation for waveform generation, which is…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-28 Xin Wang , Junichi Yamagishi

In this article, we present a new EEG signal classification framework by integrating the complex-valued and real-valued Convolutional Neural Network(CNN) with discrete Fourier transform (DFT). The proposed neural network architecture…

Machine Learning · Computer Science 2022-08-01 Hang Du , Rebecca Pillai Riddell , Xiaogang Wang

Neural waveform models such as the WaveNet are used in many recent text-to-speech systems, but the original WaveNet is quite slow in waveform generation because of its autoregressive (AR) structure. Although faster non-AR models were…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-30 Xin Wang , Shinji Takaki , Junichi Yamagishi

At present, the great achievements of convolutional neural network(CNN) in feature and metric learning have attracted many researchers. However, the vast majority of deep network architectures have been used to represent based on real…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Siwen Jiang , Wenxuan Wei , Shihao Guo , Hongguang Fu , Lei Huang

We propose a complex-valued neural-network (CV-NN) framework to optimally configure stacked intelligent surfaces (SIS) in next-generation multi-antenna systems. Unlike conventional solutions that separately tune analog metasurface phases or…

Information Theory · Computer Science 2025-09-09 Abdullah Zayat , Omran Abbas , Loic Markley , Anas Chaaban

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

Most modern text-to-speech architectures use a WaveNet vocoder for synthesizing high-fidelity waveform audio, but there have been limitations, such as high inference time, in its practical application due to its ancestral sampling scheme.…

Sound · Computer Science 2019-05-21 Sungwon Kim , Sang-gil Lee , Jongyoon Song , Jaehyeon Kim , Sungroh Yoon

Recently deep learning-based image compression has shown the potential to outperform traditional codecs. However, most existing methods train multiple networks for multiple bit rates, which increase the implementation complexity. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones;…

In this paper, we propose an invertible deep learning framework called INVVC for voice conversion. It is designed against the possible threats that inherently come along with voice conversion systems. Specifically, we develop an invertible…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-27 Zexin Cai , Ming Li

Most GAN(Generative Adversarial Network)-based approaches towards high-fidelity waveform generation heavily rely on discriminators to improve their performance. However, GAN methods introduce much uncertainty into the generation process and…

Sound · Computer Science 2022-03-22 Shengyuan Xu , Wenxiao Zhao , Jing Guo

Recently, the connectionist temporal classification (CTC) model coupled with recurrent (RNN) or convolutional neural networks (CNN), made it easier to train speech recognition systems in an end-to-end fashion. However in real-valued models,…

Active research is currently underway to enhance the efficiency of vision transformers (ViTs). Most studies have focused solely on effective token mixers, overlooking the potential relationship with normalization. To boost diverse feature…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jongseong Bae , Susang Kim , Minsu Cho , Ha Young Kim

Recent advances in fMRI-based visual decoding have enabled compelling reconstructions of perceived images. However, most approaches rely on subject-specific training, limiting scalability and practical deployment. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Chenqian Le , Yilin Zhao , Nikasadat Emami , Kushagra Yadav , Xujin "Chris" Liu , Xupeng Chen , Yao Wang

Vision transformer based models bring significant improvements for image segmentation tasks. Although these architectures offer powerful capabilities irrespective of specific segmentation tasks, their use of computational resources can be…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Manyi Yao , Abhishek Aich , Yumin Suh , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker

Selecting appropriate inductive biases is an essential step in the design of machine learning models, especially when working with audio, where even short clips may contain millions of samples. To this end, we propose the combolutional…

Sound · Computer Science 2025-08-06 Cameron Churchwell , Minje Kim , Paris Smaragdis

This paper provides an in-depth analysis of Wave Network, a novel token representation method derived from the Wave Network, designed to capture both global and local semantics of input text through wave-inspired complex vectors. In complex…

Computation and Language · Computer Science 2025-01-14 Xin Zhang , Victor S. Sheng

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

Sound · Computer Science 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel