English
Related papers

Related papers: Upsampling artifacts in neural audio synthesis

200 papers

Advancements in AI-synthesized human voices have created a growing threat of impersonation and disinformation, making it crucial to develop methods to detect synthetic human voices. This study proposes a new approach to identifying…

Sound · Computer Science 2023-04-28 Chengzhe Sun , Shan Jia , Shuwei Hou , Siwei Lyu

Researchers recently found out that sometimes language models achieve high accuracy on benchmark data set, but they can not generalize very well with even little changes to the original data set. This is sometimes due to data artifacts,…

Computation and Language · Computer Science 2024-01-26 Han Chen

In this paper, we propose a fixed convolutional layer with an order of smoothness not only for avoiding checkerboard artifacts in convolutional neural networks (CNNs) but also for enhancing the performance of CNNs, where the smoothness of…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Yuma Kinoshita , Hitoshi Kiya

The rise of deep learning algorithms has led many researchers to withdraw from using classic signal processing methods for sound generation. Deep learning models have achieved expressive voice synthesis, realistic sound textures, and…

Sound · Computer Science 2022-01-10 Anastasia Natsiou , Sean O'Leary

Recurrent neural networks (RNNs) are effective at emulating the non-linear, stateful behavior of analog guitar amplifiers and distortion effects. Unlike the case of direct circuit simulation, RNNs have a fixed sample rate encoded in their…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-31 Alistair Carson , Alec Wright , Stefan Bilbao

Existing audio analysis methods generally first transform the audio stream to spectrogram, and then feed it into CNN for further analysis. A standard CNN recognizes specific visual patterns over feature map, then pools for high-level…

Sound · Computer Science 2023-03-16 Yulin Pan , Xiangteng He , Biao Gong , Yuxin Peng , Yiliang Lv

Ultrasound (US) imaging is a fast and non-invasive imaging modality which is widely used for real-time clinical imaging applications without concerning about radiation hazard. Unfortunately, it often suffers from poor visual quality from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Shujaat Khan , Jaeyoung Huh , Jong Chul Ye

While extracting the temporal dynamical features based on the time-frequency analyses, like the reassignment and synchrosqueezing transform, attracts more and more interest in bio-medical data analysis, we should be careful about artifacts…

Applications · Statistics 2015-12-16 Yu-Ting Lin , Patrick Flandrin , Hau-tieng Wu

Reducing noise interference is crucial for automatic speech recognition (ASR) in a real-world scenario. However, most single-channel speech enhancement (SE) generates "processing artifacts" that negatively affect ASR performance. Hence, in…

Sound · Computer Science 2023-08-25 Kuan-Hsun Ho , En-Lun Yu , Jeih-weih Hung , Berlin Chen

Given a set of ordered pixel data in the form of an image, our goal is to perform upsampling on the data such that: the resulting resolution is improved by some factor, the final result passes the human test, having added new, believable,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Evan Matthews , Nicolas Prate

Electroencephalogram (EEG) recordings are often contaminated with artifacts. Various methods have been developed to eliminate or weaken the influence of artifacts. However, most of them rely on prior experience for analysis. Here, we…

Machine Learning · Computer Science 2022-02-22 Junjie Yu , Chenyi Li , Kexin Lou , Chen Wei , Quanying Liu

This paper seeks to develop a deeper understanding of the fundamental properties of neural text generations models. The study of artifacts that emerge in machine generated text as a result of modeling choices is a nascent research area.…

Computation and Language · Computer Science 2020-04-15 Yi Tay , Dara Bahri , Che Zheng , Clifford Brunk , Donald Metzler , Andrew Tomkins

Electroencephalograms (EEG) are often contaminated by artifacts which make interpreting them more challenging for clinicians. Hence, automated artifact recognition systems have the potential to aid the clinical workflow. In this abstract,…

Signal Processing · Electrical Eng. & Systems 2019-03-20 Subhrajit Roy

Image inpainting has earned substantial progress, owing to the encoder-and-decoder pipeline, which is benefited from the Convolutional Neural Networks (CNNs) with convolutional downsampling to inpaint the masked regions semantically from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Haipeng Liu , Yang Wang , Biao Qian , Yong Rui , Meng Wang

Large language models (LLMs) have facilitated the generation of high-quality, cost-effective synthetic data for developing downstream models and conducting statistical analyses in various domains. However, the increased reliance on…

Machine Learning · Computer Science 2025-02-04 Yixin Wu , Ziqing Yang , Yun Shen , Michael Backes , Yang Zhang

In recent years, machine learning approaches to modelling guitar amplifiers and effects pedals have been widely investigated and have become standard practice in some consumer products. In particular, recurrent neural networks (RNNs) are a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Alistair Carson , Alec Wright , Jatin Chowdhury , Vesa Välimäki , Stefan Bilbao

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored.…

Recent advancements in text-to-speech technologies enable generating high-fidelity synthetic speech nearly indistinguishable from real human voices. While recent studies show the efficacy of self-supervised learning-based speech encoders…

Sound · Computer Science 2026-03-24 Kyudan Jung , Jihwan Kim , Minwoo Lee , Soyoon Kim , Jeonghoon Kim , Jaegul Choo , Cheonbok Park

Audio processing methods based on deep neural networks are typically trained at a single sampling frequency (SF). To handle untrained SFs, signal resampling is commonly employed, but it can degrade performance, particularly when the input…

Sound · Computer Science 2026-01-22 Kanami Imamura , Tomohiko Nakamura , Kohei Yatabe , Hiroshi Saruwatari

We introduce an audio texture synthesis algorithm based on scattering moments. A scattering transform is computed by iteratively decomposing a signal with complex wavelet filter banks and computing their amplitude envelop. Scattering…

Applications · Statistics 2013-11-05 Joan Bruna , Stéphane Mallat