English
Related papers

Related papers: Upsampling artifacts in neural audio synthesis

200 papers

Music, speech, and acoustic scene sound are often handled separately in the audio domain because of their different signal characteristics. However, as the image domain grows rapidly by versatile image classification models, it is necessary…

Sound · Computer Science 2017-12-05 Jongpil Lee , Taejun Kim , Jiyoung Park , Juhan Nam

Conventional audio classification relied on predefined classes, lacking the ability to learn from free-form text. Recent methods unlock learning joint audio-text embeddings from raw audio-text pairs describing audio in natural language.…

Multimedia · Computer Science 2024-01-11 Ali Vosoughi , Luca Bondi , Ho-Hsiang Wu , Chenliang Xu

To detect GAN generated images, conventional supervised machine learning algorithms require collection of a number of real and fake images from the targeted GAN model. However, the specific model used by the attacker is often unavailable.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Xu Zhang , Svebor Karaman , Shih-Fu Chang

With the rapid advancement of generative audio models, distinguishing between human-composed and generated music is becoming increasingly challenging. As a response, models for detecting fake music have been proposed. In this work, we…

Sound · Computer Science 2025-07-15 Tomasz Sroka , Tomasz Wężowicz , Dominik Sidorczuk , Mateusz Modrzejewski

Lossy compression introduces complex compression artifacts, particularly the blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, or restores sharpened…

Computer Vision and Pattern Recognition · Computer Science 2015-04-28 Chao Dong , Yubin Deng , Chen Change Loy , Xiaoou Tang

In spite of recent progress, image diffusion models still produce artifacts. A common solution is to leverage the feedback provided by quality assessment systems or human annotators to optimize the model, where images are generally rated in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yiyang Wang , Xi Chen , Xiaogang Xu , Sihui Ji , Yu Liu , Yujun Shen , Hengshuang Zhao

Artifacts pose a significant challenge in medical imaging, impacting diagnostic accuracy and downstream analysis. While image-based approaches for detecting artifacts can be effective, they often rely on preprocessing methods that can lead…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Caner Özer , Patryk Rygiel , Bram de Wilde , İlkay Öksüz , Jelmer M. Wolterink

Understanding how cognitive and social mechanisms shape the evolution of complex artifacts such as songs is central to cultural evolution research. Social network topology (what artifacts are available?), selection (which are chosen?), and…

Social and Information Networks · Computer Science 2025-02-19 Raja Marjieh , Manuel Anglada-Tort , Thomas L. Griffiths , Nori Jacoby

Anti-spoofing for automatic speaker verification is now a well established area of research, with three competitive challenges having been held in the last 6 years. A great deal of research effort over this time has been invested into the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Hemlata Tak , Jose Patino , Andreas Nautsch , Nicholas Evans , Massimiliano Todisco

In recent years, many software engineering researchers have begun to include artifacts alongside their research papers. Ideally, artifacts, including tools, benchmarks, and data, support the dissemination of ideas, provide evidence for…

Software Engineering · Computer Science 2021-05-05 Christopher S. Timperley , Lauren Herckis , Claire Le Goues , Michael Hilton

A large number of works view the automatic assessment of speech from an utterance- or system-level perspective. While such approaches are good in judging overall quality, they cannot adequately explain why a certain score was assigned to an…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Michael Kuhlmann , Alexander Werning , Thilo von Neumann , Reinhold Haeb-Umbach

Recent unsupervised representation learning methods have shown to be effective in a range of vision tasks by learning representations invariant to data augmentations such as random cropping and color jittering. However, such invariance…

Machine Learning · Computer Science 2021-11-19 Hankook Lee , Kibok Lee , Kimin Lee , Honglak Lee , Jinwoo Shin

The ever-increasing use of synthetically generated content in different sectors of our everyday life, one for all media information, poses a strong need for deepfake detection tools in order to avoid the proliferation of altered messages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Andrea Ciamarra , Roberto Caldelli , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

Most recent works on optical flow use convex upsampling as the last step to obtain high-resolution flow. In this work, we show and discuss several issues and limitations of this currently widely adopted convex upsampling approach. We…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Alexander Gielisse , Nergis Tömen , Jan van Gemert

Generative models in vision have seen rapid progress due to algorithmic improvements and the availability of high-quality image datasets. In this paper, we offer contributions in both these areas to enable similar progress in audio…

Machine Learning · Computer Science 2017-04-06 Jesse Engel , Cinjon Resnick , Adam Roberts , Sander Dieleman , Douglas Eck , Karen Simonyan , Mohammad Norouzi

While both the data volume and heterogeneity of the digital music content is huge, it has become increasingly important and convenient to build a recommendation or search system to facilitate surfacing these content to the user or consumer…

Controllable neural audio synthesis of sound effects is a challenging task due to the potential scarcity and spectro-temporal variance of the data. Differentiable digital signal processing (DDSP) synthesisers have been successfully employed…

Sound · Computer Science 2024-10-28 Adrián Barahona-Ríos , Tom Collins

Most deep learning-based multi-channel speech enhancement methods focus on designing a set of beamforming coefficients to directly filter the low signal-to-noise ratio signals received by microphones, which hinders the performance of these…

Sound · Computer Science 2022-02-08 Wenzhe Liu , Andong Li , Chengshi Zheng , Xiaodong Li

Audio fingerprinting is a well-established solution for song identification from short recording excerpts. Popular methods rely on the extraction of sparse representations, generally spectral peaks, and have proven to be accurate, fast, and…

Sound · Computer Science 2023-10-31 Kamil Akesbi , Dorian Desblancs , Benjamin Martin

Downsampling is one of the most basic image processing operations. Improper spatio-temporal downsampling applied on videos can cause aliasing issues such as moir\'e patterns in space and the wagon-wheel effect in time. Consequently, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xiaoyu Xiang , Yapeng Tian , Vijay Rengarajan , Lucas Young , Bo Zhu , Rakesh Ranjan