English
Related papers

Related papers: DiffAU: Diffusion-Based Ambisonics Upscaling

200 papers

Recently, researchers have proposed various deep learning methods to accurately detect infrared targets with the characteristics of indistinct shape and texture. Due to the limited variety of infrared datasets, training deep learning models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yukai Shi , Yupei Lin , Pengxu Wei , Xiaoyu Xian , Tianshui Chen , Liang Lin

Data augmentation methods have shown great importance in diverse supervised learning problems where labeled data is scarce or costly to obtain. For sound event localization and detection (SELD) tasks several augmentation methods have been…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-20 Ricardo Falcon-Perez , Kazuki Shimada , Yuichiro Koyama , Shusuke Takahashi , Yuki Mitsufuji

The intersection of Astronomy and AI encounters significant challenges related to issues such as noisy backgrounds, lower resolution (LR), and the intricate process of filtering and archiving images from advanced telescopes like the James…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Mohammed Talha Alam , Raza Imam , Mohsen Guizani , Fakhri Karray

Diffusion models have recently emerged as a promising framework for Image Restoration (IR), owing to their ability to produce high-quality reconstructions and their compatibility with established methods. Existing methods for solving noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kyungsung Lee , Donggyu Lee , Myungjoo Kang

This work introduces a novel method for binaural reproduction from arbitrary microphone arrays, based on array-aware optimization of Ambisonics encoding through Head-Related Transfer Function (HRTF) pre-processing. The proposed approach…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-20 Yhonatan Gayer , Vladimir Tourbabin , Zamir Ben Hur , David Lou Alon , Boaz Rafaely

We present a novel generative modeling framework,Wavelet-Fourier-Diffusion, which adapts the diffusion paradigm to hybrid frequency representations in order to synthesize high-quality, high-fidelity images with improved spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Andrew Kiruluta , Andreas Lemos

This report presents the comprehensive implementation, evaluation, and optimization of Denoising Diffusion Probabilistic Models (DDPMs) and Denoising Diffusion Implicit Models (DDIMs), which are state-of-the-art generative models. During…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jaineet Shah , Michael Gromis , Rickston Pinto

We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks. While state-space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Hao Phung , Quan Dao , Trung Dao , Hoang Phan , Dimitris Metaxas , Anh Tran

Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and predict the system's…

Machine Learning · Statistics 2026-05-26 Lifu Wei , Yinuo Ren , Naichen Shi , Yiping Lu

Here we propose FastFCA-AS, an accelerated algorithm for Full-rank spatial Covariance Analysis (FCA), which is a robust audio source separation method proposed by Duong et al. ["Under-determined reverberant audio source separation using a…

Sound · Computer Science 2018-05-25 Nobutaka Ito , Tomohiro Nakatani

Diffusion models have demonstrated remarkable success in generative tasks, including audio super-resolution (SR). In many applications like movie post-production and album mastering, substantial computational budgets are available for…

Sound · Computer Science 2025-08-05 Yizhu Jin , Zhen Ye , Zeyue Tian , Haohe Liu , Qiuqiang Kong , Yike Guo , Wei Xue

Audio diffusion models can synthesize a wide variety of sounds. Existing models often operate on the latent domain with cascaded phase recovery modules to reconstruct waveform. This poses challenges when generating high-fidelity audio. In…

Sound · Computer Science 2023-11-21 Ge Zhu , Yutong Wen , Marc-André Carbonneau , Zhiyao Duan

Current generative models are able to generate high-quality artefacts but have been shown to struggle with compositional reasoning, which can be defined as the ability to generate complex structures from simpler elements. In this paper, we…

Machine Learning · Computer Science 2024-08-20 Giovanni Bindi , Philippe Esling

Dysarthric speech poses significant challenges for automatic speech recognition (ASR) systems due to its high variability and reduced intelligibility. In this work we explore the use of diffusion models for dysarthric speech enhancement,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Dimme de Groot , Tanvina Patel , Devendra Kayande , Odette Scharenborg , Zhengjun Yue

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks…

Image and Video Processing · Electrical Eng. & Systems 2023-06-22 Mingjie Pan , Yulu Gan , Fangxu Zhou , Jiaming Liu , Aimin Wang , Shanghang Zhang , Dawei Li

Classical methods for acoustic scene mapping require the estimation of time difference of arrival (TDOA) between microphones. Unfortunately, TDOA estimation is very sensitive to reverberation and additive noise. We introduce an unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Idan Cohen , Ofir Lindenbaum , Sharon Gannot

Recent years have seen immense progress in 3D computer vision and computer graphics, with emerging tools that can virtualize real-world 3D environments for numerous Mixed Reality (XR) applications. However, alongside immersive visual…

Sound · Computer Science 2024-06-12 Mason Wang , Ryosuke Sawata , Samuel Clarke , Ruohan Gao , Shangzhe Wu , Jiajun Wu

Diffusion models have recently emerged as a powerful framework for generative modeling. They consist of a forward process that perturbs input data with Gaussian white noise and a reverse process that learns a score function to generate…

Developing algorithms for sound classification, detection, and localization requires large amounts of flexible and realistic audio data, especially when leveraging modern machine learning and beamforming techniques. However, most existing…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-23 Luca Barbisan , Marco Levorato , Fabrizio Riente

Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Justin Tebbe , Jawad Tayyub