English
Related papers

Related papers: Ambisonizer: Neural Upmixing as Spherical Harmonic…

200 papers

Recent advances in deep learning have expanded possibilities to generate music, but generating a customizable full piece of music with consistent long-term structure remains a challenge. This paper introduces MusicFrameworks, a hierarchical…

Sound · Computer Science 2021-09-03 Shuqi Dai , Zeyu Jin , Celso Gomes , Roger B. Dannenberg

Deep learning models struggle with systematic compositional generalization, a hallmark of human cognition. We propose \textsc{Mirage}, a neuro-inspired dual-process model that offers a processing account for this ability. It combines a…

Artificial Intelligence · Computer Science 2025-10-29 Alex Noviello , Claas Beger , Jacob Groner , Kevin Ellis , Weinan Sun

Speech separation, the task of isolating multiple speech sources from a mixed audio signal, remains challenging in noisy environments. In this paper, we propose a generative correction method to enhance the output of a discriminative…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Helin Wang , Jesus Villalba , Laureano Moro-Velazquez , Jiarui Hai , Thomas Thebaud , Najim Dehak

In this paper, a parallel computing method is proposed to perform the background denoising and wheezing detection from a multi-channel recording captured during the auscultation process. The proposed system is based on a non-negative matrix…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-11 Antonio J. Muñoz-Montoro , Pablo Revuelta-Sanz , Damian Martínez-Muñoz , Juan Torre-Cruz , José Ranilla

We introduce materiomusic as a generative framework linking the hierarchical structures of matter with the compositional logic of music. Across proteins, spider webs and flame dynamics, vibrational and architectural principles recur as…

Machine Learning · Computer Science 2026-01-06 Markus J. Buehler

Modelling musical structure is vital yet challenging for artificial intelligence systems that generate symbolic music compositions. This literature review dissects the evolution of techniques for incorporating coherent structure, from…

Sound · Computer Science 2024-03-14 Keshav Bhandari , Simon Colton

This paper introduces a novel recurrent model for music composition that is tailored to the structure of polyphonic music. We propose an efficient new conditional probabilistic factorization of musical scores, viewing a score as a…

Sound · Computer Science 2019-11-28 John Thickstun , Zaid Harchaoui , Dean P. Foster , Sham M. Kakade

Linear spectral unmixing under nonnegativity and sum-to-one constraints is a convex optimization problem for which many algorithms were proposed. In practice, especially for supervised unmixing (i.e., with a large dictionary), solutions…

Signal Processing · Electrical Eng. & Systems 2025-12-19 Nils Foix-Colonier , Sébastien Bourguignon

Dynamical generative models that produce samples through an iterative process, such as Flow Matching and denoising diffusion models, have seen widespread use, but there have not been many theoretically-sound methods for improving these…

Machine Learning · Computer Science 2025-01-08 Carles Domingo-Enrich , Michal Drozdzal , Brian Karrer , Ricky T. Q. Chen

In this paper, we propose Universal Holistic Audio Generation (UniHAGen), a task for synthesizing comprehensive auditory scenes that include both on-screen and off-screen sounds across diverse domains (e.g., ambient events, musical…

Sound · Computer Science 2026-04-07 Weiguo Pian , Saksham Singh Kushwaha , Zhimin Chen , Shijian Deng , Kai Wang , Yunhui Guo , Yapeng Tian

In higher-order Ambisonics, a framework for sound field reproduction, secondary-source driving signals are generally obtained by regularized mode matching. The authors have proposed a regularization technique based on direction-of-arrival…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-25 Ryo Matsuda , Makoto Otani

Multi-subject personalized generation presents unique challenges in maintaining identity fidelity and semantic coherence when synthesizing images conditioned on multiple reference subjects. Existing methods often suffer from identity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Dong She , Siming Fu , Mushui Liu , Qiaoqiao Jin , Hualiang Wang , Mu Liu , Jidong Jiang

Automatic melody generation for pop music has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melody has turned out to be highly challenging due to a number of factors.…

Artificial intelligence and machine learning techniques have the promise to revolutionize the field of digital pathology. However, these models demand considerable amounts of data, while the availability of unbiased training data is…

Image and Video Processing · Electrical Eng. & Systems 2023-02-14 Nati Daniel , Eliel Aknin , Ariel Larey , Yoni Peretz , Guy Sela , Yael Fisher , Yonatan Savir

We introduce EgoSonics, a method to generate semantically meaningful and synchronized audio tracks conditioned on silent egocentric videos. Generating audio for silent egocentric videos could open new applications in virtual reality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Aashish Rai , Srinath Sridhar

A new framework is presented for generating musical audio using autoencoder neural networks. With the presented framework, called network modulation synthesis, users can create synthesis architectures and use novel generative algorithms to…

Sound · Computer Science 2025-09-30 Jeremy Hyrkas

In recent years, machine learning has been widely adopted to automate the audio mixing process. Automatic mixing systems have been applied to various audio effects such as gain-adjustment, equalization, and reverberation. These systems can…

Sound · Computer Science 2022-09-21 Satvik Venkatesh , David Moffat , Eduardo Reck Miranda

Speech enhancement in hearing aids remains a difficult task in nonstationary acoustic environments, mainly because current signal processing algorithms rely on fixed, manually tuned parameters that cannot adapt in situ to different users or…

We investigate enhanced harmonic generation processes in gain-assisted, near-zero permittivity metamaterials composed of spherical plasmonic nanoshells. We report the presence of narrow-band features in transmission, reflection and…

We develop a neural network architecture which, trained in an unsupervised manner as a denoising diffusion model, simultaneously learns to both generate and segment images. Learning is driven entirely by the denoising diffusion objective,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xin Yuan , Michael Maire