English
Related papers

Related papers: Towards Lightweight Controllable Audio Synthesis w…

200 papers

High-resolution magnetic resonance imaging (MRI) is essential in clinical diagnosis. However, its long acquisition time remains a critical issue. Parallel imaging (PI) is a common approach to reduce acquisition time by periodically skipping…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Hao Li , Yusheng Zhou , Jianan Liu , Xiling Liu , Tao Huang , Zhihan Lyu , Weidong Cai , Wei Chen

Deep learning approaches have demonstrated success in modeling analog audio effects. Nevertheless, challenges remain in modeling more complex effects that involve time-varying nonlinear elements, such as dynamic range compressors. Existing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-18 Christian J. Steinmetz , Joshua D. Reiss

Recently, deep learning-based compressed sensing (CS) has achieved great success in reducing the sampling and computational cost of sensing systems and improving the reconstruction quality. These approaches, however, largely overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yu Zhou , Yu Chen , Xiao Zhang , Pan Lai , Lei Huang , Jianmin Jiang

Granular sound synthesis is a popular audio generation technique based on rearranging sequences of small waveform windows. In order to control the synthesis, all grains in a given corpus are analyzed through a set of acoustic descriptors.…

Sound · Computer Science 2021-07-06 Adrien Bitton , Philippe Esling , Tatsuya Harada

Recent advances in video compression introduce implicit neural representation (INR) based methods, which effectively capture global dependencies and characteristics of entire video sequences. Unlike traditional and deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Lv Tang , Jun Zhu , Xinfeng Zhang , Li Zhang , Siwei Ma , Qingming Huang

Modern speech enhancement algorithms achieve remarkable noise suppression by means of large recurrent neural networks (RNNs). However, large RNNs limit practical deployment in hearing aid hardware (HW) form-factors, which are battery…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Igor Fedorov , Marko Stamenovic , Carl Jensen , Li-Chia Yang , Ari Mandell , Yiming Gan , Matthew Mattina , Paul N. Whatmough

Most soundfield synthesis approaches deal with extensive and regular loudspeaker arrays, which are often not suitable for home audio systems, due to physical space constraints. In this article we propose a technique for soundfield synthesis…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-09 Luca Comanducci , Fabio Antonacci , Augusto Sarti

Non-autoregressive models greatly improve decoding speed over typical sequence-to-sequence models, but suffer from degraded performance. Infilling and iterative refinement models make up some of this gap by editing the outputs of a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-28 Ethan A. Chi , Julian Salazar , Katrin Kirchhoff

Implicit Neural Representations (INRs) model signals as continuous, differentiable functions. However, monolithic INRs scale poorly with data dimensionality, leading to excessive training costs. We propose F-INR, a framework that addresses…

Machine Learning · Computer Science 2025-11-27 Sai Karthikeya Vemuri , Tim Büchner , Joachim Denzler

This paper presents a novel approach to neural instrument sound synthesis using a two-stage semi-supervised learning framework capable of generating pitch-accurate, high-quality music samples from an expressive timbre latent space. Existing…

Sound · Computer Science 2025-10-07 Christian Limberg , Fares Schulz , Zhe Zhang , Stefan Weinzierl

Compression and reconstruction of visual data have been widely studied in the computer vision community, even before the popularization of deep learning. More recently, some have used deep learning to improve or refine existing pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Hao Chen , Matt Gwilliam , Bo He , Ser-Nam Lim , Abhinav Shrivastava

The development and progress in sensor, communication and computing technologies have led to data rich environments. In such environments, data can easily be acquired not only from the monitored entities but also from the surroundings where…

Machine Learning · Computer Science 2023-01-13 Rashmi Dutta Baruah , Mario Muñoz Organero

Neural Implicit Representation (NIR) has recently gained significant attention due to its remarkable ability to encode complex and high-dimensional data into representation space and easily reconstruct it through a trainable mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Haeyong Kang , Jaehong Yoon , DaHyun Kim , Sung Ju Hwang , Chang D Yoo

Implicit neural representations (INR) have been recently proposed as deep learning (DL) based solutions for image compression. An image can be compressed by training an INR model with fewer weights than the number of image pixels to map the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-28 Harry Gao , Weijie Gan , Zhixin Sun , Ulugbek S. Kamilov

Identifying changes in a pair of 3D aerial LiDAR point clouds, obtained during two distinct time periods over the same geographic region presents a significant challenge due to the disparities in spatial coverage and the presence of noise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Peter Naylor , Diego Di Carlo , Arianna Traviglia , Makoto Yamada , Marco Fiorucci

Multi-contrast MRI sequences allow for the acquisition of images with varying tissue contrast within a single scan. The resulting multi-contrast images can be used to extract quantitative information on tissue microstructure. To make such…

Image and Video Processing · Electrical Eng. & Systems 2025-09-08 Natascha Niessen , Carolin M. Pirkl , Ana Beatriz Solana , Hannah Eichhorn , Veronika Spieker , Wenqi Huang , Tim Sprenger , Marion I. Menzel , Julia A. Schnabel

Implicit neural representations (INRs) can parameterize continuous beamforming functions in continuous aperture arrays (CAPAs) and thus enable efficient online inference. Existing INR-based beamforming methods for CAPAs, however, typically…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Shiyong Chen , Jia Guo , Shengqian Han

Speech enhancement aims to improve speech quality and intelligibility, especially in noisy environments where background noise degrades speech signals. Currently, deep learning methods achieve great success in speech enhancement, e.g. the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Changjiang Zhao , Shulin He , Xueliang Zhang

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

Deep neural network architectures designed for application domains other than sound, especially image recognition, may not optimally harness the time-frequency representation when adapted to the sound recognition problem. In this work, we…

Machine Learning · Computer Science 2019-04-30 Fady Medhat , David Chesmore , John Robinson