English
Related papers

Related papers: Towards Lightweight Controllable Audio Synthesis w…

200 papers

This paper introduces {HINER}, a novel neural representation for compressing HSI and ensuring high-quality downstream tasks on compressed HSI. HINER fully exploits inter-spectral correlations by explicitly encoding of spectral wavelengths…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Junqi Shi , Mingyi Jiang , Ming Lu , Tong Chen , Xun Cao , Zhan Ma

The scanning time for a fully sampled MRI can be undesirably lengthy. Compressed sensing has been developed to minimize image artifacts in accelerated scans, but the required iterative reconstruction is computationally complex and difficult…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Di Xu , Hengjie Liu , Xin Miao , Daniel O'Connor , Jessica E. Scholey , Wensha Yang , Mary Feng , Michael Ohliger , Hui Lin , Dan Ruan , Yang Yang , Ke Sheng

Implicit Neural Representations (INR) or neural fields have emerged as a popular framework to encode multimedia signals such as images and radiance fields while retaining high-quality. Recently, learnable feature grids proposed by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Sharath Girish , Abhinav Shrivastava , Kamal Gupta

We present a deep neural network-based methodology for synthesising percussive sounds with control over high-level timbral characteristics of the sounds. This approach allows for intuitive control of a synthesizer, enabling the user to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 António Ramires , Pritish Chandna , Xavier Favory , Emilia Gómez , Xavier Serra

We propose symmetric power transformation to enhance the capacity of Implicit Neural Representation~(INR) from the perspective of data transformation. Unlike prior work utilizing random permutation or index rearrangement, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Weixiang Zhang , Shuzhao Xie , Chengwei Ren , Shijia Ge , Mingzi Wang , Zhi Wang

Speech enhancement algorithms based on deep learning have been improved in terms of speech intelligibility and perceptual quality greatly. Many methods focus on enhancing the amplitude spectrum while reconstructing speech using the mixture…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-10 Qinglong Li , Fei Gao , Haixin Guan , Kaichi Ma

We introduce Temporal Variational Implicit Neural Representations (TV-INRs), a probabilistic framework for modeling irregular multivariate time series that enables efficient individualized imputation and forecasting. By integrating implicit…

Machine Learning · Computer Science 2025-06-03 Batuhan Koyuncu , Rachael DeVries , Ole Winther , Isabel Valera

Recent developments in acoustic signal processing have seen the integration of deep learning methodologies, alongside the continued prominence of classical wave expansion-based approaches, particularly in sound field reconstruction.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Marco Olivieri , Xenofon Karakonstantis , Mirco Pezzoli , Fabio Antonacci , Augusto Sarti , Efren Fernandez-Grande

Implicit Neural Representations (INRs), also known as neural fields, have emerged as a powerful paradigm in deep learning, parameterizing continuous spatial fields using coordinate-based neural networks. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yichi Zhang , Qianqian Yang

Blind Compressed Image Restoration (CIR) has garnered significant attention due to its practical applications. It aims to mitigate compression artifacts caused by unknown quality factors, particularly with JPEG codecs. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Bingchen Li , Xin Li , Yiting Lu , Ruoyu Feng , Mengxi Guo , Shijie Zhao , Li Zhang , Zhibo Chen

Transformers have rapidly increased in popularity in recent years, achieving state-of-the-art performance in processing text, images, audio and video. However, Transformers present large computational requirements for both training and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Amrit Nagarajan , Anand Raghunathan

Automated classification of animal sounds is a prerequisite for large-scale monitoring of biodiversity. Convolutional Neural Networks (CNNs) are among the most promising algorithms but they are slow, often achieve poor classification in the…

In recent studies on MRI reconstruction, advances have shown significant promise for further accelerating the MRI acquisition. Most state-of-the-art methods require a large amount of fully-sampled data to optimise reconstruction models,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-04 Junwei Yang , Pietro Liò

In audio processing applications, the generation of expressive sounds based on high-level representations demonstrates a high demand. These representations can be used to manipulate the timbre and influence the synthesis of creative…

Sound · Computer Science 2023-01-19 Anastasia Natsiou , Luca Longo , Sean O'Leary

The focus of this work is to study how to efficiently tailor Convolutional Neural Networks (CNNs) towards learning timbre representations from log-mel magnitude spectrograms. We first review the trends when designing CNN architectures.…

Sound · Computer Science 2017-06-05 Jordi Pons , Olga Slizovskaia , Rong Gong , Emilia Gómez , Xavier Serra

We explore a novel way of conceptualising the task of polyphonic music transcription, using so-called invertible neural networks. Invertible models unify both discriminative and generative aspects in one function, sharing one set of…

Sound · Computer Science 2019-09-05 Rainer Kelz , Gerhard Widmer

Implicit Neural Representations (INRs) have emerged as a promising paradigm for video compression. However, existing INR-based frameworks typically suffer from inherent spectral bias, which favors low-frequency components and leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jun Zhu , Xinfeng Zhang , Lv Tang , Junhao Jiang , Gai Zhang , Jia Wang

Implicit Neural Representations (INRs) based on vanilla Multi-Layer Perceptrons (MLPs) are widely believed to be incapable of representing high-frequency content. This has directed research efforts towards architectural interventions, such…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Julian McGinnis , Florian A. Hölzl , Suprosanna Shit , Florentin Bieder , Paul Friedrich , Mark Mühlau , Björn Menze , Daniel Rueckert , Benedikt Wiestler

Efficient and fast reconstruction of anatomical structures plays a crucial role in clinical practice. Minimizing retrieval and processing times not only potentially enhances swift response and decision-making in critical scenarios but also…

Designed to learn long-range interactions on sequential data, transformers continue to show state-of-the-art results on a wide variety of tasks. In contrast to CNNs, they contain no inductive bias that prioritizes local interactions. This…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Patrick Esser , Robin Rombach , Björn Ommer