English
Related papers

Related papers: Towards Lightweight Controllable Audio Synthesis w…

200 papers

Implicit neural representations (INRs) have emerged as a promising approach for video storage and processing, showing remarkable versatility across various video tasks. However, existing methods often fail to fully leverage their…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Xinjie Zhang , Ren Yang , Dailan He , Xingtong Ge , Tongda Xu , Yan Wang , Hongwei Qin , Jun Zhang

Implicit neural representations (INRs) are a powerful paradigm for modeling data, offering a continuous alternative to discrete signal representations. Their ability to compactly encode complex signals has led to strong performance in many…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Pandula Thennakoon , Avishka Ranasinghe , Mario De Silva , Buwaneka Epakanda , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath

A Recurrent Neural Network (RNN) for audio synthesis is trained by augmenting the audio input with information about signal characteristics such as pitch, amplitude, and instrument. The result after training is an audio synthesizer that is…

Sound · Computer Science 2018-05-31 Lonce Wyse

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

Machine Learning · Computer Science 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Sai Sanjeet , Seyyedali Hosseinalipour , Jinjun Xiong , Masahiro Fujita , Bibhu Datta Sahoo

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Encoding input coordinates with sinusoidal functions into multilayer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of low-dimensional signals, enabling the modeling of high-frequency details. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Diana Aldana , João Paulo Lima , Daniel Csillag , Daniel Perazzo , Haoan Feng , Luiz Velho , Tiago Novello

X-ray ptychography provides exceptional nanoscale resolution and is widely applied in materials science, biology, and nanotechnology. However, its full potential is constrained by the critical challenge of accurately reconstructing images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Tingyou Li , Zixin Xu , Zirui Gao , Hanfei Yan , Xiaojing Huang , Jizhou Li

Neural fields, also known as implicit neural representations (INRs), have shown a remarkable capability of representing, generating, and manipulating various data types, allowing for continuous data reconstruction at a low memory footprint.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Implicit Neural Representations (INRs) have peaked interest in recent years due to their ability to encode natural signals using neural networks. While INRs allow for useful applications such as interpolating new coordinates and signal…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Maor Ashkenazi , Eran Treister

Directly learning to generate audio waveforms in an autoregressive manner is a challenging task, due to the length of the raw sequences and the existence of important structure on many different timescales. Traditional approaches based on…

Sound · Computer Science 2025-10-06 Konrad Szewczyk , Daniel Gallo Fernández , James Townsend

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Despite recent advances in implicit neural representations (INRs), it remains challenging for a coordinate-based multi-layer perceptron (MLP) of INRs to learn a common representation across data instances and generalize it for unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Chiheon Kim , Doyup Lee , Saehoon Kim , Minsu Cho , Wook-Shin Han

Implicit Neural Representations (INRs) have recently demonstrated impressive performance for video compression. However, since a separate INR must be overfit for each video, scaling to high-resolution videos while maintaining encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Namitha Padmanabhan , Matthew Gwilliam , Abhinav Shrivastava

Deep neural networks can learn complex and abstract representations, that are progressively obtained by combining simpler ones. A recent trend in speech and speaker recognition consists in discovering these representations starting from raw…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-26 Mirco Ravanelli , Yoshua Bengio

Implicit neural representations (INRs) have recently emerged as a promising alternative to classical discretized representations of signals. Nevertheless, despite their practical success, we still do not understand how INRs represent…

Machine Learning · Computer Science 2022-03-28 Gizem Yüce , Guillermo Ortiz-Jiménez , Beril Besbinar , Pascal Frossard

Implicit Neural Representations (INRs) have recently shown impressive results, but their fundamental capacity, implicit biases, and scaling behavior remain poorly understood. We investigate the performance of diverse INRs across a suite of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-27 Namhoon Kim , Sara Fridovich-Keil

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio