中文
相关论文

相关论文: Towards Lightweight Controllable Audio Synthesis w…

200 篇论文

Implicit neural representations (INRs) have emerged as a promising approach for video storage and processing, showing remarkable versatility across various video tasks. However, existing methods often fail to fully leverage their…

图像与视频处理 · 电气工程与系统科学 2024-03-19 Xinjie Zhang , Ren Yang , Dailan He , Xingtong Ge , Tongda Xu , Yan Wang , Hongwei Qin , Jun Zhang

Implicit neural representations (INRs) are a powerful paradigm for modeling data, offering a continuous alternative to discrete signal representations. Their ability to compactly encode complex signals has led to strong performance in many…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Pandula Thennakoon , Avishka Ranasinghe , Mario De Silva , Buwaneka Epakanda , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath

A Recurrent Neural Network (RNN) for audio synthesis is trained by augmenting the audio input with information about signal characteristics such as pitch, amplitude, and instrument. The result after training is an audio synthesizer that is…

声音 · 计算机科学 2018-05-31 Lonce Wyse

We present a perceptually-driven video compression framework integrating implicit neural representations (INRs) and pre-trained video diffusion models to address the extremely low bitrate regime (<0.05 bpp). Our approach exploits the…

图像与视频处理 · 电气工程与系统科学 2026-04-10 Eren Çetin , Lucas Relic , Yuanyi Xue , Markus Gross , Christopher Schroers , Roberto Azevedo

Reliably reconstructing physical fields from sparse sensor data is a challenge that frequently arises in many scientific domains. In practice, the process generating the data often is not understood to sufficient accuracy. Therefore, there…

机器学习 · 计算机科学 2024-01-23 Xihaier Luo , Wei Xu , Yihui Ren , Shinjae Yoo , Balu Nadiga

In an era where the exponential growth of image data driven by the Internet of Things (IoT) is outpacing traditional storage solutions, this work explores and advances the potential of Implicit Neural Representation (INR) as a…

图像与视频处理 · 电气工程与系统科学 2024-09-23 Sai Sanjeet , Seyyedali Hosseinalipour , Jinjun Xiong , Masahiro Fujita , Bibhu Datta Sahoo

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Encoding input coordinates with sinusoidal functions into multilayer perceptrons (MLPs) has proven effective for implicit neural representations (INRs) of low-dimensional signals, enabling the modeling of high-frequency details. However,…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Diana Aldana , João Paulo Lima , Daniel Csillag , Daniel Perazzo , Haoan Feng , Luiz Velho , Tiago Novello

X-ray ptychography provides exceptional nanoscale resolution and is widely applied in materials science, biology, and nanotechnology. However, its full potential is constrained by the critical challenge of accurately reconstructing images…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Tingyou Li , Zixin Xu , Zirui Gao , Hanfei Yan , Xiaojing Huang , Jizhou Li

Neural fields, also known as implicit neural representations (INRs), have shown a remarkable capability of representing, generating, and manipulating various data types, allowing for continuous data reconstruction at a low memory footprint.…

图像与视频处理 · 电气工程与系统科学 2024-02-29 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Implicit Neural Representations (INRs) have peaked interest in recent years due to their ability to encode natural signals using neural networks. While INRs allow for useful applications such as interpolating new coordinates and signal…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Maor Ashkenazi , Eran Treister

Directly learning to generate audio waveforms in an autoregressive manner is a challenging task, due to the length of the raw sequences and the existence of important structure on many different timescales. Traditional approaches based on…

声音 · 计算机科学 2025-10-06 Konrad Szewczyk , Daniel Gallo Fernández , James Townsend

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Despite recent advances in implicit neural representations (INRs), it remains challenging for a coordinate-based multi-layer perceptron (MLP) of INRs to learn a common representation across data instances and generalize it for unseen…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Chiheon Kim , Doyup Lee , Saehoon Kim , Minsu Cho , Wook-Shin Han

Implicit Neural Representations (INRs) have recently demonstrated impressive performance for video compression. However, since a separate INR must be overfit for each video, scaling to high-resolution videos while maintaining encoding…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Namitha Padmanabhan , Matthew Gwilliam , Abhinav Shrivastava

Deep neural networks can learn complex and abstract representations, that are progressively obtained by combining simpler ones. A recent trend in speech and speaker recognition consists in discovering these representations starting from raw…

音频与语音处理 · 电气工程与系统科学 2019-02-26 Mirco Ravanelli , Yoshua Bengio

Implicit neural representations (INRs) have recently emerged as a promising alternative to classical discretized representations of signals. Nevertheless, despite their practical success, we still do not understand how INRs represent…

机器学习 · 计算机科学 2022-03-28 Gizem Yüce , Guillermo Ortiz-Jiménez , Beril Besbinar , Pascal Frossard

Implicit Neural Representations (INRs) have recently shown impressive results, but their fundamental capacity, implicit biases, and scaling behavior remain poorly understood. We investigate the performance of diverse INRs across a suite of…

图像与视频处理 · 电气工程与系统科学 2025-10-27 Namhoon Kim , Sara Fridovich-Keil

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

音频与语音处理 · 电气工程与系统科学 2019-08-12 Mirco Ravanelli , Yoshua Bengio