English
Related papers

Related papers: Siamese SIREN: Audio Compression with Implicit Neu…

200 papers

Analysis and visualization of 3D microscopy images pose challenges due to anisotropic axial resolution, demanding volumetric super-resolution along the axial direction. While training a learning-based 3D super-resolution model seems to be a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Kyungryun Lee , Won-Ki Jeong

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Audio-driven facial reenactment is a crucial technique that has a range of applications in film-making, virtual avatars and video conferences. Existing works either employ explicit intermediate face representations (e.g., 2D facial…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ricong Huang , Peiwen Lai , Yipeng Qin , Guanbin Li

Compression and reconstruction of visual data have been widely studied in the computer vision community, even before the popularization of deep learning. More recently, some have used deep learning to improve or refine existing pipelines,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Hao Chen , Matt Gwilliam , Bo He , Ser-Nam Lim , Abhinav Shrivastava

Rendering immersive spatial audio in virtual reality (VR) and video games demands a fast and accurate generation of room impulse responses (RIRs) to recreate auditory environments plausibly. However, the conventional methods for simulating…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Jackie Lin , Georg Götz , Sebastian J. Schlecht

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a…

Image and Video Processing · Electrical Eng. & Systems 2024-05-02 Lorenzo Luzi , Daniel LeJeune , Ali Siahkoohi , Sina Alemohammad , Vishwanath Saragadam , Hossein Babaei , Naiming Liu , Zichao Wang , Richard G. Baraniuk

Implicit representation of an image can map arbitrary coordinates in the continuous domain to their corresponding color values, presenting a powerful capability for image reconstruction. Nevertheless, existing implicit representation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Canyu Zhang , Xiaoguang Li , Qing Guo , Song Wang

Synthetic aperture radar (SAR) is a tomographic sensor that measures 2D slices of the 3D spatial Fourier transform of the scene. In many operational scenarios, the measured set of 2D slices does not fill the 3D space in the Fourier domain,…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Nithin Sugavanam , Emre Ertin

Personalised 3D vascular models are valuable for diagnosis, prognosis and treatment planning in patients with cardiovascular disease. Traditionally, such models have been constructed with explicit representations such as meshes and voxel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Dieuwertje Alblas , Christoph Brune , Kak Khee Yeung , Jelmer M. Wolterink

SIREN is a flexible, extensible, and customizable web-based general-purpose interface for auditory data display (sonification). Designed as a digital audio workstation for sonification, synthesizers written in JavaScript using the Web Audio…

Sound · Computer Science 2024-04-01 Tristan Peng , Hongchan Choi , Jonathan Berger

Existing methods for spectral reconstruction usually learn a discrete mapping from RGB images to a number of spectral bands. However, this modeling strategy ignores the continuous nature of spectral signature. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Ruikang Xu , Mingde Yao , Chang Chen , Lizhi Wang , Zhiwei Xiong

Implicit representation mapping (IRM) can translate image features to any continuous resolution, showcasing its potent capability for ultra-high-resolution image segmentation refinement. Current IRM-based methods for refining…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ziyu Zhao , Xiaoguang Li , Pingping Cai , Canyu Zhang , Song Wang

Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems. However, the expressive power of INR is limited by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Hao Zhu , Shaowen Xie , Zhen Liu , Fengyi Liu , Qi Zhang , You Zhou , Yi Lin , Zhan Ma , Xun Cao

Acquiring and utilizing accurate channel state information (CSI) can significantly improve transmission performance, thereby holding a crucial role in realizing the potential advantages of massive multiple-input multiple-output (MIMO)…

Information Theory · Computer Science 2024-03-21 Haotian Wu , Maojun Zhang , Yulin Shao , Krystian Mikolajczyk , Deniz Gündüz

This paper proposes a regularizer called Implicit Neural Representation Regularizer (INRR) to improve the generalization ability of the Implicit Neural Representation (INR). The INR is a fully connected network that can represent signals…

Machine Learning · Computer Science 2023-03-29 Zhemin Li , Hongxia Wang , Deyu Meng

Multispectral satellite images play a vital role in agriculture, fisheries, and environmental monitoring. However, their high dimensionality, large data volumes, and diverse spatial resolutions across multiple channels pose significant…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Woojin Cho , Steve Andreas Immanuel , Junhyuk Heo , Darongsae Kwon

This paper observes the application of the Compressive Sensing in reconstruction of the under-sampled iris images. Iris recognition represents form of biometric identification whose usage in real applications is growing. Compressive Sensing…

Image and Video Processing · Electrical Eng. & Systems 2019-02-11 Radoje Darmanovic , Tamara Bulatovic , Seid Salkovic

3D Human Mesh Reconstruction (HMR) from 2D RGB images faces challenges in environments with poor lighting, privacy concerns, or occlusions. These weaknesses of RGB imaging can be complemented by acoustic signals, which are widely available,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xiaoxuan Liang , Wuyang Zhang , Hong Zhou , Zhaolong Wei , Sicheng Zhu , Yansong Li , Rui Yin , Jiantao Yuan , Jeremy Gummeson

In this study, we introduce a method for estimating sound fields in reverberant environments using a conditional invertible neural network (CINN). Sound field reconstruction can be hindered by experimental errors, limited spatial data,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Xenofon Karakonstantis , Efren Fernandez-Grande , Peter Gerstoft