English
Related papers

Related papers: VI3NR: Variance Informed Initialization for Implic…

200 papers

Generating videos is a complex task that is accomplished by generating a set of temporally coherent images frame-by-frame. This limits the expressivity of videos to only image-based operations on the individual video frames needing network…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Bipasha Sen , Aditya Agarwal , Vinay P Namboodiri , C. V. Jawahar

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Brandon Yushan Feng , Susmija Jabbireddy , Amitabh Varshney

Implicit neural representations, represented by Neural Radiance Fields (NeRF), have dominated research in 3D computer vision by virtue of high-quality visual results and data-driven benefits. However, their realistic applications are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yaokun Li , Chao Gou , Guang Tan

Learning-based video compression is currently a popular research topic, offering the potential to compete with conventional standard video codecs. In this context, Implicit Neural Representations (INRs) have previously been used to…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Ho Man Kwan , Ge Gao , Fan Zhang , Andrew Gower , David Bull

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

We propose symmetric power transformation to enhance the capacity of Implicit Neural Representation~(INR) from the perspective of data transformation. Unlike prior work utilizing random permutation or index rearrangement, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Weixiang Zhang , Shuzhao Xie , Chengwei Ren , Shijia Ge , Mingzi Wang , Zhi Wang

Implicit Neural Representation (INR) has gained increasing popularity as a data representation method, serving as a prerequisite for innovative generation models. Unlike gradient-based methods, which exhibit lower efficiency in inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Shuyi Zhang , Ke Liu , Jingjun Gu , Xiaoxu Cai , Zhihua Wang , Jiajun Bu , Haishuai Wang

We study the interpolation capabilities of implicit neural representations (INRs) of images. In principle, INRs promise a number of advantages, such as continuous derivatives and arbitrary sampling, being freed from the restrictions of a…

Image and Video Processing · Electrical Eng. & Systems 2024-05-02 Lorenzo Luzi , Daniel LeJeune , Ali Siahkoohi , Sina Alemohammad , Vishwanath Saragadam , Hossein Babaei , Naiming Liu , Zichao Wang , Richard G. Baraniuk

Reconstructing continuous environmental fields from sparse and irregular observations remains a central challenge in environmental modelling and biodiversity informatics. Many ecological datasets are heterogeneous in space and time, making…

Machine Learning · Computer Science 2026-04-21 Agnieszka Pregowska , Hazem M. Kalaji

Recurrent neural networks (RNN) are used in many real-world text and speech applications. They include complex modules such as recurrence, exponential-based activation, gate interaction, unfoldable normalization, bi-directional dependence,…

Machine Learning · Computer Science 2022-02-16 Eyyüb Sari , Vanessa Courville , Vahid Partovi Nia

Normalizing flow models have been used successfully for generative image super-resolution (SR) by approximating complex distribution of natural images to simple tractable distribution in latent space through Invertible Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Min Zhang , Zhihong Pan , Xin Zhou , C. -C. Jay Kuo

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Activation functions critically influence trainability and expressivity, and recent work has therefore explored a broad range of nonlinearities. However, widely used Gaussian i.i.d. initializations are designed to preserve activation…

Machine Learning · Computer Science 2025-12-17 Hyunwoo Lee , Hayoung Choi , Hyunju Kim

The proper initialization of weights is crucial for the effective training and fast convergence of deep neural networks (DNNs). Prior work in this area has mostly focused on balancing the variance among weights per layer to maintain…

Machine Learning · Computer Science 2020-06-05 Maciej Skorski , Alessandro Temperoni , Martin Theobald

Deep neural networks (DNNs) have shown very promising results for various image restoration (IR) tasks. However, the design of network architectures remains a major challenging for achieving further improvements. While most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Weisheng Dong , Peiyao Wang , Wotao Yin , Guangming Shi , Fangfang Wu , Xiaotong Lu

Implicit neural representations (INRs) have achieved remarkable success in image representation and compression, but they require substantial training time and memory. Meanwhile, recent 2D Gaussian Splatting (GS) methods (\textit{e.g.},…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Tiantian Li , Xinjie Zhang , Xingtong Ge , Tongda Xu , Dailan He , Jun Zhang , Yan Wang

Implicit Neural Representations (INRs) encode discrete signals continuously while addressing spectral bias through activation functions (AFs). Previous approaches mitigate this bias by employing complex AFs, which often incur significant…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Wenyong Zhou , Boyu Li , Jiachen Ren , Taiqiang Wu , Zhilin Ai , Zhengwu Liu , Ngai Wong

Deep Learning (DL) methods can reconstruct highly accelerated magnetic resonance imaging (MRI) scans, but they rely on application-specific large training datasets and often generalize poorly to out-of-distribution data. Self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2026-04-24 Hongze Yu , Jeffrey A. Fessler , Yun Jiang

Initialization plays a critical role in Deep Neural Network training, directly influencing convergence, stability, and generalization. Common approaches such as Glorot and He initializations rely on randomness, which can produce uneven…

Machine Learning · Computer Science 2025-12-11 Alberto Fernández-Hernández , Jose I. Mestre , Manuel F. Dolz , Jose Duato , Enrique S. Quintana-Ortí

Implicit Neural Representations (INRs) have emerged as a powerful framework for modeling continuous signals. The spectral bias of ReLU-based networks is a well-established limitation, restricting their ability to capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Alireza Morsali , MohammadJavad Vaez , Mohammadhossein Soltani , Amirhossein Kazerouni , Babak Taati , Morteza Mohammad-Noori