English
Related papers

Related papers: Boosting Neural Video Representation via Online St…

200 papers

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are…

Machine Learning · Computer Science 2023-11-10 Anastasiia Prutianova , Alexey Zaytsev , Chung-Kuei Lee , Fengyu Sun , Ivan Koryakovskiy

Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu , Kalyan Sunkavalli , Ulrich Neumann

Novel view synthesis is a long-standing problem in machine learning and computer vision. Significant progress has recently been made in developing neural scene representations and rendering techniques that synthesize photorealistic images…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Alexander W. Bergman , Petr Kellnhofer , Gordon Wetzstein

Recent advances in image super-resolution (SR) explored the power of deep learning to achieve a better reconstruction performance. However, the feedback mechanism, which commonly exists in human visual system, has not been fully exploited…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Zhen Li , Jinglei Yang , Zheng Liu , Xiaomin Yang , Gwanggil Jeon , Wei Wu

There has been a growing interest in using different approaches to improve the coding efficiency of modern video codec in recent years as demand for web-based video consumption increases. In this paper, we propose a model-based approach…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Chichen Fu , Di Chen , Edward J. Delp , Zoe Liu , Fengqing Zhu

Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Christian Simon , Sen He , Juan-Manuel Perez-Rua , Mengmeng Xu , Amine Benhalloum , Tao Xiang

We introduce a novel neural volumetric pose feature, termed PoseMap, designed to enhance camera localization by encapsulating the information between images and the associated camera poses. Our framework leverages an Absolute Pose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jingyu Lin , Jiaqi Gu , Bojian Wu , Lubin Fan , Renjie Chen , Ligang Liu , Jieping Ye

We present a novel 3D mapping method leveraging the recent progress in neural implicit representation for 3D reconstruction. Most existing state-of-the-art neural implicit representation methods are limited to object-level reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Stefan Lionar , Lukas Schmid , Cesar Cadena , Roland Siegwart , Andrei Cramariuc

This paper focuses on the task of quality enhancement for compressed videos. Although deep network-based video restorers achieve impressive progress, most of the existing methods lack a structured design to optimally leverage the priors…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Hanchi Sun , Xiaohong Liu , Xinyang Jiang , Yifei Shen , Dongsheng Li , Xiongkuo Min , Guangtao Zhai

In this paper, we propose a partition-masked Convolution Neural Network (CNN) to achieve compressed-video enhancement for the state-of-the-art coding standard, High Efficiency Video Coding (HECV). More precisely, our method utilizes the…

Multimedia · Computer Science 2019-12-30 Xiaoyi He , Qiang Hu , Xintong Han , Xiaoyun Zhang , Chongyang Zhang , Weiyao Lin

Recently, deep learning approaches have been extensively investigated to reconstruct images from accelerated magnetic resonance image (MRI) acquisition. Although these approaches provide significant performance gain compared to compressed…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Eunju Cha , Gyutaek Oh , Jong Chul Ye

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

Implicit Neural Networks (INRs) have emerged as powerful representations to encode all forms of data, including images, videos, audios, and scenes. With video, many INRs for video have been proposed for the compression task, and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shishira R Maiya , Anubhav Gupta , Matthew Gwilliam , Max Ehrlich , Abhinav Shrivastava

NeRFs have revolutionized the world of per-scene radiance field reconstruction because of their intrinsic compactness. One of the main limitations of NeRFs is their slow rendering speed, both at training and inference time. Recent research…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Chenxi Lola Deng , Enzo Tartaglione

Next-Token Prediction (NTP) is a de facto approach for autoregressive (AR) video generation, but it suffers from suboptimal unidirectional dependencies and slow inference speed. In this work, we propose a semi-autoregressive (semi-AR)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shuhuai Ren , Shuming Ma , Xu Sun , Furu Wei

Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking because they require very long training time and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanxi Li , Yi Li , Fatih Porikli

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

Implicit neural representations have recently been extended to represent convolutional neural network weights via neural representation for neural networks, offering promising parameter compression benefits. However, standard multi-layer…

Machine Learning · Computer Science 2025-09-10 Qihu Xie , Yuan Li , Yi Kang

This paper addresses the limitations of neural rendering-based multi-view surface reconstruction methods, which require an additional mesh extraction step that is inconvenient and would produce poor-quality surfaces with mesh aliasing,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qitong Zhang , Jieqing Feng

The structural re-parameterization (SRP) technique is a novel deep learning technique that achieves interconversion between different network architectures through equivalent parameter transformations. This technique enables the mitigation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Shanshan Zhong , Zhongzhan Huang , Wushao Wen , Jinghui Qin , Liang Lin