English
Related papers

Related papers: DNeRV: Modeling Inherent Dynamics via Difference N…

200 papers

Reconstructing high-fidelity magnetic resonance (MR) images from under-sampled k-space is a commonly used strategy to reduce scan time. The posterior sampling of diffusion models based on the real measurement data holds significant promise…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Jiayue Chu , Chenhe Du , Xiyue Lin , Yuyao Zhang , Hongjiang Wei

Visible (VIS) to near infrared (NIR) face matching is a challenging problem due to the significant domain discrepancy between the domains and a lack of sufficient data for training cross-modal matching algorithms. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Xiang Wu , Huaibo Huang , Vishal M. Patel , Ran He , Zhenan Sun

This paper addresses the challenge of quickly reconstructing free-viewpoint videos of dynamic humans from sparse multi-view videos. Some recent works represent the dynamic human as a canonical neural radiance field (NeRF) and a motion…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Chen Geng , Sida Peng , Zhen Xu , Hujun Bao , Xiaowei Zhou

Video inpainting tasks have seen significant improvements in recent years with the rise of deep neural networks and, in particular, vision transformers. Although these models show promising reconstruction quality and temporal consistency,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Guillaume Thiry , Hao Tang , Radu Timofte , Luc Van Gool

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke

Video frame interpolation is a fundamental tool for temporal video enhancement, but existing quality metrics struggle to evaluate the perceptual impact of interpolation artefacts effectively. Metrics like PSNR, SSIM and LPIPS ignore…

Image and Video Processing · Electrical Eng. & Systems 2026-01-23 Conall Daly , Darren Ramsook , Anil Kokaram

We propose a method to compress full-resolution video sequences with implicit neural representations. Each frame is represented as a neural network that maps coordinate positions to pixel values. We use a separate implicit network to…

Machine Learning · Computer Science 2021-12-22 Yunfan Zhang , Ties van Rozendaal , Johann Brehmer , Markus Nagel , Taco Cohen

In NeRF-aided editing tasks, object movement presents difficulties in supervision generation due to the introduction of variability in object positions. Moreover, the removal operations of certain scene objects often lead to empty regions,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyang Li , Zilong Chen , Feifan Qu , Mingqing Wang , Yizhou Zhao , Kai Zhang , Yifan Peng

Implicit neural representations (INRs) are the subject of extensive research, particularly in their application to modeling complex signals by mapping spatial and temporal coordinates to corresponding values. When handling videos, mapping…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

A common strategy to video understanding is to incorporate spatial and motion information by fusing features derived from RGB frames and optical flow. In this work, we introduce a new way to leverage semantic segmentation as an intermediate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Juhana Kangaspunta , AJ Piergiovanni , Rico Jonschkowski , Michael Ryoo , Anelia Angelova

We propose Neural-DynamicReconstruction (NDR), a template-free method to recover high-fidelity geometry and motions of a dynamic scene from a monocular RGB-D camera. In NDR, we adopt the neural implicit function for surface representation…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hongrui Cai , Wanquan Feng , Xuetao Feng , Yan Wang , Juyong Zhang

Artifacts pose a significant challenge in medical imaging, impacting diagnostic accuracy and downstream analysis. While image-based approaches for detecting artifacts can be effective, they often rely on preprocessing methods that can lead…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Caner Özer , Patryk Rygiel , Bram de Wilde , İlkay Öksüz , Jelmer M. Wolterink

Implicit neural representations (INRs) have been successfully used to compress a variety of 3D surface representations such as Signed Distance Functions (SDFs), voxel grids, and also other forms of structured data such as images, videos,…

Graphics · Computer Science 2025-04-03 Sai Karthikey Pentapati , Gregoire Phillips , Alan C. Bovik

Because of the rich dynamical structure of videos and their ubiquity in everyday life, it is a natural idea that video data could serve as a powerful unsupervised learning signal for training visual representations in deep neural networks.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Chengxu Zhuang , Tianwei She , Alex Andonian , Max Sobol Mark , Daniel Yamins

Though action recognition in videos has achieved great success recently, it remains a challenging task due to the massive computational cost. Designing lightweight networks is a possible solution, but it may degrade the recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Wenhao Wu , Dongliang He , Xiao Tan , Shifeng Chen , Yi Yang , Shilei Wen

Dynamic MRI suffers from limited spatiotemporal resolution due to long acquisition times. Undersampling k-space accelerates imaging but makes accurate reconstruction challenging. Supervised deep learning methods achieve impressive results…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Yuanyuan Liu , Yuanbiao Yang , Jing Cheng , Zhuo-Xu Cui , Qingyong Zhu , Congcong Liu , Yuliang Zhu , Jingran Xu , Hairong Zheng , Dong Liang , Yanjie Zhu

Displaying high-quality images on edge devices, such as augmented reality devices, is essential for enhancing the user experience. However, these devices often face power consumption and computing resource limitations, making it challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-06-10 Xiang Liu , Jiahong Chen , Bin Chen , Zimo Liu , Baoyi An , Shu-Tao Xia , Zhi Wang

Multi-view videos are becoming widely used in different fields, but their high resolution and multi-camera shooting raise significant challenges for storage and transmission. In this paper, we propose MV-MGINR, a multi-grid implicit neural…

Image and Video Processing · Electrical Eng. & Systems 2025-09-23 Qingyue Ling , Zhengxue Cheng , Donghui Feng , Shen Wang , Chen Zhu , Guo Lu , Heming Sun , Jiro Katto , Li Song

Dynamic Neural Radiance Field (NeRF) from monocular videos has recently been explored for space-time novel view synthesis and achieved excellent results. However, defocus blur caused by depth variation often occurs in video capture,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Xianrui Luo , Huiqiang Sun , Juewen Peng , Zhiguo Cao

We introduce Neural Representation of Distribution (NeRD) technique, a module for convolutional neural networks (CNNs) that can estimate the feature distribution by optimizing an underlying function mapping image coordinates to the feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-10 Hang Zhang , Rongguang Wang , Jinwei Zhang , Chao Li , Gufeng Yang , Pascal Spincemaille , Thanh Nguyen , Yi Wang