中文
相关论文

相关论文: Render, Don't Decode: Weight-Space World Models wi…

200 篇论文

Implicit neural representation (INR) has recently emerged as a promising paradigm for signal representations, which takes coordinates as inputs and generates corresponding signal values. Since these coordinates contain no semantic features,…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Zhicheng Cai , Qiu Shen

Implicit Neural Representations (INRs) have emerged as a promising paradigm for video compression. However, existing INR-based frameworks typically suffer from inherent spectral bias, which favors low-frequency components and leads to…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Jun Zhu , Xinfeng Zhang , Lv Tang , Junhao Jiang , Gai Zhang , Jia Wang

Neural Representations for Videos (NeRV) has emerged as a promising implicit neural representation (INR) approach for video analysis, which represents videos as neural networks with frame indexes as inputs. However, NeRV-based methods are…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Jialong Guo , Ke liu , Jiangchao Yao , Zhihua Wang , Jiajun Bu , Haishuai Wang

Generalizable implicit neural representation (INR) enables a single continuous function, i.e., a coordinate-based neural network, to represent multiple data instances by modulating its weights or intermediate features using latent codes.…

机器学习 · 计算机科学 2023-10-13 Doyup Lee , Chiheon Kim , Minsu Cho , Wook-Shin Han

Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements.…

计算机视觉与模式识别 · 计算机科学 2019-03-12 Reinhard Heckel , Paul Hand

Implicit neural representation (INR) embed various signals into neural networks. They have gained attention in recent years because of their versatility in handling diverse signal types. In the context of video, INR achieves video…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Taiga Hayami , Takahiro Shindo , Shunsuke Akamatsu , Hiroshi Watanabe

Implicit Neural Representation (INR) has been emerging in computer vision in recent years. It has been shown to be effective in parameterising continuous signals such as dense 3D models from discrete image data, e.g. the neural radius field…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Wentian Xu , Jianbo Jiao

Learning-based video compression is currently a popular research topic, offering the potential to compete with conventional standard video codecs. In this context, Implicit Neural Representations (INRs) have previously been used to…

图像与视频处理 · 电气工程与系统科学 2024-06-11 Ho Man Kwan , Ge Gao , Fan Zhang , Andrew Gower , David Bull

We propose a novel neural representation for videos (NeRV) which encodes videos in neural networks. Unlike conventional representations that treat videos as frame sequences, we represent videos as neural networks taking frame index as…

计算机视觉与模式识别 · 计算机科学 2021-10-27 Hao Chen , Bo He , Hanyu Wang , Yixuan Ren , Ser-Nam Lim , Abhinav Shrivastava

Despite the abundant availability and content richness for video data, its high-dimensionality poses challenges for video research. Recent advancements have explored the implicit representation for videos using neural networks,…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Hao Chen , Saining Xie , Ser-Nam Lim , Abhinav Shrivastava

Models for image representation learning are typically designed for either recognition or generation. Various forms of contrastive learning help models learn to convert images to embeddings that are useful for classification, detection, and…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Matthew Gwilliam , Xiao Wang , Xuefeng Hu , Zhenheng Yang

This paper takes a step towards temporal reasoning in a dynamically changing video, not in the pixel space that constitutes its frames, but in a latent space that describes the non-linear dynamics of the objects in its world. We introduce…

机器学习 · 统计学 2017-10-31 Marco Fraccaro , Simon Kamronn , Ulrich Paquet , Ole Winther

Implicit neural representation (INR) has emerged as a promising solution for encoding volumetric data, offering continuous representations and seamless compatibility with the volume rendering pipeline. However, optimizing an INR network…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Maizhe Yang , Kaiyuan Tang , Chaoli Wang

We introduce a novel generative framework for functions by integrating Implicit Neural Representations (INRs) and Transformer-based hypernetworks into latent variable models. Unlike prior approaches that rely on MLP-based hypernetworks with…

机器学习 · 计算机科学 2025-11-04 Ignacio Peis , Batuhan Koyuncu , Isabel Valera , Jes Frellsen

Implicit Neural Representations (INRs) aim to parameterize discrete signals through implicit continuous functions. However, formulating each image with a separate neural network~(typically, a Multi-Layer Perceptron (MLP)) leads to…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Wenyong Zhou , Taiqiang Wu , Zhengwu Liu , Yuxin Cheng , Chen Zhang , Ngai Wong

Implicit neural representation (INR) methods for video compression have recently achieved visual quality and compression ratios that are competitive with traditional pipelines. However, due to the need for per-sample network training, the…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Matthew Gwilliam , Roy Zhang , Namitha Padmanabhan , Hongyang Du , Abhinav Shrivastava

Implicit Neural Representations (INRs) provide a powerful continuous framework for modeling complex visual and geometric signals, but spectral bias remains a fundamental challenge, limiting their ability to capture high-frequency details.…

机器学习 · 计算机科学 2025-12-01 Yesom Park , Kelvin Kan , Thomas Flynn , Yi Huang , Shinjae Yoo , Stanley Osher , Xihaier Luo

We present NOVA3R, an effective approach for non-pixel-aligned 3D reconstruction from a set of unposed images in a feed-forward manner. Unlike pixel-aligned methods that tie geometry to per-ray predictions, our formulation learns a global,…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Weirong Chen , Chuanxia Zheng , Ganlin Zhang , Andrea Vedaldi , Daniel Cremers

Generating videos is a complex task that is accomplished by generating a set of temporally coherent images frame-by-frame. This limits the expressivity of videos to only image-based operations on the individual video frames needing network…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Bipasha Sen , Aditya Agarwal , Vinay P Namboodiri , C. V. Jawahar

Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data…

分布式、并行与集群计算 · 计算机科学 2024-07-23 Qi Wu , Joseph A. Insley , Victor A. Mateevitsi , Silvio Rizzi , Michael E. Papka , Kwan-Liu Ma