English
Related papers

Related papers: Neural Implicit Representations for Physical Param…

200 papers

Representing visual signals with implicit coordinate-based neural networks, as an effective replacement of the traditional discrete signal representation, has gained considerable popularity in computer vision and graphics. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Qing Wang

Implicit neural representation is a recent approach to learn shape collections as zero level-sets of neural networks, where each shape is represented by a latent code. So far, the focus has been shape reconstruction, while shape…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Matan Atzmon , David Novotny , Andrea Vedaldi , Yaron Lipman

Neural representations have emerged as a new paradigm for applications in rendering, imaging, geometric modeling, and simulation. Compared to traditional representations such as meshes, point clouds, or volumes they can be flexibly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Julien N. P. Martel , David B. Lindell , Connor Z. Lin , Eric R. Chan , Marco Monteiro , Gordon Wetzstein

We propose an action-conditioned dynamics model that predicts scene changes caused by object and agent interactions in a viewpoint-invariant 3D neural scene representation space, inferred from RGB-D videos. In this 3D feature space, objects…

Robotics · Computer Science 2020-12-29 Hsiao-Yu Fish Tung , Zhou Xian , Mihir Prabhudesai , Shamit Lal , Katerina Fragkiadaki

Neural ordinary differential equations (Neural ODEs) are an effective framework for learning dynamical systems from irregularly sampled time series data. These models provide a continuous-time latent representation of the underlying…

Machine Learning · Computer Science 2023-03-06 Edward De Brouwer , Rahul G. Krishnan

Deformable image registration (DIR) is crucial in medical image analysis, enabling the exploration of biological dynamics such as organ motions and longitudinal changes in imaging. Leveraging Neural Ordinary Differential Equations (ODE) for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yifan Wu , Mengjin Dong , Rohit Jena , Chen Qin , James C. Gee

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

Machine Learning · Computer Science 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing

Existing implicit neural representation (INR) methods do not fully exploit spatiotemporal redundancies in videos. Index-based INRs ignore the content-specific spatial features and hybrid INRs ignore the contextual dependency on adjacent…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qi Zhao , M. Salman Asif , Zhan Ma

Implicit neural representations (INRs) have gained prominence as a powerful paradigm in scene reconstruction and computer graphics, demonstrating remarkable results. By utilizing neural networks to parameterize data through implicit…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Amirali Molaei , Amirhossein Aminimehr , Armin Tavakoli , Amirhossein Kazerouni , Bobby Azad , Reza Azad , Dorit Merhof

Videos provide a rich source of information, but it is generally hard to extract dynamical parameters of interest. Inferring those parameters from a video stream would be beneficial for physical reasoning. Robots performing tasks in dynamic…

This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sida Peng , Yuanqing Zhang , Yinghao Xu , Qianqian Wang , Qing Shuai , Hujun Bao , Xiaowei Zhou

Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Luca De Luigi , Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Some forms of novel visual media enable the viewer to explore a 3D scene from arbitrary viewpoints, by interpolating between a discrete set of original views. Compared to 2D imagery, these types of applications require much larger amounts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Thomas Bird , Johannes Ballé , Saurabh Singh , Philip A. Chou

Neural fields, also known as implicit neural representations (INRs), have shown a remarkable capability of representing, generating, and manipulating various data types, allowing for continuous data reconstruction at a low memory footprint.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Implicit fields have recently shown increasing success in representing and learning 3D shapes accurately. Signed distance fields and occupancy fields are decades old and still the preferred representations, both with well-studied…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Edoardo Mello Rella , Ajad Chhatkuli , Ender Konukoglu , Luc Van Gool

Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Humans possess an exceptional ability to imagine 4D scenes, encompassing both motion and 3D geometry, from a single still image. This ability is rooted in our accumulated observations of similar scenes and an intuitive understanding of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Emily Yue-Ting Jia , Jiageng Mao , Zhiyuan Gao , Yajie Zhao , Yue Wang

Humans intuitively recognize objects' physical properties and predict their motion, even when the objects are engaged in complicated interactions. The abilities to perform physical reasoning and to adapt to new environments, while intrinsic…

Machine Learning · Computer Science 2020-06-30 Yunzhu Li , Toru Lin , Kexin Yi , Daniel M. Bear , Daniel L. K. Yamins , Jiajun Wu , Joshua B. Tenenbaum , Antonio Torralba

Representing visual signals by implicit representation (e.g., a coordinate based deep network) has prevailed among many vision tasks. This work explores a new intriguing direction: training a stylized implicit representation, using a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhiwen Fan , Yifan Jiang , Peihao Wang , Xinyu Gong , Dejia Xu , Zhangyang Wang

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…