English
Related papers

Related papers: Neural rendering enables dynamic tomography

200 papers

4D time-space reconstruction of dynamic events or deforming objects using X-ray computed tomography (CT) is an important inverse problem in non-destructive evaluation. Conventional back-projection based reconstruction methods assume that…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 K. Aditya Mohan , Massimiliano Ferrucci , Chuck Divin , Garrett A. Stevenson , Hyojin Kim

Modeling Neural Radiance Fields for fast-moving deformable objects from visual data alone is a challenging problem. A major issue arises due to the high deformation and low acquisition rates. To address this problem, we propose to use event…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Qi Ma , Danda Pani Paudel , Ajad Chhatkuli , Luc Van Gool

Dynamic imaging involves the reconstruction of a spatio-temporal object at all times using its undersampled measurements. In particular, in dynamic computed tomography (dCT), only a single projection at one view angle is available at a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-14 Berk Iskender , Sushan Nakarmi , Nitin Daphalapurkar , Marc L. Klasky , Yoram Bresler

Computed tomography (CT) is an effective medical imaging modality, widely used in the field of clinical medicine for the diagnosis of various pathologies. Advances in Multidetector CT imaging technology have enabled additional…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Abril Corona-Figueroa , Jonathan Frawley , Sam Bond-Taylor , Sarath Bethapudi , Hubert P. H. Shum , Chris G. Willcocks

Dynamic garment reconstruction from monocular video is an important yet challenging task due to the complex dynamics and unconstrained nature of the garments. Recent advancements in neural rendering have enabled high-quality geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Soham Dasgupta , Shanthika Naik , Preet Savalia , Sujay Kumar Ingle , Avinash Sharma

As a crucial and intricate task in robotic minimally invasive surgery, reconstructing surgical scenes using stereo or monocular endoscopic video holds immense potential for clinical applications. NeRF-based techniques have recently garnered…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Mengya Xu , Ziqi Guo , An Wang , Long Bai , Hongliang Ren

Data-driven approaches have revolutionized 3D vision, enabling transformers to effectively reconstruct and generate static 3D objects. However, generating simulative 4D dynamics -- realistic temporal deformations of static objects under…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chen Geng , Guangzhao He , Yue Gao , Yunzhi Zhang , Shangzhe Wu , Jiajun Wu

The healthcare industry has a growing need for realistic modeling and efficient simulation of surgical scenes. With effective models of deformable surgical scenes, clinicians are able to conduct surgical planning and surgery training on…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Yuehao Wang , Bingchen Gong , Yonghao Long , Siu Hin Fan , Qi Dou

The research on neural radiance fields for new view synthesis has experienced explosive growth with the development of new models and extensions. The NERF algorithm, suitable for underwater scenes or scattering media, is also evolving.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Zhuoyifan Zhang , Lu Zhang , Liang Wang , Haoming Wu

Motion during acquisition of a set of projections can lead to significant motion artifacts in computed tomography reconstructions despite fast acquisition of individual views. In cases such as cardiac imaging, motion may be unavoidable and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Kunal Gupta , Brendan Colvert , Francisco Contijoch

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

Dynamic imaging is essential for analyzing various biological systems and behaviors but faces two main challenges: data incompleteness and computational burden. For many imaging systems, high frame rates and short acquisition times require…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Luke Lozenski , Mark A. Anastasio , Umberto Villa

Computed Tomography (CT) with its remarkable capability for three-dimensional imaging from multiple projections, enjoys a broad range of applications in clinical diagnosis, scientific observation, and industrial detection. Neural Adaptive…

Image and Video Processing · Electrical Eng. & Systems 2023-11-06 Bo Xiong , Changqing Su , Zihan Lin , You Zhou , Zhaofei Yu

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

In this work, we aim to reconstruct a time-varying 3D model, capable of rendering photo-realistic renderings with independent control of viewpoint, illumination, and time, from Internet photos of large-scale landmarks. The core challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Haotong Lin , Qianqian Wang , Ruojin Cai , Sida Peng , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

Implicit neural representations have shown compelling results in offline 3D reconstruction and also recently demonstrated the potential for online SLAM systems. However, applying them to autonomous 3D reconstruction, where a robot is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Yunlong Ran , Jing Zeng , Shibo He , Lincheng Li , Yingfeng Chen , Gimhee Lee , Jiming Chen , Qi Ye

The modern computer graphics pipeline can synthesize images at remarkable visual quality; however, it requires well-defined, high-quality 3D content as input. In this work, we explore the use of imperfect 3D content, for instance, obtained…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Justus Thies , Michael Zollhöfer , Matthias Nießner

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

Graphics · Computer Science 2025-03-12 Jiaxuan Zhu , Hao Tang

This paper presents a novel approach 4DRecons that takes a single camera RGB-D sequence of a dynamic subject as input and outputs a complete textured deforming 3D model over time. 4DRecons encodes the output as a 4D neural implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Xiaoyan Cong , Haitao Yang , Liyan Chen , Kaifeng Zhang , Li Yi , Chandrajit Bajaj , Qixing Huang