English
Related papers

Related papers: NeuSEditor: From Multi-View Images to Text-Guided …

200 papers

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Recent advances in deep generative models have demonstrated impressive results in photo-realistic facial image synthesis and editing. Facial expressions are inherently the result of muscle movement. However, existing neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sida Peng , Yuanqing Zhang , Yinghao Xu , Qianqian Wang , Qing Shuai , Hujun Bao , Xiaowei Zhou

Text-to-image diffusion models are gradually introduced into computer graphics, recently enabling the development of Text-to-3D pipelines in an open domain. However, for interactive editing purposes, local manipulations of content through a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Aryan Mikaeili , Or Perel , Mehdi Safaee , Daniel Cohen-Or , Ali Mahdavi-Amiri

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yunfan Ye , Renjiao Yi , Zhirui Gao , Chenyang Zhu , Zhiping Cai , Kai Xu

Accurate surface geometry representation is crucial in 3D visual computing. Explicit representations, such as polygonal meshes, and implicit representations, like signed distance functions, each have distinct advantages, making efficient…

Graphics · Computer Science 2025-09-26 Christian Stippel , Felix Mujkanovic , Thomas Leimkühler , Pedro Hermosilla

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ashkan Mirzaei , Tristan Aumentado-Armstrong , Konstantinos G. Derpanis , Jonathan Kelly , Marcus A. Brubaker , Igor Gilitschenski , Alex Levinshtein

We present GSEdit, a pipeline for text-guided 3D object editing based on Gaussian Splatting models. Our method enables the editing of the style and appearance of 3D objects without altering their main details, all in a matter of minutes on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Francesco Palandra , Andrea Sanchietti , Daniele Baieri , Emanuele Rodolà

Current text-driven image editing methods typically follow one of two directions: relying on large-scale, high-quality editing pair datasets to improve editing precision and diversity, or exploring alternative dataset-free techniques.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chenrui Ma , Xi Xiao , Tianyang Wang , Yanning Shen

We present a method for generating high-quality watertight manifold meshes from multi-view input images. Existing volumetric rendering methods are robust in optimization but tend to generate noisy meshes with poor topology. Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Xinyue Wei , Fanbo Xiang , Sai Bi , Anpei Chen , Kalyan Sunkavalli , Zexiang Xu , Hao Su

Neural implicit representations, including Neural Distance Fields and Neural Radiance Fields, have demonstrated significant capabilities for reconstructing surfaces with complicated geometry and topology, and generating novel views of a…

Graphics · Computer Science 2024-02-08 Lin Gao , Jie Yang , Bo-Tao Zhang , Jia-Mu Sun , Yu-Jie Yuan , Hongbo Fu , Yu-Kun Lai

In this paper, we focus on the task of instruction-based image editing. Previous works like InstructPix2Pix, InstructDiffusion, and SmartEdit have explored end-to-end editing. However, two limitations still remain: First, existing datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yingjing Xu , Jie Kong , Jiazhi Wang , Xiao Pan , Bo Lin , Qiang Liu

Surface reconstruction from sparse views aims to reconstruct a 3D shape or scene from few RGB images. The latest methods are either generalization-based or overfitting-based. However, the generalization-based methods do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Liang Han , Xu Zhang , Haichuan Song , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Mobile robots operating indoors must be prepared to navigate challenging scenes that contain transparent surfaces. This paper proposes a novel method for the fusion of acoustic and visual sensing modalities through implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Advaith V. Sethuraman , Onur Bagoren , Harikrishnan Seetharaman , Dalton Richardson , Joseph Taylor , Katherine A. Skinner

3D scene reconstruction from 2D images has been a long-standing task. Instead of estimating per-frame depth maps and fusing them in 3D, recent research leverages the neural implicit surface as a unified representation for 3D reconstruction.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xinyi Yu , Liqin Lu , Jintao Rong , Guangkai Xu , Linlin Ou

In this paper, we study the problem of continuous 3D shape representations. The majority of existing successful methods are coordinate-based implicit neural representations. However, they are inefficient to render novel views or recover…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhuoman Liu , Bo Yang , Yan Luximon , Ajay Kumar , Jinxi Li

For the last decades, the concern of producing convincing facial animation has garnered great interest, that has only been accelerating with the recent explosion of 3D content in both entertainment and professional activities. The use of…

Graphics · Computer Science 2020-10-13 Eloïse Berson , Catherine Soladié , Nicolas Stoiber