English
Related papers

Related papers: CoARF: Controllable 3D Artistic Style Transfer for…

200 papers

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger

Capturing and re-animating the 3D structure of articulated objects present significant barriers. On one hand, methods requiring extensively calibrated multi-view setups are prohibitively complex and resource-intensive, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Heng Yu , Joel Julin , Zoltán Á. Milacski , Koichiro Niinuma , László A. Jeni

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

We present a first step towards 4D (3D and time) human video stylization, which addresses style transfer, novel view synthesis and human animation within a unified framework. While numerous video stylization methods have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Tiantian Wang , Xinxin Zuo , Fangzhou Mu , Jian Wang , Ming-Hsuan Yang

Neural Radiance Fields (NeRF) is an emerging technique to synthesize 3D objects from 2D images with a wide range of potential applications. However, rendering existing NeRF models is extremely computation intensive, making it challenging to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-25 Zhe Wang , Yifei Zhu

Textures are a vital aspect of creating visually appealing and realistic 3D models. In this paper, we study the problem of generating high-fidelity texture given shapes of 3D assets, which has been relatively less explored compared with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 An-Chieh Cheng , Xueting Li , Sifei Liu , Xiaolong Wang

Spatial intelligence is foundational to AI systems that interact with the physical world, particularly in 3D scene generation and spatial comprehension. Current methodologies for 3D scene generation often rely heavily on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Libin Liu , Shen Chen , Sen Jia , Jingzhe Shi , Zhongyu Jiang , Can Jin , Wu Zongkai , Jenq-Neng Hwang , Lei Li

Neural Radiance Fields (NeRFs) have emerged as promising digital mediums of 3D objects and scenes, sparking a surge in research to extend the editing capabilities in this domain. The task of seamless editing and merging of multiple NeRFs,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Artistic text style transfer is the task of migrating the style from a source image to the target text to create artistic typography. Recent style transfer methods have considered texture control to enhance usability. However, controlling…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Shuai Yang , Zhangyang Wang , Zhaowen Wang , Ning Xu , Jiaying Liu , Zongming Guo

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Robots typically possess sensors of different modalities, such as colour cameras, inertial measurement units, and 3D laser scanners. Often, solving a particular problem becomes easier when more than one modality is used. However, while…

Computer Vision and Pattern Recognition · Computer Science 2017-01-10 Charika De Alvis , Lionel Ott , Fabio Ramos

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

Graphics · Computer Science 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

Text-driven localized editing of 3D objects is particularly difficult as locally mixing the original 3D object with the intended new object and style effects without distorting the object's form is not a straightforward process. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hyeonseop Song , Seokhun Choi , Hoseok Do , Chul Lee , Taehyeong Kim

This paper presents a neural rendering method for controllable portrait video synthesis. Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view synthesis of static…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

As recent advances in Neural Radiance Fields (NeRF) have enabled high-fidelity 3D face reconstruction and novel view synthesis, its manipulation also became an essential task in 3D vision. However, existing manipulation methods require…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sungwon Hwang , Junha Hyung , Daejin Kim , Min-Jung Kim , Jaegul Choo

In volume visualization, visualization synthesis has attracted much attention due to its ability to generate novel visualizations without following the conventional rendering pipeline. However, existing solutions based on generative…

Graphics · Computer Science 2024-08-02 Kaiyuan Tang , Chaoli Wang

Stylized view generation of scenes captured casually using a camera has received much attention recently. The geometry and appearance of the scene are typically captured as neural point sets or neural radiance fields in the previous work.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Rahul Goel , Sirikonda Dhawal , Saurabh Saini , P. J. Narayanan

NeRF's high-quality scene synthesis capability was quickly accepted by scholars in the years after it was proposed, and significant progress has been made in 3D scene representation and synthesis. However, the high computational cost limits…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Shun Fang , Ming Cui , Xing Feng , Yanan Zhang

We propose a new method for reconstructing controllable implicit 3D human models from sparse multi-view RGB videos. Our method defines the neural scene representation on the mesh surface points and signed distances from the surface of a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tianhan Xu , Yasuhiro Fujita , Eiichi Matsumoto