English
Related papers

Related papers: StreetCrafter: Street View Synthesis with Controll…

200 papers

Advancements in generative models have sparked significant interest in generating images while adhering to specific structural guidelines. Scene graph to image generation is one such task of generating images which are consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Rameshwar Mishra , A V Subramanyam

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

The essence of a video lies in its dynamic motions, including character actions, object movements, and camera movements. While text-to-video generative diffusion models have recently advanced in creating diverse contents, controlling…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yuxin Zhang , Fan Tang , Nisha Huang , Haibin Huang , Chongyang Ma , Weiming Dong , Changsheng Xu

Video world models aim to simulate dynamic, real-world environments, yet existing methods struggle to provide unified and precise control over camera and multi-object motion, as videos inherently capture dynamics in the projected 2D image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Sixiao Zheng , Minghao Yin , Wenbo Hu , Xiaoyu Li , Ying Shan , Yanwei Fu

In recent years, event cameras have gained significant attention due to their bio-inspired properties, such as high temporal resolution and high dynamic range. However, obtaining large-scale labeled ground-truth data for event-based vision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yixuan Hu , Yuxuan Xue , Simon Klenk , Daniel Cremers , Gerard Pons-Moll

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, creating and editing 3D…

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

Modern text-to-video synthesis models demonstrate coherent, photorealistic generation of complex videos from a text description. However, most existing models lack fine-grained control over camera movement, which is critical for downstream…

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Recent advancements in 3D object generation using diffusion models have achieved remarkable success, but generating realistic 3D urban scenes remains challenging. Existing methods relying solely on 3D diffusion models tend to suffer a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Hanlei Guo , Jiahao Shao , Xinya Chen , Xiyang Tan , Sheng Miao , Yujun Shen , Yiyi Liao

Generating photorealistic images with controllable camera pose and scene contents is essential for many applications including AR/VR and simulation. Despite the fact that rapid progress has been made in 3D-aware generative models, most…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Yuanbo Yang , Yifei Yang , Hanlei Guo , Rong Xiong , Yue Wang , Yiyi Liao

We introduce a principled approach for synthesizing new views of a scene given a single source image. Previous methods for novel view synthesis can be divided into image-based rendering methods (e.g. flow prediction) or pixel generation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Yuxin Hou , Arno Solin , Juho Kannala

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

Representing and synthesizing novel views in real-world dynamic scenes from casual monocular videos is a long-standing problem. Existing solutions typically approach dynamic scenes by applying geometry techniques or utilizing temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Boyu Zhang , Wenbo Xu , Zheng Zhu , Guan Huang

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Neural Radiance Fields (NeRF) have emerged as a paradigm-shifting methodology for the photorealistic rendering of objects and environments, enabling the synthesis of novel viewpoints with remarkable fidelity. This is accomplished through…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Peng Tu , Xun Zhou , Mingming Wang , Xiaojun Yang , Bo Peng , Ping Chen , Xiu Su , Yawen Huang , Yefeng Zheng , Chang Xu
‹ Prev 1 3 4 5 6 7 10 Next ›