English
Related papers

Related papers: CoGen: 3D Consistent Video Generation via Adaptive…

200 papers

Urban scene synthesis with video generation models has recently shown great potential for autonomous driving. Existing video generation approaches to autonomous driving primarily focus on RGB video generation and lack the ability to support…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guile Wu , David Huang , Dongfeng Bai , Bingbing Liu

Video generation has achieved impressive quality, but it still suffers from artifacts such as temporal inconsistency and violation of physical laws. Leveraging 3D scenes can fundamentally resolve these issues by providing precise control…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zhaofang Qian , Abolfazl Sharifi , Tucker Carroll , Ser-Nam Lim

In recent years, the demand for 3D content has grown exponentially with the intelligent upgrade of interactive media, extended reality (XR), and Metaverse industries. In order to overcome the limitations of traditional manual modeling…

Graphics · Computer Science 2025-12-23 Xiang Tang , Ruotong Li , Xiaopeng Fan

Recent progress in robot learning has been driven by large-scale datasets and powerful visuomotor policy architectures, yet policy robustness remains limited by the substantial cost of collecting diverse demonstrations, particularly for…

Robotics · Computer Science 2026-03-24 Yujie Zhao , Hongwei Fan , Di Chen , Shengcong Chen , Liliang Chen , Xiaoqi Li , Guanghui Ren , Hao Dong

Single-image 3D generation has emerged as a prominent research topic, playing a vital role in virtual reality, 3D modeling, and digital content creation. However, existing methods face challenges such as a lack of multi-view geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jinbo Yan , Alan Zhao , Yixin Hu

Motion generation, the task of synthesizing realistic motion sequences from various conditioning inputs, has become a central problem in computer vision, computer graphics, and robotics, with applications ranging from animation and virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aliasghar Khani , Arianna Rampini , Bruno Roy , Larasika Nadela , Noa Kaplan , Evan Atherton , Derek Cheung , Jacky Bibliowicz

We introduce 3inGAN, an unconditional 3D generative model trained from 2D images of a single self-similar 3D scene. Such a model can be used to produce 3D "remixes" of a given scene, by mapping spatial latent codes into a 3D volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Animesh Karnewar , Oliver Wang , Tobias Ritschel , Niloy Mitra

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

Creating high-fidelity 3D models of indoor environments is essential for applications in design, virtual reality, and robotics. However, manual 3D modeling remains time-consuming and labor-intensive. While recent advances in generative AI…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Chuan Fang , Heng Li , Yixun Liang , Jia Zheng , Yongsen Mao , Yuan Liu , Rui Tang , Zihan Zhou , Ping Tan

Generating images with both photorealism and multiview 3D consistency is crucial for 3D-aware GANs, yet existing methods struggle to achieve them simultaneously. Improving the photorealism via CNN-based 2D super-resolution can break the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Xingyu Chen , Yu Deng , Baoyuan Wang

3D content generation has recently attracted significant research interest, driven by its critical applications in VR/AR and embodied AI. In this work, we tackle the challenging task of synthesizing multiple 3D assets within a single scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yanxu Meng , Haoning Wu , Ya Zhang , Weidi Xie

We present a method for text-driven perpetual view generation -- synthesizing long-term videos of various scenes solely, given an input text prompt describing the scene and camera poses. We introduce a novel framework that generates such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Rafail Fridman , Amit Abecasis , Yoni Kasten , Tali Dekel

Precise modeling of microscopic vehicle trajectories is critical for traffic behavior analysis and autonomous driving systems. We propose Ctx2TrajGen, a context-aware trajectory generation framework that synthesizes realistic urban driving…

Artificial Intelligence · Computer Science 2025-07-24 Joobin Jin , Seokjun Hong , Gyeongseon Baek , Yeeun Kim , Byeongjoon Noh

Video Diffusion Models (VDMs) offer a promising approach for simulating dynamic scenes and environments, with broad applications in robotics and media generation. However, existing models often generate temporally incoherent content that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhexiao Xiong , Yizhi Song , Liu He , Wei Xiong , Yu Yuan , Feng Qiao , Nathan Jacobs

Synthesizability remains a critical bottleneck in generative molecular design. While recent advances have addressed synthesizability in 2D graphs, extending these constraints to 3D for geometry-based conditional generation remains largely…

Visuomotor policies have shown great promise in robotic manipulation but often require substantial amounts of human-collected data for effective performance. A key reason underlying the data demands is their limited spatial generalization…

Robotics · Computer Science 2025-02-25 Zhengrong Xue , Shuying Deng , Zhenyang Chen , Yixuan Wang , Zhecheng Yuan , Huazhe Xu

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

The acquisition of annotated datasets with paired images and segmentation masks is a critical challenge in domains such as medical imaging, remote sensing, and computer vision. Manual annotation demands significant resources, faces ethical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Rupak Bose , Chinedu Innocent Nwoye , Aditya Bhat , Nicolas Padoy

Controllable video generation aims to synthesize video content that aligns precisely with user-provided conditions, such as text descriptions and initial images. However, a significant challenge persists in this domain: existing models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Peng Hu , Yu Gu , Liang Luo , Fuji Ren

High-quality 3D assets are essential for VR/AR, industrial design, and entertainment, motivating growing interest in generative models that create 3D content from user prompts. Most existing 3D generators, however, rely on a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiazhong Cen , Jiemin Fang , Sikuang Li , Guanjun Wu , Chen Yang , Taoran Yi , Zanwei Zhou , Zhikuan Bao , Lingxi Xie , Wei Shen , Qi Tian