English
Related papers

Related papers: MetaEarth3D: Unlocking World-scale 3D Generation w…

200 papers

Recent advances in visual generative models have highlighted the promise of learning generative world models. However, most existing approaches frame world modeling as novel-view synthesis or future-frame prediction, emphasizing visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yifan Yin , Zehao Wen , Jieneng Chen , Zehan Zheng , Nanru Dai , Haojun Shi , Suyu Ye , Aydan Huang , Zheyuan Zhang , Alan Yuille , Jianwen Xie , Ayush Tewari , Tianmin Shu

Generating 3D models lies at the core of computer graphics and has been the focus of decades of research. With the emergence of advanced neural representations and generative models, the field of 3D content generation is developing rapidly,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xiaoyu Li , Qi Zhang , Di Kang , Weihao Cheng , Yiming Gao , Jingbo Zhang , Zhihao Liang , Jing Liao , Yan-Pei Cao , Ying Shan

Large-scale scene data is essential for training and testing in robot learning. Neural reconstruction methods have promised the capability of reconstructing large physically-grounded outdoor scenes from captured sensor data. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Julian Ost , Andrea Ramazzina , Amogh Joshi , Maximilian Bömer , Mario Bijelic , Felix Heide

Recent advances in generative modeling have substantially enhanced 3D urban generation, enabling applications in digital twins, virtual cities, and large-scale simulations. However, existing methods face two key challenges: (1) the need for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yijie Kang , Xinliang Wang , Zhenyu Wu , Yifeng Shi , Hailong Zhu

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…

World models have garnered increasing attention for comprehensive modeling of the real world. However, most existing methods still rely on pixel-aligned representations as the basis for world evolution, neglecting the inherent 3D nature of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Yuanhui Huang , Weiliang Chen , Wenzhao Zheng , Xin Tao , Pengfei Wan , Jie Zhou , Jiwen Lu

Spatial understanding is a fundamental cornerstone of human-level intelligence. Nonetheless, current research predominantly focuses on domain-specific data production, leaving a critical void: the absence of a principled, open-source engine…

Reconstructing accurate 3D models of large-scale real-world scenes from unstructured, in-the-wild imagery remains a core challenge in computer vision, especially when the input views have little or no overlap. In such cases, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Tamir Cohen , Leo Segre , Shay Shomer-Chai , Shai Avidan , Hadar Averbuch-Elor

Managing natural resources and mitigating risks from floods, droughts, wildfires, and landslides require models that can accurately predict climate-driven land-surface responses. Traditional models often struggle with spatial generalization…

Machine Learning · Computer Science 2026-02-03 Nicholas Kraabel , Jiangtao Liu , Yuchen Bian , Daniel Kifer , Chaopeng Shen

Spatial reasoning is an important component of human intelligence. We can imagine the shapes of 3D objects and reason about their spatial relations by merely looking at their three-view line drawings in 2D, with different levels of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wenyu Han , Siyuan Xiang , Chenhui Liu , Ruoyu Wang , Chen Feng

3D shape generation is a challenging problem due to the high-dimensional output space and complex part configurations of real-world objects. As a result, existing algorithms experience difficulties in accurate generative modeling of 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Salman H. Khan , Yulan Guo , Munawar Hayat , Nick Barnes

Imagine stepping into a virtual world that's as rich, dynamic, and interactive as our physical one. This is the promise of the Metaverse, and it's being brought to life by the transformative power of Generative Artificial Intelligence (AI).…

Generative AI has demonstrated significant potential in creative design, enabling the rapid generation of visual content and imaginative concepts. Although deep AI models achieve effective featurization in the latent space, navigating the…

Human-Computer Interaction · Computer Science 2026-04-23 Mingwei Li , Suyang Li , Daisuke Sakurai , Bei Wang , Remco Chang

Developing embodied AI agents requires scalable training environments that balance content diversity with physics accuracy. World simulators provide such environments but face distinct limitations: video-based methods generate diverse…

Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Xuanru Zhou , Cheng Li , Shuqiang Wang , Ye Li , Tao Tan , Hairong Zheng , Shanshan Wang

Generative AI research increasingly confronts a shared problem: systems must sustain yet govern their own generative activity when uncertainty is high, evidence is missing, or context is insufficient. This position paper argues that…

Neurons and Cognition · Quantitative Biology 2026-05-26 Eugene Yu Ji , Igor Grossmann , Amir-Hossein Karimi

Extended Reality (XR), including virtual, augmented, and mixed reality, provides immersive and interactive experiences across diverse applications, from VR-based education to AR-based assistance and MR-based training. However, widespread XR…

Human-Computer Interaction · Computer Science 2026-01-23 Mingyu Zhu , Jiangong Chen , Bin Li

3D spatial perception is the problem of building and maintaining an actionable and persistent representation of the environment in real-time using sensor data and prior knowledge. Despite the fast-paced progress in robot perception, most…

Robotics · Computer Science 2023-05-15 Nathan Hughes , Yun Chang , Siyi Hu , Rajat Talak , Rumaisa Abdulhai , Jared Strader , Luca Carlone

The creation of 3D human face avatars from a single unconstrained image is a fundamental task that underlies numerous real-world vision and graphics applications. Despite the significant progress made in generative models, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Wenqing Wang , Haosen Yang , Josef Kittler , Xiatian Zhu

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang