English

GECO: Generative Image-to-3D within a SECOnd

Computer Vision and Pattern Recognition 2024-08-21 v2

Abstract

Recent years have seen significant advancements in 3D generation. While methods like score distillation achieve impressive results, they often require extensive per-scene optimization, which limits their time efficiency. On the other hand, reconstruction-based approaches are more efficient but tend to compromise quality due to their limited ability to handle uncertainty. We introduce GECO, a novel method for high-quality 3D generative modeling that operates within a second. Our approach addresses the prevalent issues of uncertainty and inefficiency in existing methods through a two-stage approach. In the first stage, we train a single-step multi-view generative model with score distillation. Then, a second-stage distillation is applied to address the challenge of view inconsistency in the multi-view generation. This two-stage process ensures a balanced approach to 3D generation, optimizing both quality and efficiency. Our comprehensive experiments demonstrate that GECO achieves high-quality image-to-3D mesh generation with an unprecedented level of efficiency. We will make the code and model publicly available.

Keywords

Cite

@article{arxiv.2405.20327,
  title  = {GECO: Generative Image-to-3D within a SECOnd},
  author = {Chen Wang and Jiatao Gu and Xiaoxiao Long and Yuan Liu and Lingjie Liu},
  journal= {arXiv preprint arXiv:2405.20327},
  year   = {2024}
}

Comments

Project Page: https://cwchenwang.github.io/geco

R2 v1 2026-06-28T16:47:36.968Z