English
Related papers

Related papers: Orientation Matters: Making 3D Generative Models O…

200 papers

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Weiyu Li , Xuanyang Zhang , Zheng Sun , Di Qi , Hao Li , Wei Cheng , Weiwei Cai , Shihao Wu , Jiarui Liu , Zihao Wang , Xiao Chen , Feipeng Tian , Jianxiong Pan , Zeming Li , Gang Yu , Xiangyu Zhang , Daxin Jiang , Ping Tan

Generative Adversarial Networks (GANs) are shown to be successful at generating new and realistic samples including 3D object models. Conditional GAN, a variant of GANs, allows generating samples in given conditions. However, objects…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Cihan Öngün , Alptekin Temizel

Estimating an object's 6D pose, size, and shape from visual input is a fundamental problem in computer vision, with critical applications in robotic grasping and manipulation. Existing methods either rely on object-specific priors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jinyu Zhang , Haitao Lin , Jiashu Hou , Xiangyang Xue , Yanwei Fu

Recent advances in 3D generative models have rapidly improved image-to-3D synthesis quality, enabling higher-resolution geometry and more realistic appearance. Yet fidelity, which measures pixel-level faithfulness of the generated 3D asset…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Dong-Yang Li , Wang Zhao , Yuxin Chen , Wenbo Hu , Meng-Hao Guo , Fang-Lue Zhang , Ying Shan , Shi-Min Hu

Active object reconstruction is crucial for many robotic applications. A key aspect in these scenarios is generating object-specific view configurations to obtain informative measurements for reconstruction. One-shot view planning enables…

Robotics · Computer Science 2025-04-17 Sicong Pan , Liren Jin , Xuying Huang , Cyrill Stachniss , Marija Popović , Maren Bennewitz

Estimating the 6D pose of arbitrary unseen objects from a single reference image is critical for robotics operating in the long-tail of real-world instances. However, this setting is notoriously challenging: 3D models are rarely available,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Zheng Geng , Nan Wang , Shaocong Xu , Chongjie Ye , Bohan Li , Zhaoxi Chen , Sida Peng , Hao Zhao

We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions. Our method, Dream Fields, can generate the geometry and color of a wide range of objects…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Ajay Jain , Ben Mildenhall , Jonathan T. Barron , Pieter Abbeel , Ben Poole

Compositing an object into an image involves multiple non-trivial sub-tasks such as object placement and scaling, color/lighting harmonization, viewpoint/geometry adjustment, and shadow/reflection generation. Recent generative image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Gemma Canet Tarrés , Zhe Lin , Zhifei Zhang , Jianming Zhang , Yizhi Song , Dan Ruta , Andrew Gilbert , John Collomosse , Soo Ye Kim

Recent advancements in 3D object reconstruction from single images have primarily focused on improving the accuracy of object shapes. Yet, these techniques often fail to accurately capture the inter-relation between the object, ground, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yunze Man , Yichen Sheng , Jianming Zhang , Liang-Yan Gui , Yu-Xiong Wang

Today, most methods for image understanding tasks rely on feed-forward neural networks. While this approach has allowed for empirical accuracy, efficiency, and task adaptation via fine-tuning, it also comes with fundamental disadvantages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Julian Ost , Tanushree Banerjee , Mario Bijelic , Felix Heide

3D-aware generative models have shown that the introduction of 3D information can lead to more controllable image generation. In particular, the current state-of-the-art model GIRAFFE can control each object's rotation, translation, scale,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yang Xue , Yuheng Li , Krishna Kumar Singh , Yong Jae Lee

In this paper, we consider the task of one-shot object detection, which consists in detecting objects defined by a single demonstration. Differently from the standard object detection, the classes of objects used for training and testing do…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Anton Osokin , Denis Sumin , Vasily Lomakin

The practicality of 3D object pose estimation remains limited for many applications due to the need for prior knowledge of a 3D model and a training period for new objects. To address this limitation, we propose an approach that takes a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Van Nguyen Nguyen , Thibault Groueix , Yinlin Hu , Mathieu Salzmann , Vincent Lepetit

Automatic detection of weapons is significant for improving security and well being of individuals, nonetheless, it is a difficult task due to large variety of size, shape and appearance of weapons. View point variations and occlusion also…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Nazeef Ul Haq , Muhammad Moazam Fraz , Tufail Sajjad Shah Hashmi , Muhammad Shahzad

Monocular 3D shape recovery is fundamental to geometric understanding, yet achieving robust generalization across arbitrary viewpoints and unseen object categories remains a significant challenge. In this paper, we present a generalizable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yiyao Ma , Kai Chen , Zhongxiang Zhou , Zhuheng Song , Dongsheng Xie , Zelong Tan , Rong Xiong , Qi Dou

We present a method for jointly generating 3D models of objects and 2D renders at different viewing angles, with the process guided by ImageNet and CLIP -based models. Our results indicate that it can generate anamorphic objects, with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Eric Chu

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation. Humans robustly detect and segment moving entities that constitute independently moveable chunks of matter,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Eric Li , Arijit Dasgupta , Yoni Friedman , Mathieu Huot , Vikash Mansinghka , Thomas O'Connell , William T. Freeman , Joshua B. Tenenbaum

Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Larissa T. Triess , Andre Bühler , David Peter , Fabian B. Flohr , J. Marius Zöllner

Methods tackling multi-object tracking need to estimate the number of targets in the sensing area as well as to estimate their continuous state. While the majority of existing methods focus on data association, precise state (3D pose)…

Computer Vision and Pattern Recognition · Computer Science 2019-10-11 Johannes Groß , Aljosa Osep , Bastian Leibe