English
Related papers

Related papers: Pixel2Mesh++: 3D Mesh Generation and Refinement fr…

200 papers

Generating accurate 3D models is a challenging problem that traditionally requires explicit learning from 3D datasets using supervised learning. Although recent advances have shown promise in learning 3D models from 2D images, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Qijia Shen , Guangrun Wang

Surface reconstruction with preservation of geometric features is a challenging computer vision task. Despite significant progress in implicit shape reconstruction, state-of-the-art mesh extraction methods often produce aliased,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Natalia Soboleva , Olga Gorbunova , Maria Ivanova , Evgeny Burnaev , Matthias Nießner , Denis Zorin , Alexey Artemov

Shape from texture refers to the extraction of 3D information from 2D images with irregular texture. This paper introduces a statistical framework to learn shape from texture where convex texture elements in a 2D image are represented…

A complete representation of 3D objects requires characterizing the space of deformations in an interpretable manner, from articulations of a single instance to changes in shape across categories. In this work, we improve on a prior…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

3D Human Body Reconstruction from a monocular image is an important problem in computer vision with applications in virtual and augmented reality platforms, animation industry, en-commerce domain, etc. While several of the existing works…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Abbhinav Venkat , Chaitanya Patel , Yudhik Agrawal , Avinash Sharma

3D pose transfer is one of the most challenging 3D generation tasks. It aims to transfer the pose of a source mesh to a target mesh and keep the identity (e.g., body shape) of the target mesh. Some previous works require key point…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Chaoyue Song , Jiacheng Wei , Ruibo Li , Fayao Liu , Guosheng Lin

Existing generative models for 3D shapes are typically trained on a large 3D dataset, often of a specific object category. In this paper, we investigate the deep generative model that learns from only a single reference 3D shape.…

Graphics · Computer Science 2022-12-19 Rundi Wu , Changxi Zheng

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

Meshes are commonly used as 3D maps since they encode the topology of the scene while being lightweight. Unfortunately, 3D meshes are mathematically difficult to handle directly because of their combinatorial and discrete nature. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Antoni Rosinol , Luca Carlone

Recent 3D-based manipulation methods either directly predict the grasp pose using 3D neural networks, or solve the grasp pose using similar objects retrieved from shape databases. However, the former faces generalizability challenges when…

Robotics · Computer Science 2023-10-03 Luobin Wang , Runlin Guo , Quan Vuong , Yuzhe Qin , Hao Su , Henrik Christensen

Learning to generate textures for a novel 3D mesh given a collection of 3D meshes and real-world 2D images is an important problem with applications in various domains such as 3D simulation, augmented and virtual reality, gaming,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Dharma KC , Clayton T. Morrison

We develop a rotation equivariant model for generating 3D hand meshes from 2D RGB images. This guarantees that as the input image of a hand is rotated the generated mesh undergoes a corresponding rotation. Furthermore, this removes…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Joshua Mitton , Chaitanya Kaul , Roderick Murray-Smith

A longstanding question in computer vision concerns the representation of 3D shapes for recognition: should 3D shapes be represented with descriptors operating on their native 3D formats, such as voxel grid or polygon mesh, or can they be…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Hang Su , Subhransu Maji , Evangelos Kalogerakis , Erik Learned-Miller

Generating compact and sharply detailed 3D meshes poses a significant challenge for current 3D generative models. Different from extracting dense meshes from neural representation, some recent works try to model the native mesh distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Haohan Weng , Yikai Wang , Tong Zhang , C. L. Philip Chen , Jun Zhu

We address the problem of learning accurate 3D shape and camera pose from a collection of unlabeled category-specific images. We train a convolutional network to predict both the shape and the pose from a single image by minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Eldar Insafutdinov , Alexey Dosovitskiy

Pose diversity is an inherent representative characteristic of 2D images. Due to the 3D to 2D projection mechanism, there is evident content discrepancy among distinct pose images. This is the main obstacle bothering pose transformation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yuelong Li , Tengfei Xiao , Lei Geng , Jianming Wang

Mesh models are a promising approach for encoding the structure of 3D objects. Current mesh reconstruction systems predict uniformly distributed vertex locations of a predetermined graph through a series of graph convolutions, leading to…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Edward J. Smith , Scott Fujimoto , Adriana Romero , David Meger

3D shape modeling is labor-intensive, time-consuming, and requires years of expertise. To facilitate 3D shape modeling, we propose a 3D shape generation network that takes a 3D VR sketch as a condition. We assume that sketches are created…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ling Luo , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song , Yulia Gryaditskaya

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman