English
Related papers

Related papers: Compositionally Generalizable 3D Structure Predict…

200 papers

Reconstruction of a 3D shape from a single 2D image is a classical computer vision problem, whose difficulty stems from the inherent ambiguity of recovering occluded or only partially observed surfaces. Recent methods address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Yuan Yao , Nico Schertler , Enrique Rosales , Helge Rhodin , Leonid Sigal , Alla Sheffer

Compositional generalization (the ability to respond correctly to novel combinations of familiar components) is thought to be a cornerstone of intelligent behavior. Compositionally structured (e.g. disentangled) representations support this…

Machine Learning · Computer Science 2025-04-09 Samuel Lippl , Kim Stachenfeld

Deep learning has achieved remarkable results in 3D shape analysis by learning global shape features from the pixel-level over multiple views. Previous methods, however, compute low-level features for entire views without considering…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Zhizhong Han , Xinhai Liu , Yu-Shen Liu , Matthias Zwicker

3D shape is a crucial but heavily underutilized cue in today's computer vision systems, mostly due to the lack of a good generic shape representation. With the recent availability of inexpensive 2.5D depth sensors (e.g. Microsoft Kinect),…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Zhirong Wu , Shuran Song , Aditya Khosla , Fisher Yu , Linguang Zhang , Xiaoou Tang , Jianxiong Xiao

Humans are highly efficient learners, with the ability to grasp the meaning of a new concept from just a few examples. Unlike popular computer vision systems, humans can flexibly leverage the compositional structure of the visual world,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Yanli Zhou , Brenden M. Lake

The so-called factorization methods recover 3-D rigid structure from motion by factorizing an observation matrix that collects 2-D projections of features. These methods became popular due to their robustness - they use a large number of…

Computer Vision and Pattern Recognition · Computer Science 2010-10-20 Pedro M. Q. Aguiar , Rui F. C. Guerreiro , Bruno B. Gonçalves

Our work learns a unified model for single-view 3D reconstruction of objects from hundreds of semantic categories. As a scalable alternative to direct 3D supervision, our work relies on segmented image collections for learning 3D of generic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Kalyan Vasudev Alwala , Abhinav Gupta , Shubham Tulsiani

Despite a multitude of empirical studies, little consensus exists on whether neural networks are able to generalise compositionally, a controversy that, in part, stems from a lack of agreement about what it means for a neural model to be…

Computation and Language · Computer Science 2020-02-25 Dieuwke Hupkes , Verna Dankers , Mathijs Mul , Elia Bruni

We address the problem of discovering 3D parts for objects in unseen categories. Being able to learn the geometry prior of parts and transfer this prior to unseen categories pose fundamental challenges on data-driven shape segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Tiange Luo , Kaichun Mo , Zhiao Huang , Jiarui Xu , Siyu Hu , Liwei Wang , Hao Su

Recently, the emergence of diffusion models has opened up new opportunities for single-view reconstruction. However, all the existing methods represent the target object as a closed mesh devoid of any structural information, thus neglecting…

Graphics · Computer Science 2024-05-28 Anran Liu , Cheng Lin , Yuan Liu , Xiaoxiao Long , Zhiyang Dou , Hao-Xiang Guo , Ping Luo , Wenping Wang

The impressive performance of deep convolutional neural networks in single-view 3D reconstruction suggests that these models perform non-trivial reasoning about the 3D structure of the output space. However, recent work has challenged this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Mateusz Michalkiewicz , Sarah Parisot , Stavros Tsogkas , Mahsa Baktashmotlagh , Anders Eriksson , Eugene Belilovsky

Learning powerful deep generative models for 3D shape synthesis is largely hindered by the difficulty in ensuring plausibility encompassing correct topology and reasonable geometry. Indeed, learning the distribution of plausible 3D shapes…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Jun Li , Chengjie Niu , Kai Xu

We study end-to-end learning strategies for 3D shape inference from images, in particular from a single image. Several approaches in this direction have been investigated that explore different shape representations and suitable learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Roman Klokov , Jakob Verbeek , Edmond Boyer

Single-image 3D generation lies at the core of vision-to-graphics models in the real world. However, it remains a fundamental challenge to achieve reliable generalization across diverse semantic categories and highly variable structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bi'an Du , Daizong Liu , Pufan Li , Wei Hu

Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other. This is partly due to the fact that they do not learn in a compositional way, that is, by discovering skills that are shared…

Artificial Intelligence · Computer Science 2018-07-27 Adam Liška , Germán Kruszewski , Marco Baroni

Autonomous assembly is a crucial capability for robots in many applications. For this task, several problems such as obstacle avoidance, motion planning, and actuator control have been extensively studied in robotics. However, when it comes…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yichen Li , Kaichun Mo , Lin Shao , Minhyuk Sung , Leonidas Guibas

Template 3D shapes are useful for many tasks in graphics and vision, including fitting observation data, analyzing shape collections, and transferring shape attributes. Because of the variety of geometry and topology of real-world shapes,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Kyle Genova , Forrester Cole , Daniel Vlasic , Aaron Sarna , William T. Freeman , Thomas Funkhouser

Compositional generalization refers to the ability to generalize to novel combinations of previously observed words and syntactic structures. Since it is regarded as a desired property of neural models, recent work has assessed…

Computation and Language · Computer Science 2025-04-07 Ryoma Kumon , Daiki Matsuoka , Hitomi Yanaka

Generic 3D reconstruction from a single image is a difficult problem. A lot of data loss occurs in the projection. A domain based approach to reconstruction where we solve a smaller set of problems for a particular use case lead to greater…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Atishay Jain

Generalization of models to out-of-distribution (OOD) data has captured tremendous attention recently. Specifically, compositional generalization, i.e., whether a model generalizes to new structures built of components observed during…

Computation and Language · Computer Science 2020-10-13 Inbar Oren , Jonathan Herzig , Nitish Gupta , Matt Gardner , Jonathan Berant