English
Related papers

Related papers: SOPHY: Learning to Generate Simulation-Ready Objec…

200 papers

Sequential assembly with geometric primitives has drawn attention in robotics and 3D vision since it yields a practical blueprint to construct a target shape. However, due to its combinatorial property, a greedy method falls short of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Jungtaek Kim , Hyunsoo Chung , Jinhwi Lee , Minsu Cho , Jaesik Park

We present CaPhy, a novel method for reconstructing animatable human avatars with realistic dynamic properties for clothing. Specifically, we aim for capturing the geometric and physical properties of the clothing from real observations.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zhaoqi Su , Liangxiao Hu , Siyou Lin , Hongwen Zhang , Shengping Zhang , Justus Thies , Yebin Liu

The task of generating natural images from 3D scenes has been a long standing goal in computer graphics. On the other hand, recent developments in deep neural networks allow for trainable models that can produce natural-looking images with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Hassan Abu Alhaija , Siva Karthik Mustikovela , Andreas Geiger , Carsten Rother

We study the problem of 3D object generation. We propose a novel framework, namely 3D Generative Adversarial Network (3D-GAN), which generates 3D objects from a probabilistic space by leveraging recent advances in volumetric convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-01-05 Jiajun Wu , Chengkai Zhang , Tianfan Xue , William T. Freeman , Joshua B. Tenenbaum

The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xingang Pan , Xudong Xu , Chen Change Loy , Christian Theobalt , Bo Dai

Generating photorealistic 3D hand-object interactions (HOIs) from text is important for applications like robotic grasping and AR/VR content creation. In practice, however, achieving both visual fidelity and physical plausibility remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Uyoung Jeong , Yihalem Yimolal Tiruneh , Hyung Jin Chang , Seungryul Baek , Kwang In Kim

We address the challenge of generating 3D worlds from textual descriptions. We propose SynCity, a training- and optimization-free approach, which leverages the geometric precision of pre-trained 3D generative models and the artistic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Paul Engstler , Aleksandar Shtedritski , Iro Laina , Christian Rupprecht , Andrea Vedaldi

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

We present a method for teaching machines to understand and model the underlying spatial common sense of diverse human-object interactions in 3D in a self-supervised way. This is a challenging task, as there exist specific manifolds of the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sookwan Han , Hanbyul Joo

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Human motion synthesis is an important problem with applications in graphics, gaming and simulation environments for robotics. Existing methods require accurate motion capture data for training, which is costly to obtain. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Kevin Xie , Tingwu Wang , Umar Iqbal , Yunrong Guo , Sanja Fidler , Florian Shkurti

Numerous methods have been proposed for probabilistic generative modelling of 3D objects. However, none of these is able to produce textured objects, which renders them of limited use for practical tasks. In this work, we present the first…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Paul Henderson , Vagia Tsiminaki , Christoph H. Lampert

Large-scale articulated objects with high quality are desperately needed for multiple tasks related to embodied AI. Most existing methods for creating articulated objects are either data-driven or simulation based, which are limited by the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xinyu Lian , Zichao Yu , Ruiming Liang , Yitong Wang , Li Ray Luo , Kaixu Chen , Yuanzhen Zhou , Qihong Tang , Xudong Xu , Zhaoyang Lyu , Bo Dai , Jiangmiao Pang

Text-to-3D generation has shown great promise in generating novel 3D content based on given text prompts. However, existing generative methods mostly focus on geometric or visual plausibility while ignoring precise physics perception for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Qingshan Xu , Jiao Liu , Melvin Wong , Caishun Chen , Yew-Soon Ong

Recent advances in deep generative models have led to immense progress in 3D shape synthesis. While existing models are able to synthesize shapes represented as voxels, point-clouds, or implicit functions, these methods only indirectly…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Andrew Luo , Tianqin Li , Wen-Hao Zhang , Tai Sing Lee

We present a novel alignment-before-generation approach to tackle the challenging task of generating general 3D shapes based on 2D images or texts. Directly learning a conditional generative model from images or texts to 3D shapes is prone…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zibo Zhao , Wen Liu , Xin Chen , Xianfang Zeng , Rui Wang , Pei Cheng , Bin Fu , Tao Chen , Gang Yu , Shenghua Gao

We introduce PhysMotion, a novel framework that leverages principled physics-based simulations to guide intermediate 3D representations generated from a single image and input conditions (e.g., applied force and torque), producing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Xiyang Tan , Ying Jiang , Xuan Li , Zeshun Zong , Tianyi Xie , Yin Yang , Chenfanfu Jiang

Hand-Object Interaction (HOI) generation has significant application potential. However, current 3D HOI motion generation approaches heavily rely on predefined 3D object models and lab-captured motion data, limiting generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Lingwei Dang , Ruizhi Shao , Hongwen Zhang , Wei Min , Yebin Liu , Qingyao Wu

Generating natural hand-object interactions in 3D is challenging as the resulting hand and object motions are expected to be physically plausible and semantically meaningful. Furthermore, generalization to unseen objects is hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Sammy Christen , Shreyas Hampali , Fadime Sener , Edoardo Remelli , Tomas Hodan , Eric Sauser , Shugao Ma , Bugra Tekin

Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zachary Lee , Maxwell Jacobson , Yexiang Xue