English
Related papers

Related papers: Shape from Semantics: 3D Shape Generation from Mul…

200 papers

We introduce ReStyle3D, a novel framework for scene-level appearance transfer from a single style image to a real-world scene represented by multiple views. The method combines explicit semantic correspondences with multi-view consistency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Liyuan Zhu , Shengqu Cai , Shengyu Huang , Gordon Wetzstein , Naji Khosravan , Iro Armeni

Recent advancements in 3D Gaussian Splatting (3D-GS) enable high-quality 3D scene reconstruction from RGB images. Many studies extend this paradigm for language-driven open-vocabulary scene understanding. However, most of them simply…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiazhong Cen , Xudong Zhou , Jiemin Fang , Changsong Wen , Lingxi Xie , Xiaopeng Zhang , Wei Shen , Qi Tian

3D generative models have been recently successful in generating realistic 3D objects in the form of point clouds. However, most models do not offer controllability to manipulate the shape semantics of component object parts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Amaya Dharmasiri , Dinithi Dissanayake , Mohamed Afham , Isuru Dissanayake , Ranga Rodrigo , Kanchana Thilakarathna

The entertainment industry relies on 3D visual content to create immersive experiences, but traditional methods for creating textured 3D models can be time-consuming and subjective. Generative networks such as StyleGAN have advanced image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Yi-Ting Pan , Chai-Rong Lee , Shu-Ho Fan , Jheng-Wei Su , Jia-Bin Huang , Yung-Yu Chuang , Hung-Kuo Chu

Procedural textures are normally generated from mathematical models with parameters carefully selected by experienced users. However, for naive users, the intuitive way to obtain a desired texture is to provide semantic descriptions such as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Junyu Dong , Lina Wang , Jun Liu , Xin Sun

We present a unified framework tackling two problems: class-specific 3D reconstruction from a single image, and generation of new 3D shape samples. These tasks have received considerable attention recently; however, existing approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Paul Henderson , Vittorio Ferrari

Human visual attention on three-dimensional objects emerges from the interplay between bottom-up geometric processing and top-down semantic recognition. Existing 3D saliency methods rely on hand-crafted geometric features or learning-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Soham Pahari , Sandeep C. Kumain

Most text-to-3D generators build upon off-the-shelf text-to-image models trained on billions of images. They use variants of Score Distillation Sampling (SDS), which is slow, somewhat unstable, and prone to artifacts. A mitigation is to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Luke Melas-Kyriazi , Iro Laina , Christian Rupprecht , Natalia Neverova , Andrea Vedaldi , Oran Gafni , Filippos Kokkinos

Reconstructing and understanding 3D structures from a limited number of images is a well-established problem in computer vision. Traditional methods usually break this task into multiple subtasks, each requiring complex transformations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhiwen Fan , Jian Zhang , Wenyan Cong , Peihao Wang , Renjie Li , Kairun Wen , Shijie Zhou , Achuta Kadambi , Zhangyang Wang , Danfei Xu , Boris Ivanovic , Marco Pavone , Yue Wang

Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in…

Graphics · Computer Science 2023-09-13 Jie Zhou , Zhongjin Luo , Qian Yu , Xiaoguang Han , Hongbo Fu

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our method automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Ming-Jia Yang , Yu-Xiao Guo , Bin Zhou , Xin Tong

Holistic 3D scene understanding, which jointly models geometry, appearance, and semantics, is crucial for applications like augmented reality and robotic interaction. Existing feed-forward 3D scene understanding methods (e.g., LSM) are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Qijing Li , Jingxiang Sun , Liang An , Zhaoqi Su , Hongwen Zhang , Yebin Liu

Vision-Language Models (VLMs) have shown remarkable performance on diverse visual and linguistic tasks, yet they remain fundamentally limited in their understanding of 3D spatial structures. We propose Geometric Distillation, a lightweight,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Seonho Lee , Jiho Choi , Inha Kang , Jiwook Kim , Junsung Park , Hyunjung Shim

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

In this paper, we tackle a new task of 3D object synthesis, where a 3D model is composited with another object category to create a novel 3D model. However, most existing text/image/3D-to-3D methods struggle to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zeren Xiong , Zikun Chen , Zedong Zhang , Xiang Li , Ying Tai , Jian Yang , Jun Li

3D digital garment generation and editing play a pivotal role in fashion design, virtual try-on, and gaming. Traditional methods struggle to meet the growing demand due to technical complexity and high resource costs. Learning-based…

Graphics · Computer Science 2025-09-23 Ruiyan Wang , Zhengxue Cheng , Zonghao Lin , Jun Ling , Yuzhou Liu , Yanru An , Rong Xie , Li Song

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

In computed tomography, the reconstruction is typically obtained on a voxel grid. In this work, however, we propose a mesh-based reconstruction method. For tomographic problems, 3D meshes have mostly been studied to simulate data…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Jakeoung Koo , Anders B. Dahl , J. Andreas Bærentzen , Qiongyang Chen , Sara Bals , Vedrana A. Dahl

We present a new local descriptor for 3D shapes, directly applicable to a wide range of shape analysis problems such as point correspondences, semantic segmentation, affordance prediction, and shape-to-scan matching. The descriptor is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Haibin Huang , Evangelos Kalogerakis , Siddhartha Chaudhuri , Duygu Ceylan , Vladimir G. Kim , Ersin Yumer