English
Related papers

Related papers: Interactive3D: Create What You Want by Interactive…

200 papers

In this study, we tackle the complex task of generating 3D human-object interactions (HOI) from textual descriptions in a zero-shot text-to-3D manner. We identify and address two key challenges: the unsatisfactory outcomes of direct…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Sisi Dai , Wenhao Li , Haowen Sun , Haibin Huang , Chongyang Ma , Hui Huang , Kai Xu , Ruizhen Hu

4D generation has made remarkable progress in synthesizing dynamic 3D objects from input text, images, or videos. However, existing methods often represent motion as an implicit deformation field, which limits direct control and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Lifan Wu , Ruijie Zhu , Yubo Ai , Tianzhu Zhang

Recent advances in Gaussian Splatting have enabled fast, high-fidelity 3D scene generation, yet these methods remain purely visual and lack an understanding of how shapes behave in the physical world. We introduce Physics-Guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Zachary Lee , Maxwell Jacobson , Yexiang Xue

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

Among various interactions between humans, such as eye contact and gestures, physical interactions by contact can act as an essential moment in understanding human behaviors. Inspired by this fact, given a 3D partner human with the desired…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Dongjun Gu , Jaehyeok Shim , Jaehoon Jang , Changwoo Kang , Kyungdon Joo

Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Bohan Zeng , Shanglin Li , Yutang Feng , Ling Yang , Hong Li , Sicheng Gao , Jiaming Liu , Conghui He , Wentao Zhang , Jianzhuang Liu , Baochang Zhang , Shuicheng Yan

Photorealistic 3D scene generation is challenging due to the scarcity of large-scale, high-quality real-world 3D datasets and complex workflows requiring specialized expertise for manual modeling. These constraints often result in slow…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Clément Jambon , Changwoon Choi , Dongsu Zhang , Olga Sorkine-Hornung , Young Min Kim

Touch and vision go hand in hand, mutually enhancing our ability to understand the world. From a research perspective, the problem of mixing touch and vision is underexplored and presents interesting challenges. To this end, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Mauro Comi , Alessio Tonioni , Max Yang , Jonathan Tremblay , Valts Blukis , Yijiong Lin , Nathan F. Lepora , Laurence Aitchison

3D digital garment generation and editing play a pivotal role in fashion design, virtual try-on, and gaming. Traditional methods struggle to meet the growing demand due to technical complexity and high resource costs. Learning-based…

Graphics · Computer Science 2025-09-23 Ruiyan Wang , Zhengxue Cheng , Zonghao Lin , Jun Ling , Yuzhou Liu , Yanru An , Rong Xie , Li Song

The automated generation of interactive 3D cities is a critical challenge with broad applications in autonomous driving, virtual reality, and embodied intelligence. While recent advances in generative models and procedural techniques have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zishan Liu , Zecong Tang , RuoCheng Wu , Xinzhe Zheng , Jingyu Hu , Ka-Hei Hui , Haoran Xie , Bo Dai , Zhengzhe Liu

Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures. These assets typically consist of a single, fused representation, like an implicit neural field, a Gaussian mixture, or a mesh,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minghao Chen , Roman Shapovalov , Iro Laina , Tom Monnier , Jianyuan Wang , David Novotny , Andrea Vedaldi

Robotic grasping of house-hold objects has made remarkable progress in recent years. Yet, human grasps are still difficult to synthesize realistically. There are several key reasons: (1) the human hand has many degrees of freedom (more than…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Korrawe Karunratanakul , Jinlong Yang , Yan Zhang , Michael Black , Krikamol Muandet , Siyu Tang

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

3D Gaussian Splatting (3DGS) has emerged as a leading approach for high-quality novel view synthesis, with numerous variants extending its applicability to a broad spectrum of 3D and 4D scene reconstruction tasks. Despite its success, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yiming Wang , Shaofei Wang , Marko Mihajlovic , Siyu Tang

3D Gaussian Splatting has demonstrated superior performance in rendering efficiency and quality, yet the generation of 3D Gaussians still remains a challenge without proper geometric priors. Existing methods have explored predicting point…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weiqi Zhang , Junsheng Zhou , Haotian Geng , Kanle Shi , Shenkun Xu , Yi Fang , Yu-Shen Liu

3D generation methods have shown visually compelling results powered by diffusion image priors. However, they often fail to produce realistic geometric details, resulting in overly smooth surfaces or geometric details inaccurately baked in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruihan Gao , Kangle Deng , Gengshan Yang , Wenzhen Yuan , Jun-Yan Zhu

Text-to-3D generation has attracted much attention from the computer vision community. Existing methods mainly optimize a neural field from scratch for each text prompt, relying on heavy and repetitive training cost which impedes their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Ming Li , Pan Zhou , Jia-Wei Liu , Jussi Keppo , Min Lin , Shuicheng Yan , Xiangyu Xu

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Recently, image-to-3D approaches have achieved significant results with a natural image as input. However, it is not always possible to access these enriched color input samples in practical applications, where only sketches are available.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wangguandong Zheng , Haifeng Xia , Rui Chen , Ming Shao , Siyu Xia , Zhengming Ding

Simulation is essential for autonomous driving, yet current frameworks often model vehicles as rigid assets and fail to capture part-level articulation. With perception algorithms increasingly leveraging dynamics such as wheel steering or…

Artificial Intelligence · Computer Science 2026-04-08 Shiyao Qian , Yuan Ren , Dongfeng Bai , Bingbing Liu