English
Related papers

Related papers: PhysX-Omni: Unified Simulation-Ready Physical 3D G…

200 papers

Following rapid advancements in text and image generation, research has increasingly shifted towards 3D generation. Unlike the well-established pixel-based representation in images, 3D representations remain diverse and fragmented,…

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

Animatable 3D assets, defined as geometry equipped with an articulated skeleton and skinning weights, are fundamental to interactive graphics, embodied agents, and animation production. While recent 3D generative models can synthesize…

$360^{\circ}$ omnidirectional images (ODIs) have gained considerable attention recently, and are widely used in various virtual reality (VR) and augmented reality (AR) applications. However, capturing such images is expensive and requires…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Liu Yang , Huiyu Duan , Yucheng Zhu , Xiaohong Liu , Lu Liu , Zitong Xu , Guangji Ma , Xiongkuo Min , Guangtao Zhai , Patrick Le Callet

The creation of 3D assets with explicit, editable part structures is crucial for advancing interactive applications, yet most generative methods produce only monolithic shapes, limiting their utility. We introduce OmniPart, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yunhan Yang , Yufan Zhou , Yuan-Chen Guo , Zi-Xin Zou , Yukun Huang , Ying-Tian Liu , Hao Xu , Ding Liang , Yan-Pei Cao , Xihui Liu

We present PhysGen, a novel image-to-video generation method that converts a single image and an input condition (e.g., force and torque applied to an object in the image) to produce a realistic, physically plausible, and temporally…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Shaowei Liu , Zhongzheng Ren , Saurabh Gupta , Shenlong Wang

Reconstructing and simulating dynamic 3D scenes with both visual realism and physical consistency remains a fundamental challenge. Existing neural representations, such as NeRFs and 3DGS, excel in appearance reconstruction but struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Dan Wang , Xinrui Cui , Serge Belongie , Ravi Ramamoorthi

We present AnimaX, a feed-forward 3D animation framework that bridges the motion priors of video diffusion models with the controllable structure of skeleton-based animation. Traditional motion synthesis methods are either restricted to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zehuan Huang , Haoran Feng , Yangtian Sun , Yuanchen Guo , Yanpei Cao , Lu Sheng

We present a computational framework that transforms single images into 3D physical objects. The visual geometry of a physical object in an image is determined by three orthogonal attributes: mechanical properties, external forces, and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Minghao Guo , Bohan Wang , Pingchuan Ma , Tianyuan Zhang , Crystal Elaine Owens , Chuang Gan , Joshua B. Tenenbaum , Kaiming He , Wojciech Matusik

Interactable objects are ubiquitous in our daily lives. Recent advances in 3D generative models make it possible to automate the modeling of these objects, benefiting a range of applications from 3D printing to the creation of robot…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Rundong Luo , Haoran Geng , Congyue Deng , Puhao Li , Zan Wang , Baoxiong Jia , Leonidas Guibas , Siyuan Huang

Recent advances in modeling 3D objects mostly rely on synthetic datasets due to the lack of large-scale realscanned 3D databases. To facilitate the development of 3D perception, reconstruction, and generation in the real world, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Tong Wu , Jiarui Zhang , Xiao Fu , Yuxin Wang , Jiawei Ren , Liang Pan , Wayne Wu , Lei Yang , Jiaqi Wang , Chen Qian , Dahua Lin , Ziwei Liu

The increasing demand for high-quality 3D assets across various industries necessitates efficient and automated 3D content creation. Despite recent advancements in 3D generative models, existing methods still face challenges with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhaoxi Chen , Jiaxiang Tang , Yuhao Dong , Ziang Cao , Fangzhou Hong , Yushi Lan , Tengfei Wang , Haozhe Xie , Tong Wu , Shunsuke Saito , Liang Pan , Dahua Lin , Ziwei Liu

Recently, the powerful text-to-image capabilities of ChatGPT-4o have led to growing appreciation for native multimodal large language models. However, its multimodal capabilities remain confined to images and text. Yet beyond images, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junliang Ye , Zhengyi Wang , Ruowen Zhao , Shenghao Xie , Jun Zhu

Inspired by generative paradigms in image and video, 3D shape generation has made notable progress, enabling the rapid synthesis of high-fidelity 3D assets from a single image. However, current methods still face challenges, including the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yangguang Li , Xianglong He , Zi-Xin Zou , Zexiang Liu , Wanli Ouyang , Ding Liang , Yan-Pei Cao

We present UniTEX, a novel two-stage 3D texture generation framework to create high-quality, consistent textures for 3D assets. Existing approaches predominantly rely on UV-based inpainting to refine textures after reprojecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yixun Liang , Kunming Luo , Xiao Chen , Rui Chen , Hongyu Yan , Weiyu Li , Jiarui Liu , Ping Tan

We present SOPHY, a generative model for 3D physics-aware shape synthesis. Unlike existing 3D generative models that focus solely on static geometry or 4D models that produce physics-agnostic animations, our method jointly synthesizes…

Graphics · Computer Science 2025-08-12 Junyi Cao , Evangelos Kalogerakis

3D animation is central to modern visual media, yet traditional production pipelines remain labor-intensive, expertise-demanding, and computationally expensive. Recent AIGC-based approaches partially automate asset creation and rigging, but…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yupeng Zhu , Xiongzhen Zhang , Ye Chen , Bingbing Ni

Function in natural systems arises from one-dimensional sequences forming three-dimensional structures with specific properties. However, current generative models suffer from critical limitations: training objectives seldom target function…

Foundation models have achieved remarkable success across video, image, and language domains. By scaling up the number of parameters and training datasets, these models acquire generalizable world knowledge and often surpass task-specific…

Machine Learning · Computer Science 2025-07-16 Tung Nguyen , Arsh Koneru , Shufan Li , Aditya Grover

Learning effective multi-modal 3D representations of objects is essential for numerous applications, such as augmented reality and robotics. Existing methods often rely on task-specific embeddings that are tailored either for semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Gaia Di Lorenzo , Federico Tombari , Marc Pollefeys , Daniel Barath