English
Related papers

Related papers: Bioinspired123D: Generative 3D Modeling System for…

200 papers

Structure-based drug design aims at generating high affinity ligands with prior knowledge of 3D target structures. Existing methods either use conditional generative model to learn the distribution of 3D ligands given target binding sites,…

Biomolecules · Quantitative Biology 2024-03-18 Yuwei Yang , Siqi Ouyang , Xueyu Hu , Mingyue Zheng , Hao Zhou , Lei Li

The convergence of generative artificial intelligence and advanced computer vision technologies introduces a groundbreaking approach to transforming textual descriptions into three-dimensional representations. This research proposes a fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Venkat Kumar R , Deepak Saravanan

We present I2V3D, a novel framework for animating static images into dynamic videos with precise 3D control, leveraging the strengths of both 3D geometry guidance and advanced generative models. Our approach combines the precision of a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhiyuan Zhang , Dongdong Chen , Jing Liao

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

Generating coherent and useful image/video scenes from a free-form textual description is technically a very difficult problem to handle. Textual description of the same scene can vary greatly from person to person, or sometimes even for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Faria Huq , Nafees Ahmed , Anindya Iqbal

We propose a data-driven 3D shape design method that can learn a generative model from a corpus of existing designs, and use this model to produce a wide range of new designs. The approach learns an encoding of the samples in the training…

Converting hand-drawn sketches into structured 3D geometries remains challenging due to the difficulty of representing non-Euclidean surfaces and maintaining topological consistency. Existing generative models such as GANs, NeRFs, and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenda Wang , Anqi Liu , Junqi Yang , Lei He , Luying Wang , Jiachen Lu , Weixin Huang

Generating and editing a 3D scene guided by natural language poses a challenge, primarily due to the complexity of specifying the positional relations and volumetric changes within the 3D space. Recent advancements in Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Yiqi Lin , Hao Wu , Ruichen Wang , Haonan Lu , Xiaodong Lin , Hui Xiong , Lin Wang

Diffusion models trained on large-scale text-image datasets have demonstrated a strong capability of controllable high-quality image generation from arbitrary text prompts. However, the generation quality and generalization ability of 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Ying-Tian Liu , Yuan-Chen Guo , Guan Luo , Heyi Sun , Wei Yin , Song-Hai Zhang

Engineering design optimization requires an efficient combination of a 3D shape representation, an optimization algorithm, and a design performance evaluation method, which is often computationally expensive. We present a prompt evolution…

Artificial Intelligence · Computer Science 2024-08-13 Melvin Wong , Thiago Rios , Stefan Menzel , Yew Soon Ong

Recent generative AI models have achieved remarkable breakthroughs in language and visual understanding. However, although these models can generate realistic visual content, their spatial scale remains confined to bounded environments,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jinqi Cao , Zhiping Yu , Baihong Lin , Chenyang Liu , Zhenwei Shi , Zhengxia Zou

We present Seed3D 2.0, an advanced 3D content generation system built on Seed3D 1.0, with substantial improvements across generation fidelity, simulation-ready capabilities, and application coverage. For geometry, a coarse-to-fine two-stage…

Deep generative models of 3D shapes have received a great deal of research interest. Yet, almost all of them generate discrete shape representations, such as voxels, point clouds, and polygon meshes. We present the first 3D generative model…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Rundi Wu , Chang Xiao , Changxi Zheng

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layout-guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiaoyu Zhou , Xingjian Ran , Yajiao Xiong , Jinlin He , Zhiwei Lin , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

We study a fundamental problem in structure-based drug design -- generating molecules that bind to specific protein binding sites. While we have witnessed the great success of deep generative models in drug design, the existing methods are…

Biomolecules · Quantitative Biology 2022-11-15 Shitong Luo , Jiaqi Guan , Jianzhu Ma , Jian Peng

Recent advancements in text-to-3D generation have shown remarkable results by leveraging 3D priors in combination with 2D diffusion. However, previous methods utilize 3D priors that lack detailed and complex structural information, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Hao Wu , Hao Wang , Ruochong Li , Xuran Ma , Hui Xiong

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

Recent progress in text-to-3D object generation enables the synthesis of detailed geometry from text input by leveraging 2D diffusion models and differentiable 3D representations. However, the approaches often suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ming He , Zhixiang Chen , Steve Maddock

The study of biological materials and bio-inspired materials science is well established; however, surprisingly little knowledge has been systematically translated to engineering solutions. To accelerate discovery and guide insights, an…

Materials Science · Physics 2023-12-12 Rachel K. Luu , Markus J. Buehler