English
Related papers

Related papers: MOC-3D: Manifold-Order Consistency for Text-to-3D …

200 papers

3D semantic occupancy prediction is a pivotal task in autonomous driving, providing a dense and fine-grained understanding of the surrounding environment, yet single-modality methods face trade-offs between camera semantics and LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 A. Enes Doruk , Hasan F. Ates

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xubo Zhu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Wen Yang , Huai Yu

Current text-to-image models struggle to provide precise camera control using natural language alone. In this work, we present a framework for precise camera control with global scene understanding in text-to-image generation by learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xinxuan Lu , Charless Fowlkes , Alexander C. Berg

3D AI-generated content (AIGC) has made it increasingly accessible for anyone to become a 3D content creator. While recent methods leverage Score Distillation Sampling to distill 3D objects from pretrained image diffusion models, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yuxiao Yang , Peihao Li , Yuhong Zhang , Junzhe Lu , Xianglong He , Minghan Qin , Weitao Wang , Haoqian Wang

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

Machine Learning · Computer Science 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

In this paper, we investigate an open research task of cross-modal retrieval between 3D shapes and textual descriptions. Previous approaches mainly rely on point cloud encoders for feature extraction, which may ignore key inherent features…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Hao Wu , Ruochong LI , Hao Wang , Hui Xiong

While image diffusion models have made significant progress in text-driven 3D content creation, they often fail to accurately capture the intended meaning of text prompts, especially for view information. This limitation leads to the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhipeng Hu , Minda Zhao , Chaoyi Zhao , Xinyue Liang , Lincheng Li , Zeng Zhao , Changjie Fan , Xiaowei Zhou , Xin Yu

Existing multi-object image generation methods face difficulties in achieving precise alignment between localized image generation regions and their corresponding semantics based on language descriptions, frequently resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yanfeng Li , Yue Sun , Keren Fu , Sio-Kei Im , Xiaoming Liu , Guangtao Zhai , Xiaohong Liu , Tao Tan

Text-to-3D generation has advanced rapidly, yet state-of-the-art models, encompassing both optimization-based and feed-forward architectures, still face two fundamental limitations. First, they struggle with coarse semantic alignment, often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Weimin Bai , Yubo Li , Weijian Luo , Zeqiang Lai , Yequan Wang , Wenzheng Chen , He Sun

Recent progress in 3D object generation has been fueled by the strong priors offered by diffusion models. However, existing models are tailored to specific tasks, accommodating only one modality at a time and necessitating retraining to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yijun Fan , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Generating dense multiview images from text prompts is crucial for creating high-fidelity 3D assets. Nevertheless, existing methods struggle with space-view correspondences, resulting in sparse and low-quality outputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Bonan Li , Zicheng Zhang , Xingyi Yang , Xinchao Wang

The generation of accurate 3D molecular conformations is a pivotal challenge in computational chemistry and drug discovery. Recently, diffusion and flow matching models have achieved remarkable success. However, there is a critical…

Machine Learning · Computer Science 2026-05-26 Yunqing Liu , Yi Zhou , Wenqi Fan

Despite the remarkable progress of 3D generation, achieving controllability, i.e., ensuring consistency between generated 3D content and input conditions like edge and depth, remains a significant challenge. Existing methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Hongbin Xu , Chaohui Yu , Feng Xiao , Jiazheng Xing , Hai Ci , Weitao Chen , Fan Wang , Ming Li

Recent 3D generative models have achieved remarkable performance in synthesizing high resolution photorealistic images with view consistency and detailed 3D shapes, but training them for diverse domains is challenging since it requires…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Gwanghyun Kim , Se Young Chun

Text-guided 3D object generation aims to generate 3D objects described by user-defined captions, which paves a flexible way to visualize what we imagined. Although some works have been devoted to solving this challenging task, these works…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zutao Jiang , Guansong Lu , Xiaodan Liang , Jihua Zhu , Wei Zhang , Xiaojun Chang , Hang Xu

Recent advances in histopathology vision-language foundation models (VLFMs) have shown promise in addressing data scarcity for whole slide image (WSI) classification via zero-shot adaptation. However, these methods remain outperformed by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Tianqi Xiang , Yi Li , Qixiang Zhang , Xiaomeng Li

By leveraging the text-to-image diffusion priors, score distillation can synthesize 3D contents without paired text-3D training data. Instead of spending hours of online optimization per text prompt, recent studies have been focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyuan Ma , Yuxiang Wei , Yabin Zhang , Xiangyu Zhu , Zhen Lei , Lei Zhang