English
Related papers

Related papers: ITS3D: Inference-Time Scaling for Text-Guided 3D D…

200 papers

3D Gaussian Splatting (3DGS) has become a state-of-the-art framework for real-time, high-fidelity novel view synthesis. However, its substantial storage requirements and inherently unstructured representation pose challenges for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqin Lu , Yang Zhou , Yihua Dai , Guiqing Li , Shengfeng He

Diffusion models have demonstrated powerful performance in generating high-quality images. A typical example is text-to-image generator like Stable Diffusion. However, their widespread use also poses potential privacy risks. A key concern…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Guo Li , Weihong Chen , Yongfu Fan

Recent advancements in high-fidelity dynamic scene reconstruction have leveraged dynamic 3D Gaussians and 4D Gaussian Splatting for realistic scene representation. However, to make these methods viable for real-time applications such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Saqib Javed , Ahmad Jarrar Khan , Corentin Dumery , Chen Zhao , Mathieu Salzmann

Text-to-image generative models have made significant advancements in recent years; however, accurately capturing intricate details in textual prompts-such as entity missing, attribute binding errors, and incorrect relationships remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Amir Mohammad Izadi , Seyed Mohammad Hadi Hosseini , Soroush Vafaie Tabar , Ali Abdollahi , Armin Saghafian , Mahdieh Soleymani Baghshah

Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kyungmin Lee , Kihyuk Sohn , Jinwoo Shin

Text-to-image diffusion models often degrade when sampled at resolutions outside the final training resolution set. Prior work has largely emphasized higher resolution generation, enabling pretrained diffusion models to extrapolate beyond…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ruozhen He , Moayed Haji-Ali , Ziyan Yang , Vicente Ordonez

We aim to redefine robust ego-motion estimation and photorealistic 3D reconstruction by addressing a critical limitation: the reliance on noise-free data in existing models. While such sanitized conditions simplify evaluation, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Xiaohao Xu , Tianyi Zhang , Shibo Zhao , Xiang Li , Sibo Wang , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Sebastian Scherer , Xiaonan Huang

Generalized feed-forward Gaussian models have achieved significant progress in sparse-view 3D reconstruction by leveraging prior knowledge from large multi-view datasets. However, these models often struggle to represent high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Seungtae Nam , Xiangyu Sun , Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

3D Gaussian Splatting (3DGS) enables photorealistic rendering but suffers from artefacts due to sparse Structure-from-Motion (SfM) initialisation. To address this limitation, we propose GP-GS, a Gaussian Process (GP) based densification…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zhihao Guo , Jingxuan Su , Chenghao Qian , Shenglin Wang , Jinlong Fan , Jing Zhang , Wei Zhou , Hadi Amirpour , Yunlong Zhao , Liangxiu Han , Peng Wang

Infrared imagery enables temperature-based scene understanding using passive sensors, particularly under conditions of low visibility where traditional RGB imaging fails. Yet, developing downstream vision models for infrared applications is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kai A. Horstmann , Maxim Clouser , Kia Khezeli

Generating human motion that satisfies customized zero-shot goal functions, enabling applications such as controllable character animation and behavior synthesis for virtual agents, is a critical capability. While current approaches handle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hanchao Liu , Fang-Lue Zhang , Shining Zhang , Tai-Jiang Mu , Shi-Min Hu

3D Gaussian Splatting (3DGS) has emerged as a promising 3D reconstruction technique. The traditional 3DGS training pipeline follows three sequential steps: Gaussian densification, Gaussian projection, and color splatting. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Junyi Wu , Jiaming Xu , Jinhao Li , Yongkang Zhou , Jiayi Pan , Xingyang Li , Guohao Dai

Feedforward 3D Gaussian Splatting (3DGS) overcomes the limitations of optimization-based 3DGS by enabling fast and high-quality reconstruction without the need for per-scene optimization. However, existing feedforward approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anran Wu , Long Peng , Xin Di , Xueyuan Dai , Chen Wu , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

Acquiring reliable microstructure datasets is a pivotal step toward the systematic design of materials with the aid of integrated computational materials engineering (ICME) approaches. However, obtaining three-dimensional (3D)…

Materials Science · Physics 2023-09-26 Kang-Hyun Lee , Gun Jin Yun

We present DIRECT-3D, a diffusion-based 3D generative model for creating high-quality 3D assets (represented by Neural Radiance Fields) from text prompts. Unlike recent 3D generative models that rely on clean and well-aligned 3D data,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Qihao Liu , Yi Zhang , Song Bai , Adam Kortylewski , Alan Yuille

Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to…

Machine Learning · Computer Science 2024-11-19 Yunuo Chen , Tianyi Xie , Zeshun Zong , Xuan Li , Feng Gao , Yin Yang , Ying Nian Wu , Chenfanfu Jiang

We propose Diffusion Inference-Time T-Optimization (DITTO), a general-purpose frame-work for controlling pre-trained text-to-music diffusion models at inference-time via optimizing initial noise latents. Our method can be used to optimize…

Sound · Computer Science 2024-06-04 Zachary Novack , Julian McAuley , Taylor Berg-Kirkpatrick , Nicholas J. Bryan

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Generative models typically sample outputs independently, and recent inference-time guidance and scaling algorithms focus on improving the quality of individual samples. However, in real-world applications, users are often presented with a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Gaurav Parmar , Or Patashnik , Daniil Ostashev , Kuan-Chieh Wang , Kfir Aberman , Srinivasa Narasimhan , Jun-Yan Zhu

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue