English
Related papers

Related papers: CaliTex: Geometry-Calibrated Attention for View-Co…

200 papers

While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balancing narrative dynamism with multi-character coherence. Existing methods often falter at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qi Zhao , Jun Chen , Ivor Tsang , Guang Dai

Despite recent advances in text-to-3D generation techniques, current methods often suffer from geometric inconsistencies, commonly referred to as the Janus Problem. This paper identifies the root cause of the Janus Problem: viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Qing Zhang , Jinguang Tong , Jing Zhang , Jie Hong , Xuesong Li

In this paper, we introduce Era3D, a novel multiview diffusion method that generates high-resolution multiview images from a single-view image. Despite significant advancements in multiview generation, existing methods still suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Peng Li , Yuan Liu , Xiaoxiao Long , Feihu Zhang , Cheng Lin , Mengfei Li , Xingqun Qi , Shanghang Zhang , Wenhan Luo , Ping Tan , Wenping Wang , Qifeng Liu , Yike Guo

Determining crystal symmetry from powder X-ray diffraction is a central problem in materials characterization, yet multiple space groups can produce indistinguishable patterns, making automated classification difficult. We show that…

To address the data scarcity associated with 3D assets, 2D-lifting techniques such as Score Distillation Sampling (SDS) have become a widely adopted practice in text-to-3D generation pipelines. However, the diffusion models used in these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Utkarsh Nath , Rajeev Goel , Eun Som Jeon , Changhoon Kim , Kyle Min , Yezhou Yang , Yingzhen Yang , Pavan Turaga

Modern diffusion models, particularly those utilizing a Transformer-based UNet for denoising, rely heavily on self-attention operations to manage complex spatial relationships, thus achieving impressive generation performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Songhua Liu , Weihao Yu , Zhenxiong Tan , Xinchao Wang

Designing sparse attention for diffusion transformers requires reconciling two-dimensional spatial locality with GPU efficiency, a trade-off that current methods struggle to achieve. Existing approaches enforce two-dimensional spatial…

Artificial Intelligence · Computer Science 2025-10-01 Shaoyi Zheng , Wenbo Lu , Yuxuan Xia , Haomin Liu , Shengjie Wang

We seek to give users precise control over diffusion-based image generation by modeling complex scenes as sequences of layers, which define the desired spatial arrangement and visual attributes of objects in the scene. Collage Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vishnu Sarukkai , Linden Li , Arden Ma , Christopher Ré , Kayvon Fatahalian

Although diffusion-based models can generate high-quality and high-resolution video sequences from textual or image inputs, they lack explicit integration of geometric cues when controlling scene lighting and visual appearance across…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yuanze Lin , Yi-Wen Chen , Yi-Hsuan Tsai , Ronald Clark , Ming-Hsuan Yang

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

Text-to-image diffusion models generate highly detailed textures, yet they often rely on surface appearance and fail to follow strict geometric constraints, particularly when those constraints conflict with the style implied by the text…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Antara Titikhsha , Om Kulkarni , Dharun Muthaiah

Text-driven 3D editing seeks to modify 3D scenes according to textual descriptions, and most existing approaches tackle this by adapting pre-trained 2D image editors to multi-view inputs. However, without explicit control over multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Zhe Zhu , Honghua Chen , Peng Li , Mingqiang Wei

Safety-critical 3D scene understanding tasks necessitate not only accurate but also confident predictions from 3D perception models. This study introduces Calib3D, a pioneering effort to benchmark and scrutinize the reliability of 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lingdong Kong , Xiang Xu , Jun Cen , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yuyao Zhang , Yu-Wing Tai

Despite the success of convolution- and attention-based models in vision tasks, their rigid receptive fields and complex architectures limit their ability to model irregular spatial patterns and hinder interpretability, therefore posing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Xiangshuai Song , Jun-Jie Huang , Tianrui Liu , Ke Liang , Chang Tang

We present a novel framework for enhancing the visual fidelity and consistency of text-guided 3D Gaussian Splatting (3DGS) editing. Existing editing approaches face two critical challenges: inconsistent geometric reconstructions across…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Xuanqi Zhang , Jieun Lee , Chris Joslin , Wonsook Lee

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

3D AI-generated content (AIGC) has made it increasingly accessible for anyone to become a 3D content creator. While recent methods leverage Score Distillation Sampling to distill 3D objects from pretrained image diffusion models, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yuxiao Yang , Peihao Li , Yuhong Zhang , Junzhe Lu , Xianglong He , Minghan Qin , Weitao Wang , Haoqian Wang

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

With the advent of depth-to-image diffusion models, text-guided generation, editing, and transfer of realistic textures are no longer difficult. However, due to the limitations of pre-trained diffusion models, they can only create…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Zhibin Tang , Tiantong He