中文
相关论文

相关论文: 3DIS-FLUX: simple and efficient multi-instance gen…

200 篇论文

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Hansheng Chen , Bokui Shen , Yulin Liu , Ruoxi Shi , Linqi Zhou , Connor Z. Lin , Jiayuan Gu , Hao Su , Gordon Wetzstein , Leonidas Guibas

Recent Diffusion Transformers (e.g., DiT) have demonstrated their powerful effectiveness in generating high-quality 2D images. However, it is still being determined whether the Transformer architecture performs equally well in 3D shape…

计算机视觉与模式识别 · 计算机科学 2023-07-06 Shentong Mo , Enze Xie , Ruihang Chu , Lewei Yao , Lanqing Hong , Matthias Nießner , Zhenguo Li

Collecting multi-view driving scenario videos to enhance the performance of 3D visual perception tasks presents significant challenges and incurs substantial costs, making generative models for realistic data an appealing alternative. Yet,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Junpeng Jiang , Gangyi Hong , Miao Zhang , Hengtong Hu , Kun Zhan , Rui Shao , Liqiang Nie

Generating realistic 3D scenes is an area of growing interest in computer vision and robotics. However, creating high-quality, diverse synthetic 3D content often requires expert intervention, making it costly and complex. Recently, efforts…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Siyi Hu , Diego Martin Arroyo , Stephanie Debats , Fabian Manhardt , Luca Carlone , Federico Tombari

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

Diffusion models have shown exceptional performance in visual generation tasks. Recently, these models have shifted from traditional U-Shaped CNN-Attention hybrid structures to fully transformer-based isotropic architectures. While these…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yuchuan Tian , Jing Han , Chengcheng Wang , Yuchen Liang , Chao Xu , Hanting Chen

Diffusion Transformer (DiT), a promising diffusion model for visual generation, demonstrates impressive performance but incurs significant computational overhead. Intriguingly, analysis of pre-trained DiT models reveals that global…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Yuang Ai , Qihang Fan , Xuefeng Hu , Zhenheng Yang , Ran He , Huaibo Huang

Current video generative foundation models primarily focus on text-to-video tasks, providing limited control for fine-grained video content creation. Although adapter-based approaches (e.g., ControlNet) enable additional controls with…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Xuan Ju , Weicai Ye , Quande Liu , Qiulin Wang , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai , Qiang Xu

Diffusion transformers have recently delivered strong text-to-image generation around 1K resolution, but we show that extending them to native 4K across diverse aspect ratios exposes a tightly coupled failure mode spanning positional…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Tian Ye , Song Fei , Lei Zhu

Controllability plays a crucial role in the practical applications of 3D indoor scene synthesis. Existing works either allow rough language-based control, that is convenient but lacks fine-grained scene customization, or employ graph based…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Tongyuan Bai , Wangyuanfan Bai , Dong Chen , Tieru Wu , Manyi Li , Rui Ma

Recent advances in text-to-image (T2I) generation have led to impressive visual results. However, these models still face significant challenges when handling complex prompt, particularly those involving multiple subjects with distinct…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Lifeng Chen , Jiner Wang , Zihao Pan , Beier Zhu , Xiaofeng Yang , Chi Zhang

Recent advancements in 3D editing have highlighted the potential of text-driven methods in real-time, user-friendly AR/VR applications. However, current methods rely on 2D diffusion models without adequately considering multi-view…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Dong In Lee , Hyeongcheol Park , Jiyoung Seo , Eunbyung Park , Hyunje Park , Ha Dam Baek , Sangheon Shin , Sangmin Kim , Sangpil Kim

Acquiring reliable microstructure datasets is a pivotal step toward the systematic design of materials with the aid of integrated computational materials engineering (ICME) approaches. However, obtaining three-dimensional (3D)…

材料科学 · 物理学 2023-09-26 Kang-Hyun Lee , Gun Jin Yun

Scene text editing aims to modify or add texts on images while ensuring text fidelity and overall visual quality consistent with the background. Recent methods are primarily built on UNet-based diffusion models, which have improved scene…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Rui Lan , Yancheng Bai , Xu Duan , Mingxing Li , Dongyang Jin , Ryan Xu , Dong Nie , Lei Sun , Xiangxiang Chu

We present Lynx, a high-fidelity model for personalized video synthesis from a single input image. Built on an open-source Diffusion Transformer (DiT) foundation model, Lynx introduces two lightweight adapters to ensure identity fidelity.…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Shen Sang , Tiancheng Zhi , Tianpei Gu , Jing Liu , Linjie Luo

Flow-based 3D generation models typically require dozens of sampling steps during inference. Though few-step distillation methods, particularly Consistency Models (CMs), have achieved substantial advancements in accelerating 2D diffusion…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Zanwei Zhou , Taoran Yi , Jiemin Fang , Chen Yang , Lingxi Xie , Xinggang Wang , Wei Shen , Qi Tian

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Accurate image segmentation is essential for modern computer vision applications such as image editing, autonomous driving, and medical image analysis. In recent years, Dichotomous Image Segmentation (DIS) has become a standard task for…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Andranik Sargsyan , Shant Navasardyan

3D Gaussian Splatting (3DGS) and its subsequent works are restricted to specific hardware setups, either on only low-cost or on only high-end configurations. Approaches aimed at reducing 3DGS memory usage enable rendering on low-cost GPU…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Yunji Seo , Young Sun Choi , Hyun Seung Son , Youngjung Uh