English
Related papers

Related papers: InpaintSLat: Inpainting Structured 3D Latents via …

200 papers

Diffusion models have the ability to generate high quality images by denoising pure Gaussian noise images. While previous research has primarily focused on improving the control of image generation through adjusting the denoising process,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jiafeng Mao , Xueting Wang , Kiyoharu Aizawa

In this paper, we propose RI3D, a novel 3DGS-based approach that harnesses the power of diffusion models to reconstruct high-quality novel views given a sparse set of input images. Our key contribution is separating the view synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Avinash Paliwal , Xilong Zhou , Wei Ye , Jinhui Xiong , Rakesh Ranjan , Nima Khademi Kalantari

Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising process. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Haipeng Liu , Yang Wang , Biao Qian , Meng Wang , Yong Rui

M3DDM provides a computationally efficient framework for video outpainting via latent diffusion modeling. However, it exhibits significant quality degradation -- manifested as spatial blur and temporal inconsistency -- under challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Takuya Murakawa , Takumi Fukuzawa , Ning Ding , Toru Tamaki

Limited-Angle Computed Tomography (LACT) is a challenging inverse problem where missing angular projections lead to incomplete sinograms and severe artifacts in the reconstructed images. While recent learning-based methods have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-09 Jiaqi Guo , Santiago López-Tapia

In this paper, we present PGDI, a diffusion-based speech inpainting framework for restoring missing or severely corrupted speech segments. Unlike previous methods that struggle with speaker variability or long gap lengths, PGDI can…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Mordehay Moradi , Sharon Gannot

Synthesizing novel 3D models that resemble the input example has long been pursued by graphics artists and machine learning researchers. In this paper, we present Sin3DM, a diffusion model that learns the internal patch distribution from a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Rundi Wu , Ruoshi Liu , Carl Vondrick , Changxi Zheng

Diffusion models rely on a high-dimensional latent space of initial noise seeds, yet it remains unclear whether this space contains sufficient structure to predict properties of the generated samples, such as their classes. In this work, we…

Machine Learning · Computer Science 2026-02-09 Wei Wei , Yizhou Zeng , Kuntian Chen , Sophie Langer , Mariia Seleznova , Hung-Hsu Chou

Recent advances in diffusion models have significantly improved the synthesis of materials, textures, and 3D shapes. By conditioning these models via text or images, users can guide the generation, reducing the time required to create…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Marzia Riso , Giuseppe Vecchio , Fabio Pellacini

The field of neural rendering has witnessed significant progress with advancements in generative models and differentiable rendering techniques. Though 2D diffusion has achieved success, a unified 3D diffusion pipeline remains unsettled.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yushi Lan , Fangzhou Hong , Shangchen Zhou , Shuai Yang , Xuyi Meng , Yongwei Chen , Zhaoyang Lyu , Bo Dai , Xingang Pan , Chen Change Loy

Three-dimensional (3D) medical image enhancement, including denoising and super-resolution, is critical for clinical diagnosis in CT, PET, and MRI. Although diffusion models have shown remarkable success in 2D medical imaging, scaling them…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hongxu Jiang , Fei Li , Boxiao Yu , Ying Zhang , Kaleb Smith , Kuang Gong , Wei Shao

Diffusion models have shown promising results in free-form inpainting. Recent studies based on refined diffusion samplers or novel architectural designs led to realistic results and high data consistency. However, random initialization seed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yongzhe Lyu , Yu Wu , Yutian Lin , Bo Du

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Distilled diffusion models accelerate image generation by reducing the number of denoising steps, but often suffer from degraded image quality. To mitigate this trade-off, test-time optimization methods improve quality, yet their iterative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haewon Jeon , Si-Hyeon Lee

Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Justin Tebbe , Jawad Tayyub

Text-guided non-rigid editing involves complex edits for input images, such as changing motion or compositions within their surroundings. Since it requires manipulating the input structure, existing methods often struggle with preserving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yunji Jung , Seokju Lee , Tair Djanibekov , Hyunjung Shim , Jong Chul Ye

We explore inference-time scaling in text-guided 3D diffusion models to enhance generative quality without additional training. To this end, we introduce ITS3D, a framework that formulates the task as an optimization problem to identify the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenglin Zhou , Fan Ma , Xiaobo Xia , Hehe Fan , Yi Yang , Tat-Seng Chua

Diffusion models have emerged as highly effective techniques for inpainting, however, they remain constrained by slow sampling rates. While recent advances have enhanced generation quality, they have also increased sampling time, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Tsiry Mayet , Pourya Shamsolmoali , Simon Bernard , Eric Granger , Romain Hérault , Clement Chatelain

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Hanyi Wang , Han Fang , Zheng Wang , Shilin Wang , Ee-Chien Chang

We propose Diffusion Noise Optimization (DNO), a new method that effectively leverages existing motion diffusion models as motion priors for a wide range of motion-related tasks. Instead of training a task-specific diffusion model for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Korrawe Karunratanakul , Konpat Preechakul , Emre Aksan , Thabo Beeler , Supasorn Suwajanakorn , Siyu Tang