English
Related papers

Related papers: Diffusion Models with Anisotropic Gaussian Splatti…

200 papers

Image interpolation based on diffusion models is promising in creating fresh and interesting images. Advanced interpolation methods mainly focus on spherical linear interpolation, where images are encoded into the noise space and then…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 PengFei Zheng , Yonggang Zhang , Zhen Fang , Tongliang Liu , Defu Lian , Bo Han

Pseudo-healthy image inpainting is an essential preprocessing step for analyzing pathological brain MRI scans. Most current inpainting methods favor slice-wise 2D models for their high in-plane fidelity, but their independence across slices…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Dou Hoon Kwark , Shirui Luo , Xiyue Zhu , Yudu Li , Zhi-Pei Liang , Volodymyr Kindratenko

Differentiable 3D-Gaussian splatting (GS) is emerging as a prominent technique in computer vision and graphics for reconstructing 3D scenes. GS represents a scene as a set of 3D Gaussians with varying opacities and employs a computationally…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Ziyuan Qu , Omkar Vengurlekar , Mohamad Qadri , Kevin Zhang , Michael Kaess , Christopher Metzler , Suren Jayasuriya , Adithya Pediredla

In recent years, diffusion models have achieved remarkable success in various domains of artificial intelligence, such as image synthesis, super-resolution, and 3D molecule generation. However, the application of diffusion models in graph…

Machine Learning · Computer Science 2023-06-26 Run Yang , Yuling Yang , Fan Zhou , Qiang Sun

Transmissive scenes are ubiquitous in daily life, yet reconstructing and rendering them remains highly challenging due to the inherent entanglement between near-field reflections from the surrounding environment on the transmissive surface,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhenyu Liang , Xiao Zhang , Tianchao Li , Jack C. P. Cheng , Chi-Keung Tang

The creation of high-quality 3D assets is paramount for applications in digital heritage preservation, entertainment, and robotics. Traditionally, this process necessitates skilled professionals and specialized software for the modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shen Chen , Jiale Zhou , Zhongyu Jiang , Tianfang Zhang , Zongkai Wu , Jenq-Neng Hwang , Lei Li

Neural Radiance Fields and 3D Gaussian Splatting have advanced novel view synthesis, yet still rely on dense inputs and often degrade at extrapolated views. Recent approaches leverage generative models, such as diffusion models, to provide…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Hongyu Zhou , Zisen Shao , Sheng Miao , Pan Wang , Dongfeng Bai , Bingbing Liu , Yiyi Liao

Capturing and reconstructing high-speed dynamic 3D scenes has numerous applications in computer graphics, vision, and interdisciplinary fields such as robotics, aerodynamics, and evolutionary biology. However, achieving this using a single…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Zihao Zou , Ziyuan Qu , Xi Peng , Vivek Boominathan , Adithya Pediredla , Praneeth Chakravarthula

Large scale image super-resolution is a challenging computer vision task, since vast information is missing in a highly degraded image, say for example forscale x16 super-resolution. Diffusion models are used successfully in recent years in…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Chun-Chuen Hui , Wan-Chi Siu , Ngai-Fong Law

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

Image-based 3D generation has vast applications in robotics and gaming, where high-quality, diverse outputs and consistent 3D representations are crucial. However, existing methods have limitations: 3D diffusion models are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ye Tao , Jiawei Zhang , Yahao Shi , Dongqing Zou , Bin Zhou

Image inpainting, the process of restoring corrupted images, has seen significant advancements with the advent of diffusion models (DMs). Despite these advancements, current DM adaptations for inpainting, which involve modifications to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuan Ju , Xian Liu , Xintao Wang , Yuxuan Bian , Ying Shan , Qiang Xu

Recently, 3D Gaussian Splatting (3DGS) has attracted widespread attention due to its high-quality rendering, and ultra-fast training and rendering speed. However, due to the unstructured and irregular nature of Gaussian point clouds, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Danpeng Chen , Hai Li , Weicai Ye , Yifan Wang , Weijian Xie , Shangjin Zhai , Nan Wang , Haomin Liu , Hujun Bao , Guofeng Zhang

Manual modeling of material parameters and 3D geometry is a time consuming yet essential task in the gaming and film industries. While recent advances in 3D reconstruction have enabled accurate approximations of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Philipp Langsteiner , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Generating high-quality 3D content requires models capable of learning robust distributions of complex scenes and the real-world objects within them. Recent Gaussian-based 3D reconstruction techniques have achieved impressive results in…

Image and Video Processing · Electrical Eng. & Systems 2024-12-16 Kevin Miao , Harsh Agrawal , Qihang Zhang , Federico Semeraro , Marco Cavallo , Jiatao Gu , Alexander Toshev

We propose a novel framework that enhances non-rigid 3D model deformations by bridging mesh representations with 3D Gaussian splatting. While traditional Gaussian splatting delivers fast, real-time radiance-field rendering, its post-editing…

Graphics · Computer Science 2025-07-10 Wijayathunga W. M. R. D. B

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

Implicit neural representation methods have shown impressive advancements in learning 3D scenes from unstructured in-the-wild photo collections but are still limited by the large computational cost of volumetric rendering. More recently, 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hiba Dahmani , Moussab Bennehar , Nathan Piasco , Luis Roldao , Dzmitry Tsishkou

Gaussian splatting (GS) along with its extensions and variants provides outstanding performance in real-time scene rendering while meeting reduced storage demands and computational efficiency. While the selection of 2D images capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Konstantinos D. Polyzos , Athanasios Bacharis , Saketh Madhuvarasu , Nikos Papanikolopoulos , Tara Javidi