English
Related papers

Related papers: MirrorVerse: Pushing Diffusion Models to Realistic…

200 papers

Most end-to-end autonomous driving methods rely on imitation learning from single expert demonstrations, often leading to conservative and homogeneous behaviors that limit generalization in complex real-world scenarios. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ziying Song , Lin Liu , Hongyu Pan , Bencheng Liao , Mingzhe Guo , Lei Yang , Yongchang Zhang , Shaoqing Xu , Caiyan Jia , Yadan Luo

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

Real-world image denoising is an extremely important image processing problem, which aims to recover clean images from noisy images captured in natural environments. In recent years, diffusion models have achieved very promising results in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Cheng Yang , Lijing Liang , Zhixun Su

Unsupervised visual object tracking is a challenging task that requires following arbitrary targets in videos without training on ground-truth annotations. Despite considerable progress, existing state-of-the-art unsupervised trackers often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhengbo Zhang , Zhigang Tu , Junsong Yuan , De Wen Soh , Bo Du

Establishing reliable correspondences is crucial for all registration tasks, including 2D image registration, 3D point cloud registration, and 2D-3D image-to-point cloud registration. However, these tasks are often complicated by challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qianliang Wu , Haobo Jiang , Yaqing Ding , Lei Luo , Jun Li , Jin Xie , Xiaojun Wu , Jian Yang

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

Perpetual view generation aims to synthesize a long-term video corresponding to an arbitrary camera trajectory solely from a single input image. Recent methods commonly utilize a pre-trained text-to-image diffusion model to synthesize new…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bo Pan , Yang Chen , Yingwei Pan , Ting Yao , Wei Chen , Tao Mei

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Generating high-quality whole-body human object interaction motion sequences is becoming increasingly important in various fields such as animation, VR/AR, and robotics. The main challenge of this task lies in determining the level of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yonghao Zhang , Qiang He , Yanguang Wan , Yinda Zhang , Xiaoming Deng , Cuixia Ma , Hongan Wang

Diffusion models have become a popular approach for image generation and reconstruction due to their numerous advantages. However, most diffusion-based inverse problem-solving methods only deal with 2D images, and even recently published 3D…

Image and Video Processing · Electrical Eng. & Systems 2023-09-04 Suhyeon Lee , Hyungjin Chung , Minyoung Park , Jonghyuk Park , Wi-Sun Ryu , Jong Chul Ye

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Diffusion models have fundamentally transformed the field of generative models, making the assessment of similarity between customized model outputs and reference inputs critically important. However, traditional perceptual similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Yiren Song , Xiaokang Liu , Mike Zheng Shou

Large-scale generative models are capable of producing high-quality images from detailed text descriptions. However, many aspects of an image are difficult or impossible to convey through text. We introduce self-guidance, a method that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Dave Epstein , Allan Jabri , Ben Poole , Alexei A. Efros , Aleksander Holynski

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

The depth completion task is a critical problem in autonomous driving, involving the generation of dense depth maps from sparse depth maps and RGB images. Most existing methods employ a spatial propagation network to iteratively refine the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ming Yuan , Chuang Zhang , Lei He , Qing Xu , Jianqiang Wang

Diffusion models have achieved state-of-the-art results on many modalities including images, speech, and video. However, existing models are not tailored to support remote sensing data, which is widely used in important applications…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Samar Khanna , Patrick Liu , Linqi Zhou , Chenlin Meng , Robin Rombach , Marshall Burke , David Lobell , Stefano Ermon

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Gihyun Kwon , Jong Chul Ye

Generating realistic 3D scenes is an area of growing interest in computer vision and robotics. However, creating high-quality, diverse synthetic 3D content often requires expert intervention, making it costly and complex. Recently, efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Siyi Hu , Diego Martin Arroyo , Stephanie Debats , Fabian Manhardt , Luca Carlone , Federico Tombari

Detecting diffusion-generated images has recently grown into an emerging research area. Existing diffusion-based datasets predominantly focus on general image generation. However, facial forgeries, which pose a more severe social risk, have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Harry Cheng , Yangyang Guo , Tianyi Wang , Liqiang Nie , Mohan Kankanhalli