English
Related papers

Related papers: DeTrack: In-model Latent Denoising Learning for Vi…

200 papers

Denoising diffusion models are a novel class of generative algorithms that achieve state-of-the-art performance across a range of domains, including image generation and text-to-image tasks. Building on this success, diffusion models have…

Machine Learning · Computer Science 2024-03-08 Nic Fishman , Leo Klarner , Valentin De Bortoli , Emile Mathieu , Michael Hutchinson

Recovering high-dimensional statistical structure from limited measurements is a fundamental challenge in hyperspectral imaging, where capturing full-resolution data is often infeasible due to sensor, bandwidth, or acquisition constraints.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-01 Jonathan Monsalve , Kumar Vijay Mishra

We propose a self-supervised approach for training multi-frame video denoising networks. These networks predict frame t from a window of frames around t. Our self-supervised approach benefits from the video temporal consistency by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Valéry Dewil , Jérémy Anger , Axel Davy , Thibaud Ehret , Pablo Arias , Gabriele Facciolo

Denoising diffusion models have recently shown impressive results in generative tasks. By learning powerful priors from huge collections of training images, such models are able to gradually modify complete noise to a clean natural image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Naama Pearl , Yaron Brodsky , Dana Berman , Assaf Zomet , Alex Rav Acha , Daniel Cohen-Or , Dani Lischinski

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

Deep learning inference that needs to largely take place on the 'edge' is a highly computational and memory intensive workload, making it intractable for low-power, embedded platforms such as mobile nodes and remote security applications.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Andres Ussa , Chockalingam Senthil Rajen , Deepak Singla , Jyotibdha Acharya , Gideon Fu Chuanrong , Arindam Basu , Bharath Ramesh

Optical Coherence Tomography (OCT) is pervasive in both the research and clinical practice of Ophthalmology. However, OCT images are strongly corrupted by noise, limiting their interpretation. Current OCT denoisers leverage assumptions on…

Image and Video Processing · Electrical Eng. & Systems 2020-08-19 Guillaume Gisbert , Neel Dey , Hiroshi Ishikawa , Joel Schuman , James Fishbaugh , Guido Gerig

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

Recent work has shown that object-centric representations can greatly help improve the accuracy of learning dynamics while also bringing interpretability. In this work, we take this idea one step further, ask the following question: "can…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sanket Gandhi , Atul , Samanyu Mahajan , Vishal Sharma , Rushil Gupta , Arnab Kumar Mondal , Parag Singla

Image denoising methods must effectively model, implicitly or explicitly, the vast diversity of patterns and textures that occur in natural images. This is challenging, even for modern methods that leverage deep neural networks trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Zhihao Xia , Ayan Chakrabarti

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

Since the development of self-supervised visual representation learning from contrastive learning to masked image modeling (MIM), there is no significant difference in essence, that is, how to design proper pretext tasks for vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Kun Yi , Yixiao Ge , Xiaotong Li , Shusheng Yang , Dian Li , Jianping Wu , Ying Shan , Xiaohu Qie

When capturing and storing images, devices inevitably introduce noise. Reducing this noise is a critical task called image denoising. Deep learning has become the de facto method for image denoising, especially with the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Haoyu Chen , Jinjin Gu , Yihao Liu , Salma Abdel Magid , Chao Dong , Qiong Wang , Hanspeter Pfister , Lei Zhu

In recent years, diffusion models have demonstrated remarkable potential across diverse domains, from vision generation to language modeling. Transferring its generative capabilities to modern end-to-end autonomous driving systems has also…

Robotics · Computer Science 2025-09-17 Xuefeng Jiang , Yuan Ma , Pengxiang Li , Leimeng Xu , Xin Wen , Kun Zhan , Zhongpu Xia , Peng Jia , Xianpeng Lang , Sheng Sun

This work presents an optimization method for generating kinodynamically feasible and collision-free multi-robot trajectories that exploits an incremental denoising scheme in diffusion models. Our key insight is that high-quality…

Robotics · Computer Science 2025-07-08 Yuhao Zhang , Keisuke Okumura , Heedo Woo , Ajay Shankar , Amanda Prorok

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space, which can then be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Evangelos Ntavelis , Aliaksandr Siarohin , Kyle Olszewski , Chaoyang Wang , Luc Van Gool , Sergey Tulyakov

Diffusion models have demonstrated remarkable performance in generation tasks. Nevertheless, explaining the diffusion process remains challenging due to it being a sequence of denoising noisy images that are difficult for experts to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Ji-Hoon Park , Yeong-Joon Ju , Seong-Whan Lee

Object tracking is central to robot perception and scene understanding. Tracking-by-detection has long been a dominant paradigm for object tracking of specific object categories. Recently, large-scale pre-trained models have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Wen-Hsuan Chu , Adam W. Harley , Pavel Tokmakov , Achal Dave , Leonidas Guibas , Katerina Fragkiadaki

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu