English
Related papers

Related papers: Video Summarization using Denoising Diffusion Prob…

200 papers

Denoising Diffusion Probabilistic Models (DDPMs) can generate synthetic timeseries data to help improve the performance of a classifier, but their sampling process is computationally expensive. We address this by combining implicit…

Machine Learning · Computer Science 2025-11-27 Heiko Oppel , Andreas Spilz , Michael Munz

Out-of-distribution detection is crucial to the safe deployment of machine learning systems. Currently, unsupervised out-of-distribution detection is dominated by generative-based approaches that make use of estimates of the likelihood or…

It is now much easier than ever before to produce videos. While the ubiquitous video data is a great source for information discovery and extraction, the computational challenges are unparalleled. Automatically summarizing the videos has…

Machine Learning · Computer Science 2018-10-26 Aidean Sharghi , Ali Borji , Chengtao Li , Tianbao Yang , Boqing Gong

We propose the Binary Diffusion Probabilistic Model (BDPM), a generative framework specifically designed for data representations in binary form. Conventional denoising diffusion probabilistic models (DDPMs) assume continuous inputs, use…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Vitaliy Kinakh , Slava Voloshynovskiy

Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting decision-making. In…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Wele Gedara Chaminda Bandara , Nithin Gopalakrishnan Nair , Vishal M. Patel

Advances in microscopy imaging enable researchers to visualize structures at the nanoscale level thereby unraveling intricate details of biological organization. However, challenges such as image noise, photobleaching of fluorophores, and…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Pamela Osuna-Vargas , Maren H. Wehrheim , Lucas Zinz , Johanna Rahm , Ashwin Balakrishnan , Alexandra Kaminer , Mike Heilemann , Matthias Kaschube

Ultrasound images are widespread in medical diagnosis for musculoskeletal, cardiac, and obstetrical imaging due to the efficiency and non-invasiveness of the acquisition methodology. However, the acquired images are degraded by acoustic…

Image and Video Processing · Electrical Eng. & Systems 2023-06-14 Hojat Asgariandehkordi , Sobhan Goudarzi , Adrian Basarab , Hassan Rivaz

We theoretically investigate the phenomena of generalization and memorization in diffusion models. Empirical studies suggest that these phenomena are influenced by model complexity and the size of the training dataset. In our experiments,…

Machine Learning · Computer Science 2025-10-09 Anand Jerry George , Rodrigo Veiga , Nicolas Macris

Video moment retrieval and highlight detection have received attention in the current era of video content proliferation, aiming to localize moments and estimate clip relevances based on user-specific queries. Given that the video content…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Henghao Zhao , Kevin Qinghong Lin , Rui Yan , Zechao Li

Video summarization aims to automatically generate a diverse and concise summary which is useful in large-scale video processing. Most of the methods tend to adopt self-attention mechanism across video frames, which fails to model the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yingchao Pan , Ouhan Huang , Qinghao Ye , Zhongjin Li , Wenjiang Wang , Guodun Li , Yuxing Chen

Recent advancements in diffusion models have demonstrated significant success in unsupervised anomaly segmentation. For anomaly segmentation, these models are first trained on normal data; then, an anomalous image is noised to an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Mehrdad Moradi , Kamran Paynabar

This paper presents a video summarization technique for an Internet video to provide a quick way to overview its content. This is a challenging problem because finding important or informative parts of the original video requires to…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Naokazu Yokoya

Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shi Zhenning , Dong Changsheng , Xie Xueshuo , Pan Bin , He Along , Li Tao

The segmentation and tracking of living cells play a vital role within the biomedical domain, particularly in cancer research, drug development, and developmental biology. These are usually tedious and time-consuming tasks that are…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Rüveyda Yilmaz , Dennis Eschweiler , Johannes Stegmaier

Controlling memorization in diffusion models is critical for applications that require generated data to closely match the training distribution. Existing approaches mainly focus on data centric or model centric modifications, treating the…

Machine Learning · Computer Science 2026-01-30 Thuy Phuong Vu , Mai Viet Hoang Do , Minhhuy Le , Dinh-Cuong Hoang , Phan Xuan Tan

With the rapid growth of video data on the internet, video summarization is becoming a very important AI technology. However, due to the high labelling cost of video summarization, existing studies have to be conducted on small-scale…

Multimedia · Computer Science 2026-01-13 Cairong Zhao , Chutian Wang , Zifan Song , Guosheng Hu , Haonan Chen , Xiaofan Zhai

We propose a novel supervised learning technique for summarizing videos by automatically selecting keyframes or key subshots. Casting the problem as a structured prediction problem on sequential data, our main idea is to use Long Short-Term…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a…

Image and Video Processing · Electrical Eng. & Systems 2022-09-15 Kuang Gong , Keith A. Johnson , Georges El Fakhri , Quanzheng Li , Tinsu Pan

Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative deep learning models that have been very successful at image generation, and, very recently, in path planning and control. In this paper, we investigate how to…

Robotics · Computer Science 2024-11-18 Michiel Nikken , Nicolò Botteghi , Wesley Roozing , Federico Califano

The gradual nature of a diffusion process that synthesizes samples in small increments constitutes a key ingredient of Denoising Diffusion Probabilistic Models (DDPM), which have presented unprecedented quality in image synthesis and been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zihan Zhang , Richard Liu , Kfir Aberman , Rana Hanocka