English
Related papers

Related papers: ColoDiff: Integrating Dynamic Consistency With Con…

200 papers

Colonic polyps are well-recognized precursors to colorectal cancer (CRC), typically detected during colonoscopy. However, the variability in appearance, location, and size of these polyps complicates their detection and removal, leading to…

Generating temporally coherent high fidelity video is an important milestone in generative modeling research. We make progress towards this milestone by proposing a diffusion model for video generation that shows very promising initial…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jonathan Ho , Tim Salimans , Alexey Gritsenko , William Chan , Mohammad Norouzi , David J. Fleet

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Early detection, accurate segmentation, classification and tracking of polyps during colonoscopy are critical for preventing colorectal cancer. Many existing deep-learning-based methods for analyzing colonoscopic videos either require…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anwesa Choudhuri , Zhongpai Gao , Meng Zheng , Benjamin Planche , Terrence Chen , Ziyan Wu

Diffusion models deliver high-fidelity synthesis but remain slow due to iterative sampling. We empirically observe there exists feature invariance in deterministic sampling, and present InvarDiff, a training-free acceleration method that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Zihao Wu

High-quality video generation is crucial for many fields, including the film industry and autonomous driving. However, generating videos with spatiotemporal consistencies remains challenging. Current methods typically utilize attention…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haotian Dong , Xin Wang , Di Lin , Yipeng Wu , Qin Chen , Ruonan Liu , Kairui Yang , Ping Li , Qing Guo

We introduce the Joint Video-Image Diffusion model (JVID), a novel approach to generating high-quality and temporally coherent videos. We achieve this by integrating two diffusion models: a Latent Image Diffusion Model (LIDM) trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Hadrien Reynaud , Matthew Baugh , Mischa Dombrowski , Sarah Cechnicka , Qingjie Meng , Bernhard Kainz

Colonoscopy is the most widely used medical technique for preventing Colorectal Cancer, by detecting and removing polyps before they become malignant. Recent studies show that around one quarter of the existing polyps are routinely missed.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 G. Leifman , I. Kligvasser , R. Goldenberg , M. Elad , E. Rivlin

Colonoscopy is a standard imaging tool for visualizing the entire gastrointestinal (GI) tract of patients to capture lesion areas. However, it takes the clinicians excessive time to review a large number of images extracted from colonoscopy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Kaiwei Che , Chengwei Ye , Yibing Yao , Nachuan Ma , Ruo Zhang , Jiankun Wang , Max Q. -H. Meng

Purpose: To propose a domain-conditioned and temporal-guided diffusion modeling method, termed dynamic Diffusion Modeling (dDiMo), for accelerated dynamic MRI reconstruction, enabling diffusion process to characterize spatiotemporal…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Liping Zhang , Iris Yuwen Zhou , Sydney B. Montesi , Li Feng , Fang Liu

Creating high-fidelity, coherent long videos is a sought-after aspiration. While recent video diffusion models have shown promising potential, they still grapple with spatiotemporal inconsistencies and high computational resource demands.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Yongjia Ma , Junlin Chen , Donglin Di , Qi Xie , Lei Fan , Wei Chen , Xiaofei Gou , Na Zhao , Xun Yang

Echocardiography is widely used for assessing cardiac function, where clinically meaningful parameters such as left-ventricular ejection fraction (EF) play a central role in diagnosis and management. Generative models capable of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Emmanuel Oladokun , Sarina Thomas , Jurica Šprem , Vicente Grau

The progression of Idiopathic Pulmonary Fibrosis (IPF) significantly correlates with higher patient mortality rates. Early detection of IPF progression is critical for initiating timely treatment, which can effectively slow down the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Caiwen Jiang , Xiaodan Xing , Zaixin Ou , Mianxin Liu , Walsh Simon , Guang Yang , Dinggang Shen

Dense video captioning (DVC) aims to generate multi-sentence descriptions to elucidate the multiple events in the video, which is challenging and demands visual consistency, discoursal coherence, and linguistic diversity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Xu Yan , Zhengcong Fei , Shuhui Wang , Qingming Huang , Qi Tian

Video generation aims to produce temporally coherent sequences of visual frames, representing a pivotal advancement in Artificial Intelligence Generated Content (AIGC). Compared to static image generation, video generation poses unique…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zhiyu Yin , Kehai Chen , Xuefeng Bai , Ruili Jiang , Juntao Li , Hongdong Li , Jin Liu , Yang Xiang , Jun Yu , Min Zhang

Text-guided generative diffusion models unlock powerful image creation and editing tools. While these have been extended to video generation, current approaches that edit the content of existing footage while retaining structure require…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Patrick Esser , Johnathan Chiu , Parmida Atighehchian , Jonathan Granskog , Anastasis Germanidis

When hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Conventional…

Graphics · Computer Science 2023-08-08 Qiaosong Qi , Le Zhuo , Aixi Zhang , Yue Liao , Fei Fang , Si Liu , Shuicheng Yan

Predicting molecular conformations from molecular graphs is a fundamental problem in cheminformatics and drug discovery. Recently, significant progress has been achieved with machine learning approaches, especially with deep generative…

Machine Learning · Computer Science 2022-03-16 Minkai Xu , Lantao Yu , Yang Song , Chence Shi , Stefano Ermon , Jian Tang

The rising prevalence of vision-threatening retinal diseases poses a significant burden on the global healthcare systems. Deep learning (DL) offers a promising solution for automatic disease screening but demands substantial data.…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Ruoyu Chen , Weiyi Zhang , Bowen Liu , Xiaolan Chen , Pusheng Xu , Shunming Liu , Mingguang He , Danli Shi

Learning robust representations of polyp tracklets is key to enabling multiple AI-assisted colonoscopy applications, from polyp characterization to automated reporting and retrieval. Supervised contrastive learning is an effective approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Luca Parolari , Pietro Gori , Lamberto Ballan , Carlo Biffi , Loic Le Folgoc