English
Related papers

Related papers: Annotated Biomedical Video Generation using Denois…

200 papers

Modeling disease progression is crucial for improving the quality and efficacy of clinical diagnosis and prognosis, but it is often hindered by a lack of longitudinal medical image monitoring for individual patients. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Xu Cao , Kaizhao Liang , Kuei-Da Liao , Tianren Gao , Wenqian Ye , Jintai Chen , Zhiguang Ding , Jianguo Cao , James M. Rehg , Jimeng Sun

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

Segmenting objects in videos is a fundamental computer vision task. The current deep learning based paradigm offers a powerful, but data-hungry solution. However, current datasets are limited by the cost and human effort of annotating…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Bin Zhao , Goutam Bhat , Martin Danelljan , Luc Van Gool , Radu Timofte

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Computational fluid dynamics (CFD) is a powerful tool for modeling turbulent flow and is commonly used for urban microclimate simulations. However, traditional CFD methods are computationally intensive, requiring substantial hardware…

Machine learning tasks involving biomedical signals frequently grapple with issues such as limited data availability, imbalanced datasets, labeling complexities, and the interference of measurement noise. These challenges often hinder the…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Xiaomin Li , Mykhailo Sakevych , Gentry Atkinson , Vangelis Metsis

Vision algorithms capable of interpreting scenes from a real-time video stream are necessary for computer-assisted surgery systems to achieve context-aware behavior. In laparoscopic procedures one particular algorithm needed for such…

Machine Learning · Computer Science 2020-10-01 Tong Yu , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Inspired by the remarkable success of Latent Diffusion Models (LDMs) for image synthesis, we study LDM for text-to-video generation, which is a formidable challenge due to the computational and memory constraints during both model training…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jiaxi Gu , Shicong Wang , Haoyu Zhao , Tianyi Lu , Xing Zhang , Zuxuan Wu , Songcen Xu , Wei Zhang , Yu-Gang Jiang , Hang Xu

Vessel dynamics simulation is vital in studying the relationship between geometry and vascular disease progression. Reliable dynamics simulation relies on high-quality vascular meshes. Most of the existing mesh generation methods highly…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Dengqiang Jia , Xinnian Yang , Xiaosong Xiong , Shijie Huang , Feiyu Hou , Li Qin , Kaicong Sun , Kannie Wai Yan Chan , Dinggang Shen

Deep learning and generative models are advancing rapidly, with synthetic data increasingly being integrated into training pipelines for downstream analysis tasks. However, in medical imaging, their adoption remains constrained by the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Kyeonghun Kim , Jaehyeok Bae , Youngung Han , Joo Young Bae , Seoyoung Ju , Junsu Lim , Gyeongmin Kim , Nam-Joon Kim , Woo Kyoung Jeong , Ken Ying-Kai Liao , Won Jae Lee , Pa Hong , Hyuk-Jae Lee

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

Computation and Language · Computer Science 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

Human organs constantly undergo anatomical changes due to a complex mix of short-term (e.g., heartbeat) and long-term (e.g., aging) factors. Evidently, prior knowledge of these factors will be beneficial when modeling their future state,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Jee Seok Yoon , Chenghao Zhang , Heung-Il Suk , Jia Guo , Xiaoxiao Li

Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a powerful family of generative models that can yield high-fidelity samples and competitive log-likelihoods across a range of domains, including image and speech synthesis.…

Machine Learning · Computer Science 2021-06-08 Daniel Watson , Jonathan Ho , Mohammad Norouzi , William Chan

Recent advances in Diffusion Probabilistic Models (DPMs) have set new standards in high-quality image synthesis. Yet, controlled generation remains challenging, particularly in sensitive areas such as medical imaging. Medical images feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sarah Cechnicka , Matthew Baugh , Weitong Zhang , Mischa Dombrowski , Zhe Li , Johannes C. Paetzold , Candice Roufosse , Bernhard Kainz

Denoising diffusion models (DDMs) have led to staggering performance leaps in image generation, editing and restoration. However, existing DDMs use very large datasets for training. Here, we introduce a framework for training a DDM on a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Vladimir Kulikov , Shahar Yadin , Matan Kleiner , Tomer Michaeli

Diffusion models have demonstrated significant potential in producing high-quality images in medical image translation to aid disease diagnosis, localization, and treatment. Nevertheless, current diffusion models have limited success in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yunxiang Li , Hua-Chieh Shao , Xiaoxue Qian , You Zhang

Training medical image segmentation models for rare yet clinically important imaging modalities is challenging due to the scarcity of annotated data, and manual mask annotations can be costly and labor-intensive to acquire. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Haoning Wu , Ziheng Zhao , Ya Zhang , Yanfeng Wang , Weidi Xie

Medical image segmentation suffers from data scarcity, particularly in polyp detection where annotation requires specialized expertise. We present SynDiff, a framework combining text-guided synthetic data generation with efficient…

Image and Video Processing · Electrical Eng. & Systems 2025-07-22 Muhammad Aqeel , Maham Nazir , Zanxi Ruan , Francesco Setti

The ability to quickly annotate medical imaging data plays a critical role in training deep learning frameworks for segmentation. Doing so for image volumes or video sequences is even more pressing as annotating these is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Laurent Lejeune , Raphael Sznitman

We present a unified network for simultaneously generating videos and their corresponding entity segmentation and depth maps from text prompts. We utilize colormap to represent entity masks and depth maps, tightly integrating dense…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Lehan Yang , Lu Qi , Xiangtai Li , Sheng Li , Varun Jampani , Ming-Hsuan Yang