English
Related papers

Related papers: Training-Free Condition Video Diffusion Models for…

200 papers

This work introduces a new latent diffusion model to generate high-quality 3D chest CT scans conditioned on 3D anatomical masks. The method synthesizes volumetric images of size 256x256x256 at 1 mm isotropic resolution using a single…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Anna Oliveras , Roger Marí , Rafael Redondo , Oriol Guardià , Ana Tost , Bhalaji Nagarajan , Carolina Migliorelli , Vicent Ribas , Petia Radeva

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

When editing a video, a piece of attractive background music is indispensable. However, video background music generation tasks face several challenges, for example, the lack of suitable training datasets, and the difficulties in flexibly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Sizhe Li , Yiming Qin , Minghang Zheng , Xin Jin , Yang Liu

Segmentation models such as Segment Anything Model (SAM) and SAM2 achieve strong prompt-driven zero-shot performance. However, their training on natural images limits domain transfer to medical data. Consequently, accurate segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Tal Grossman , Noa Cahan , Lev Ayzenberg , Hayit Greenspan

GenerateCT, the first approach to generating 3D medical imaging conditioned on free-form medical text prompts, incorporates a text encoder and three key components: a novel causal vision transformer for encoding 3D CT volumes, a text-image…

In the past decade, deep conditional generative models have revolutionized the generation of realistic images, extending their application from entertainment to scientific domains. Single-particle cryo-electron microscopy (cryo-EM) is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jiakai Zhang , Qihe Chen , Yan Zeng , Wenyuan Gao , Xuming He , Zhijie Liu , Jingyi Yu

Continuous Conditional Generative Modeling (CCGM) estimates high-dimensional data distributions, such as images, conditioned on scalar continuous variables (aka regression labels). While Continuous Conditional Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xin Ding , Yongwei Wang , Kao Zhang , Z. Jane Wang

Noise and artifacts during computed tomography (CT) scans are a fundamental challenge affecting disease diagnosis. However, current methods either involve excessively long reconstruction times or rely on data-driven models for optimization,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Guoquan Wei , Liu Shi , Shaoyu Wang , Mohan Li , Cunfeng Wei , Qiegen Liu

Cardiac ultrasound imaging is used to diagnose various heart diseases. Common analysis pipelines involve manual processing of the video frames by expert clinicians. This suffers from intra- and inter-observer variability. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Hadrien Reynaud , Athanasios Vlontzos , Benjamin Hou , Arian Beqiri , Paul Leeson , Bernhard Kainz

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

Current sampling mechanisms for conditional diffusion models rely mainly on Classifier Free Guidance (CFG) to generate high-quality images. However, CFG requires several denoising passes in each time step, e.g., up to three passes in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mehdi Noroozi , Alberto Gil Ramos , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Abhinav Mehrotra , Sourav Bhattacharya

This study explores the potential of open-source video conditional generation models as encoders for downstream tasks, focusing on instance segmentation using the BAIR Robot Pushing Dataset. The researchers propose using video prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 James Maier , Nishanth Mohankumar

Controlling the spatial and semantic structure of diffusion-generated images remains a challenge. Existing methods like ControlNet rely on handcrafted condition maps and retraining, limiting flexibility and generalization. Inversion-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Jiang Lin , Xinyu Chen , Song Wu , Zhiqiu Zhang , Jizhi Zhang , Ye Wang , Qiang Tang , Qian Wang , Jian Yang , Zili Yi

Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient ODE-based sampling without relying on stochastic diffusion processes. While generative modeling has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhi Chen , Runze Hu , Le Zhang

Existed echocardiography segmentation methods often suffer from anatomical inconsistency challenge caused by shape variation, partial observation and region ambiguity with similar intensity across 2D echocardiographic sequences, resulting…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhihua Liu , Lei Tong , Xilin He , Che Liu , Rossella Arcucci , Chen Jin , Huiyu Zhou

As a pragmatic data augmentation tool, data synthesis has generally returned dividends in performance for deep learning based medical image analysis. However, generating corresponding segmentation masks for synthetic medical images is…

Image and Video Processing · Electrical Eng. & Systems 2023-03-23 Xiaodan Xing , Giorgos Papanastasiou , Simon Walsh , Guang Yang

We introduce segmentation-free guidance, a novel method designed for text-to-image diffusion models like Stable Diffusion. Our method does not require retraining of the diffusion model. At no additional compute cost, it uses the diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Kambiz Azarian , Debasmit Das , Qiqi Hou , Fatih Porikli

Video diffusion models have made substantial progress in various video generation applications. However, training models for long video generation tasks require significant computational and data resources, posing a challenge to developing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yu Lu , Yuanzhi Liang , Linchao Zhu , Yi Yang

Chest X-ray report generation (CXR-RG) has the potential to substantially alleviate radiologists' workload. However, conventional autoregressive vision--language models (VLMs) suffer from high inference latency due to sequential token…

Machine Learning · Computer Science 2026-05-19 Lifeng Chen , Tianqi You , Hao Liu , Zhimin Bao , Jile Jiao , Xiao Han , Zhicai Ou , Tao Sun , Xiaofeng Mou , Xiaojie Jin , Yi Xu

Domain adaptation methods aim to bridge the gap between datasets by enabling knowledge transfer across domains, reducing the need for additional expert annotations. However, many approaches struggle with reliability in the target domain, an…

Image and Video Processing · Electrical Eng. & Systems 2026-05-14 Arnaud Judge , Nicolas Duchateau , Thierry Judge , Roman A. Sandler , Joseph Z. Sokol , Christian Desrosiers , Olivier Bernard , Pierre-Marc Jodoin