English
Related papers

Related papers: Consistency Training with Physical Constraints

200 papers

We present a framework for fine-tuning flow-matching generative models to enforce physical constraints and solve inverse problems in scientific systems. Starting from a model trained on low-fidelity or observational data, we apply a…

Machine Learning · Computer Science 2026-01-28 Jan Tauberschmidt , Sophie Fellenz , Sebastian J. Vollmer , Andrew B. Duncan

Conditional diffusion models are powerful generative models that can leverage various types of conditional information, such as class labels, segmentation masks, or text captions. However, in many real-world scenarios, conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Nicolas Dufour , Victor Besnier , Vicky Kalogeiton , David Picard

Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Consistency Trajectory…

Diffusion models have emerged as powerful tools for generative tasks, producing high-quality outputs across diverse domains. However, how the generated data responds to the initial noise perturbation in diffusion models remains…

Machine Learning · Computer Science 2025-02-10 Bowen Song , Zecheng Zhang , Zhaoxu Luo , Jason Hu , Wei Yuan , Jing Jia , Zhengxu Tang , Guanyang Wang , Liyue Shen

Objective: Cone-beam computed tomography (CBCT) provides a low-dose imaging alternative to conventional CT, but suffers from noise, scatter, and artifacts that degrade image quality. Synthetic CT (sCT) aims to translate CBCT to high-quality…

Medical Physics · Physics 2025-09-23 Alzahra Altalib , Chunhui Li , Alessandro Perelli

Diffusion models accomplish remarkable success in data generation tasks across various domains. However, the iterative sampling process is computationally expensive. Consistency models are proposed to learn consistency functions to map from…

Machine Learning · Computer Science 2025-05-07 Yiding Chen , Yiyi Zhang , Owen Oertell , Wen Sun

Discrete diffusion models are a class of generative models that construct sequences by progressively denoising samples from a categorical noise distribution. Beyond their rapidly growing ability to generate coherent natural language, these…

Computation and Language · Computer Science 2025-12-11 Michael Cardei , Jacob K Christopher , Thomas Hartvigsen , Bhavya Kailkhura , Ferdinando Fioretto

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

Consistency Models (CMs) have shown promise for efficient one-step generation. However, most existing CMs rely on manually designed discretization schemes, which can cause repeated adjustments for different noise schedules and datasets. To…

Machine Learning · Computer Science 2025-10-21 Jiayu Bai , Zhanbo Feng , Zhijie Deng , Tianqi Hou , Robert C. Qiu , Zenan Ling

Improving the spatial resolution of CT images is a meaningful yet challenging task, often accompanied by the issue of noise amplification. This article introduces an innovative framework for noise-controlled CT super-resolution utilizing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuang Wang , Siyeop Yoon , Rui Hu , Baihui Yu , Duhgoon Lee , Rajiv Gupta , Li Zhang , Zhiqiang Chen , Dufan Wu

The Poisson Flow Consistency Model (PFCM) is a consistency-style model based on the robust Poisson Flow Generative Model++ (PFGM++) which has achieved success in unconditional image generation and CT image denoising. Yet the PFCM can only…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Anthony Zhang , Mahmut Gokmen , Dennis Hein , Rongjun Ge , Wenjun Xia , Ge Wang , Jin Chen

Neural Text-to-Speech (TTS) systems find broad applications in voice assistants, e-learning, and audiobook creation. The pursuit of modern models, like Diffusion Models (DMs), holds promise for achieving high-fidelity, real-time speech…

Sound · Computer Science 2024-04-02 Xiang Li , Fan Bu , Ambuj Mehrish , Yingting Li , Jiale Han , Bo Cheng , Soujanya Poria

Diffusion models have revolutionized various application domains, including computer vision and audio generation. Despite the state-of-the-art performance, diffusion models are known for their slow sample generation due to the extensive…

Machine Learning · Computer Science 2024-06-25 Zehao Dou , Minshuo Chen , Mengdi Wang , Zhuoran Yang

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achieving results on par…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Quan Dao , Khanh Doan , Di Liu , Trung Le , Dimitris Metaxas

Flow map models such as Consistency Models (CM) and Mean Flow (MF) enable few-step generation by learning the long jump of the ODE solution of diffusion models, yet training remains unstable, sensitive to hyperparameters, and costly.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Zheyuan Hu , Chieh-Hsin Lai , Yuki Mitsufuji , Stefano Ermon

Surrogate modeling for complex physical systems typically faces a trade-off between data-fitting accuracy and physical consistency. Physics-consistent approaches typically treat physical laws as soft constraints within the loss function, a…

Machine Learning · Computer Science 2026-01-30 José Afonso , Pedro Viegas , Rodrigo Ventura , Vasco Guerra

With diffusion and flow matching models achieving state-of-the-art generating performance, the interest of the community now turned to reducing the inference time without sacrificing sample quality. Consistency Models (CMs), which are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Beomsu Kim , Byunghee Cha , Jong Chul Ye

Advances in robot learning have enabled robots to generate skills for a variety of tasks. Yet, robot learning is typically sample inefficient, struggles to learn from data sources exhibiting varied behaviors, and does not naturally…

Recent research has focused on designing neural samplers that amortize the process of sampling from unnormalized densities. However, despite significant advancements, they still fall short of the state-of-the-art MCMC approach, Parallel…

Diffusion models for multi-agent trajectory prediction are limited by iterative denoising, which causes inference latency that hinders their use in time-critical settings like autonomous driving. Fast-sampling variants using DDIM and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Alen Mrdovic , Qingze , Liu , Danrui Li , Mathew Schwartz , Kaidong Hu , Sejong Yoon , Mubbasir Kapadia , Vladimir Pavlovic