English
Related papers

Related papers: Physics Informed Distillation for Diffusion Models

200 papers

Recent advancements in timestep-distilled diffusion models have enabled high-quality image generation that rivals non-distilled multi-step models, but with significantly fewer inference steps. While such models are attractive for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Zichen Miao , Zhengyuan Yang , Kevin Lin , Ze Wang , Zicheng Liu , Lijuan Wang , Qiang Qiu

Physics-informed neural networks (PINNs) have garnered significant interest for their potential in solving partial differential equations (PDEs) that govern a wide range of physical phenomena. By incorporating physical laws into the…

Machine Learning · Computer Science 2026-04-24 Jian Cheng Wong , Isaac Yin Chung Lai , Pao-Hsiung Chiu , Chin Chun Ooi , Abhishek Gupta , Yew-Soon Ong

In this study, we utilize the emerging Physics Informed Neural Networks (PINNs) approach for the first time to predict the flow field of a compressor cascade. Different from conventional training methods, a new adaptive learning strategy…

Machine Learning · Computer Science 2024-05-08 Zhihui Li , Francesco Montomoli , Sanjiv Sharma

In many science and engineering settings, system dynamics are characterized by governing PDEs, and a major challenge is to solve inverse problems (IPs) where unknown PDE parameters are inferred based on observational data gathered under…

Machine Learning · Computer Science 2025-03-11 Apivich Hemachandra , Gregory Kang Ruey Lau , See-Kiong Ng , Bryan Kian Hsiang Low

Physics Informed Neural Network (PINN) is a scientific computing framework used to solve both forward and inverse problems modeled by Partial Differential Equations (PDEs). This paper introduces IDRLnet, a Python toolbox for modeling and…

Machine Learning · Computer Science 2021-07-12 Wei Peng , Jun Zhang , Weien Zhou , Xiaoyu Zhao , Wen Yao , Xiaoqian Chen

Channel modeling is fundamental in advancing wireless systems and has thus attracted considerable research focus. Recent trends have seen a growing reliance on data-driven techniques to facilitate the modeling process and yield accurate…

Information Theory · Computer Science 2024-01-03 Ethan Zhu , Haijian Sun , Mingyue Ji

Approximating solutions to partial differential equations (PDEs) is fundamental for the modeling of dynamical systems in science and engineering. Physics-informed neural networks (PINNs) are a recent machine learning-based approach, for…

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Physics-Informed Neural Networks (PINNs), which integrate deep learning with physical prior knowledge, have proven to be a powerful tool for studying the dynamics of high-dimensional nonlinear systems. The present work utilizes PINNs to…

Quantum Gases · Physics 2026-02-05 Dongshuai Liu , Boris A. Malomed , Wen Zhang

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

Machine Learning · Computer Science 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu

Diffusion Models (DMs), also referred to as score-based diffusion models, utilize neural networks to specify score functions. Unlike most other probabilistic models, DMs directly model the score functions, which makes them more flexible to…

Machine Learning · Computer Science 2023-04-11 Weijian Luo

In many scientific and engineering (e.g., physical, biochemical, medical) practices, data generated through expensive experiments or large-scale simulations, are often sparse and noisy. Physics-informed neural network (PINN) incorporates…

Machine Learning · Computer Science 2025-10-21 Kai-liang Lu

Partial differential equations (PDEs) are widely used to describe relevant phenomena in dynamical systems. In real-world applications, we commonly need to combine formal PDE models with (potentially noisy) observations. This is especially…

Machine Learning · Computer Science 2024-07-08 Monika Nagy-Huber , Volker Roth

Diffusion Probabilistic Models (DPMs) have emerged as a powerful class of deep generative models, achieving remarkable performance in image synthesis tasks. However, these models face challenges in terms of widespread adoption due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Kidist Amde Mekonnen , Nicola Dall'Asen , Paolo Rota

Significant advancements in image generation have been made with diffusion models. Nevertheless, when contrasted with previous generative models, diffusion models face substantial computational overhead, leading to failure in real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Linfeng Zhang , Kaisheng Ma

Deep learning has achieved remarkable success in diverse applications; however, its use in solving partial differential equations (PDEs) has emerged only recently. Here, we present an overview of physics-informed neural networks (PINNs),…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Xuhui Meng , Zhiping Mao , George E. Karniadakis

As an emerging technology in deep learning, physics-informed neural networks (PINNs) have been widely used to solve various partial differential equations (PDEs) in engineering. However, PDEs based on practical considerations contain…

Machine Learning · Computer Science 2021-11-11 Yuhao Huang

Diffusion models have demonstrated excellent potential for generating diverse images. However, their performance often suffers from slow generation due to iterative denoising. Knowledge distillation has been recently proposed as a remedy…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Lingjie Liu , Josh Susskind

The application of diffusion models in 3D LiDAR scene completion is limited due to diffusion's slow sampling speed. Score distillation accelerates diffusion sampling but with performance degradation, while post-training with direct policy…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 An Zhao , Shengyuan Zhang , Ling Yang , Zejian Li , Jiale Wu , Haoran Xu , AnYang Wei , Perry Pengyun GU , Lingyun Sun

Diffusion models have achieved state-of-the-art results in generative modelling but remain computationally intensive at inference time, often requiring thousands of discretization steps. To this end, we propose Sig-DEG (Signature-based…

Machine Learning · Computer Science 2025-08-26 Lei Jiang , Wen Ge , Niels Cariou-Kotlarek , Mingxuan Yi , Po-Yu Chen , Lingyi Yang , Francois Buet-Golfouse , Gaurav Mittal , Hao Ni