English
Related papers

Related papers: Physics Informed Distillation for Diffusion Models

200 papers

Physics-informed neural networks (PINNs) have emerged as a promising approach to solving partial differential equations (PDEs) using neural networks, particularly in data-scarce scenarios, due to their unsupervised training capability.…

Machine Learning · Computer Science 2025-03-25 Edgar Torres , Jonathan Schiefer , Mathias Niepert

With the increases in computational power and advances in machine learning, data-driven learning-based methods have gained significant attention in solving PDEs. Physics-informed neural networks (PINNs) have recently emerged and succeeded…

Machine Learning · Computer Science 2023-02-07 Namgyu Kang , Byeonghyeon Lee , Youngjoon Hong , Seok-Bae Yun , Eunbyung Park

Abstract Diffusion models have recently gained prominence as a novel category of generative models. Despite their success, these models face a notable drawback in terms of slow sampling speeds, requiring a high number of function…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sanghwan Kim , Hao Tang , Fisher Yu

Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional…

The transformative impact of machine learning, particularly Deep Learning (DL), on scientific and engineering domains is evident. In the context of computational fluid dynamics (CFD), Physics-Informed Neural Networks (PINNs) represent a…

Fluid Dynamics · Physics 2024-04-05 Siddharth Raghu , Rajdip Nayek , Vamsi Chalamalla

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang

Physics-informed neural networks (PINNs) are an emerging technique to solve partial differential equations (PDEs). In this work, we propose a simple but effective PINN approach for the phase-field model of ferroelectric microstructure…

Materials Science · Physics 2024-09-06 Lan Shang , Sizheng Zheng , Jin Wang , Jie Wang

This work introduces Variational Diffusion Distillation (VDD), a novel method that distills denoising diffusion policies into Mixtures of Experts (MoE) through variational inference. Diffusion Models are the current state-of-the-art in…

Machine Learning · Computer Science 2024-10-22 Hongyi Zhou , Denis Blessing , Ge Li , Onur Celik , Xiaogang Jia , Gerhard Neumann , Rudolf Lioutikov

Knowledge distillation methods have recently shown to be a promising direction to speedup the synthesis of large-scale diffusion models by requiring only a few inference steps. While several powerful distillation methods were recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Nikita Starodubcev , Artem Fedorov , Artem Babenko , Dmitry Baranchuk

In this study, we present and validate the predictive capability of the Physics-Informed Neural Networks (PINNs) methodology for solving a variety of engineering and biological dynamical systems governed by ordinary differential equations…

Machine Learning · Computer Science 2025-11-19 Tyrus Whitman , Andrew Particka , Christopher Diers , Ian Griffin , Charuka Wickramasinghe , Pradeep Ranaweera

Differential equations are indispensable to engineering and hence to innovation. In recent years, physics-informed neural networks (PINN) have emerged as a novel method for solving differential equations. PINN method has the advantage of…

Computational Engineering, Finance, and Science · Computer Science 2022-01-07 Mayank Raj , Pramod Kumbhar , Ratna Kumar Annabattula

Physics-informed neural networks (PINNs) constitute a flexible deep learning approach for solving partial differential equations (PDEs), which model phenomena ranging from heat conduction to quantum mechanical systems. Despite their…

Machine Learning · Computer Science 2026-03-17 Aleksander Krasowski , René P. Klausen , Aycan Celik , Sebastian Lapuschkin , Wojciech Samek , Jonas Naujoks

Physics-Informed Neural Network (PINN) is a novel multi-task learning framework useful for solving physical problems modeled using differential equations (DEs) by integrating the knowledge of physics and known constraints into the…

Machine Learning · Computer Science 2024-09-18 Shivprasad Kathane , Shyamprasad Karagadde

Diffusion models generate high-quality images through progressive denoising but are computationally intensive due to large model sizes and repeated sampling. Knowledge distillation, which transfers knowledge from a complex teacher to a…

Machine Learning · Computer Science 2025-04-04 Dohyun Kim , Sehwan Park , Geonhee Han , Seung Wook Kim , Paul Hongsuck Seo

Physics-informed neural networks (PINNs) offer a powerful framework for seismic wavefield modeling, yet they typically require time-consuming retraining when applied to different velocity models. Moreover, their training can suffer from…

Geophysics · Physics 2025-06-03 Shijun Cheng , Tariq Alkhalifah

Physics-Informed Neural Networks (PINNs) offer a promising approach to solving differential equations and, more generally, to applying deep learning to problems in the physical sciences. We adopt a recently developed transfer learning…

Machine Learning · Computer Science 2022-11-02 Raphaël Pellegrin , Blake Bullwinkel , Marios Mattheakis , Pavlos Protopapas

Text-to-image diffusion models have made significant progress in generating naturalistic images from textual inputs, and demonstrate the capacity to learn and represent complex visual-semantic relationships. While these diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Rushikesh Zawar , Shaurya Dewan , Prakanshul Saxena , Yingshan Chang , Andrew Luo , Yonatan Bisk

Physics-Informed machine learning models have recently emerged with some interesting and unique features that can be applied to reservoir engineering. In particular, physics-informed neural networks (PINN) leverage the fact that neural…

Fluid Dynamics · Physics 2023-12-01 Daniel Badawi , Eduardo Gildin

Physics-informed neural networks (PINNs) are effective in solving integer-order partial differential equations (PDEs) based on scattered and noisy data. PINNs employ standard feedforward neural networks (NNs) with the PDEs explicitly…

Computational Physics · Physics 2021-11-03 Guofei Pang , Lu Lu , George Em Karniadakis

In this study, we explore the application of Physics-Informed Neural Networks (PINNs) to the analysis of bifurcation phenomena in ecological migration models. By integrating the fundamental principles of diffusion-advection-reaction…

Chaotic Dynamics · Physics 2025-11-25 Lujie Yin , Xing Lv