English
Related papers

Related papers: Physics Informed Distillation for Diffusion Models

200 papers

Training-time privileged information (PI) can enable language models to succeed on tasks they would otherwise fail, making it a powerful tool for reinforcement learning in hard, long-horizon settings. However, transferring capabilities…

Machine Learning · Computer Science 2026-02-17 Emiliano Penaloza , Dheeraj Vattikonda , Nicolas Gontier , Alexandre Lacoste , Laurent Charlin , Massimo Caccia

Denoising Diffusion models have exhibited remarkable capabilities in image generation. However, generating high-quality samples requires a large number of iterations. Knowledge distillation for diffusion models is an effective method to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Shengzhe Zhou , Zejian Lee , Shengyuan Zhang , Lefan Hou , Changyuan Yang , Guang Yang , Zhiyuan Yang , Lingyun Sun

We study the problem of learning neural network models for Ordinary Differential Equations (ODEs) with parametric uncertainties. Such neural network models capture the solution to the ODE over a given set of parameters, initial conditions,…

Machine Learning · Computer Science 2025-07-31 Chandra Kanth Nagesh , Sriram Sankaranarayanan , Ramneet Kaur , Tuhin Sahai , Susmit Jha

Physics-informed neural networks (PINNs) have been popularized as a deep learning framework that can seamlessly synthesize observational data and partial differential equation (PDE) constraints. Their practical effectiveness however can be…

Machine Learning · Computer Science 2023-08-17 Sifan Wang , Shyam Sankaran , Hanwen Wang , Paris Perdikaris

Physics-informed Neural Networks (PINNs) have been shown as a promising approach for solving both forward and inverse problems of partial differential equations (PDEs). Meanwhile, the neural operator approach, including methods such as Deep…

Machine Learning · Computer Science 2023-10-31 Bin Lin , Zhiping Mao , Zhicheng Wang , George Em Karniadakis

Diffusion models have demonstrated strong generative capabilities across scientific domains, but often produce outputs that violate physical laws. We propose a new perspective by framing physics-informed generation as a sparse reward…

Machine Learning · Computer Science 2025-09-26 Mingze Yuan , Pengfei Jin , Na Li , Quanzheng Li

In recent engineering applications using deep learning, physics-informed neural network (PINN) is a new development as it can exploit the underlying physics of engineering systems. The novelty of PINN lies in the use of partial differential…

Computational Engineering, Finance, and Science · Computer Science 2026-02-26 Kart Leong Lim , Rahul Dutta , Mihai Rotaru

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

Machine Learning · Computer Science 2022-06-08 Tim Salimans , Jonathan Ho

Physics-informed neural networks (PINNs) [31] use automatic differentiation to solve partial differential equations (PDEs) by penalizing the PDE in the loss function at a random set of points in the domain of interest. Here, we develop a…

Neural and Evolutionary Computing · Computer Science 2019-12-03 E. Kharazmi , Z. Zhang , G. E. Karniadakis

Given the facts of the extensiveness of multi-material diffusion problems and the inability of the standard PINN(Physics-Informed Neural Networks) method for such problems, in this paper we present a novel PINN method that can accurately…

Numerical Analysis · Mathematics 2023-09-28 Yanzhong Yao , Jiawei Guo , Tongxiang Gu

The physics informed neural network (PINN) is evolving as a viable method to solve partial differential equations. In the recent past PINNs have been successfully tested and validated to find solutions to both linear and non-linear partial…

Machine Learning · Computer Science 2024-03-28 Vikas Dwivedi , Nishant Parashar , Balaji Srinivasan

Physics-informed neural networks (PINNs) have made significant strides in modeling dynamical systems governed by partial differential equations (PDEs). However, their generalization capabilities across varying scenarios remain limited. To…

Machine Learning · Computer Science 2024-12-02 Honghui Wang , Yifan Pu , Shiji Song , Gao Huang

Diffusion distillation models effectively accelerate reverse sampling by compressing the process into fewer steps. However, these models still exhibit a performance gap compared to their pre-trained diffusion model counterparts, exacerbated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Geon Yeong Park , Sang Wan Lee , Jong Chul Ye

Digital twin technology, when combined with physics-informed machine learning with simulation results of Aspen, offers transformative capabilities for industrial process monitoring, control, and optimization. In this work, the proposed…

Machine Learning · Computer Science 2026-03-27 Debadutta Patra , Ayush Bardhan Tripathy , Soumya Ranjan Sahu , Sucheta Panda

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

In this paper, we review the new method Physics-Informed Neural Networks (PINNs) that has become the main pillar in scientific machine learning, we present recent practical extensions, and provide a specific example in data-driven discovery…

Machine Learning · Computer Science 2024-09-02 Maziar Raissi , Paris Perdikaris , Nazanin Ahmadi , George Em Karniadakis

Recently, physics-informed neural networks (PINNs) have emerged as a flexible and promising application of deep learning to partial differential equations in the physical sciences. While offering strong performance and competitive inference…

In chemical engineering, process data are expensive to acquire, and complex phenomena are difficult to fully model. We explore the use of physics-informed neural networks (PINNs) for modeling dynamic processes with incomplete mechanistic…

Machine Learning · Computer Science 2024-10-01 Mehmet Velioglu , Song Zhai , Sophia Rupprecht , Alexander Mitsos , Andreas Jupke , Manuel Dahmen

This paper puts forward the vision of creating a library of neural-network-based models for power system simulations. Traditional numerical solvers struggle with the growing complexity of modern power systems, necessitating faster and more…

Systems and Control · Electrical Eng. & Systems 2025-02-11 Ioannis Karampinis , Petros Ellinas , Ignasi Ventura Nadal , Rahul Nellikkath , Spyros Chatzivasileiadis

We introduce PINGS (Physics-Informed Neural Network for Fast Generative Sampling), a framework that amortizes diffusion sampling by training a physics-informed network to approximate reverse-time probability-flow dynamics, reducing sampling…