English
Related papers

Related papers: Mollifier Layers: Enabling Efficient High-Order De…

200 papers

Neural Ordinary Differential Equations (ODEs) represent a significant advancement at the intersection of machine learning and dynamical systems, offering a continuous-time analog to discrete neural networks. Despite their promise, deploying…

Numerical Analysis · Mathematics 2025-06-18 Matteo Caldana , Jan S. Hesthaven

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

Estimating parameters of Partial Differential Equations (PDEs) is of interest in a number of applications such as geophysical and medical imaging. Parameter estimation is commonly phrased as a PDE-constrained optimization problem that can…

Numerical Analysis · Mathematics 2018-10-15 Samy Wu Fung , Lars Ruthotto

Neural differential equation models have garnered significant attention in recent years for their effectiveness in machine learning applications.Among these, fractional differential equations (FDEs) have emerged as a promising tool due to…

Machine Learning · Computer Science 2025-03-21 Wenjun Cui , Qiyu Kang , Xuhao Li , Kai Zhao , Wee Peng Tay , Weihua Deng , Yidong Li

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Machine learning (ML) models have emerged as a promising approach for solving partial differential equations (PDEs) in science and engineering. Previous ML models typically cannot generalize outside the training data; for example, a trained…

Machine Learning · Computer Science 2025-07-28 Zongyi Li , Samuel Lanthaler , Catherine Deng , Michael Chen , Yixuan Wang , Kamyar Azizzadenesheli , Anima Anandkumar

The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length and timescales. Often, it is computationally intractable to resolve the finest features…

Disordered Systems and Neural Networks · Physics 2019-08-22 Yohai Bar-Sinai , Stephan Hoyer , Jason Hickey , Michael P. Brenner

This work is concerned with discovering the governing partial differential equation (PDE) of a physical system. Existing methods have demonstrated the PDE identification from finite observations but failed to maintain satisfying results…

Numerical Analysis · Mathematics 2023-02-09 Pongpisit Thanasutives , Takashi Morita , Masayuki Numao , Ken-ichi Fukui

We propose a novel composite framework to find unknown fields in the context of inverse problems for partial differential equations (PDEs). We blend the high expressibility of deep neural networks as universal function estimators with the…

Numerical Analysis · Mathematics 2021-06-02 Samira Pakravan , Pouria A. Mistani , Miguel Angel Aragon-Calvo , Frederic Gibou

Solving partial differential equations (PDEs) efficiently is essential for analyzing complex physical systems. Recent advancements in leveraging deep learning for solving PDE have shown significant promise. However, machine learning…

Machine Learning · Computer Science 2024-02-16 Ruichen Li , Chuwei Wang , Haotian Ye , Di He , Liwei Wang

Deep learning-based methods have achieved encouraging performances in the field of magnetic resonance (MR) image reconstruction. Nevertheless, to properly learn a powerful and robust model, these methods generally require large quantities…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Ruoyou Wu , Cheng Li , Juan Zou , Qiegen Liu , Hairong Zheng , Shanshan Wang

We consider accelerating machine learning (ML) inference queries on unstructured datasets. Expensive operators such as feature extractors and classifiers are deployed as user-defined functions(UDFs), which are not penetrable with classic…

Databases · Computer Science 2022-01-04 Zhihui Yang , Zuozhi Wang , Yicong Huang , Yao Lu , Chen Li , X. Sean Wang

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

We introduce mollified Christoffel-Darboux (CD) kernels on varieties, a systematic regularization of the classical CD kernel associated with a probability measure on a compact domain. The main motivations are twofold: first, to sharpen the…

Optimization and Control · Mathematics 2026-03-11 Leandro Bentancur , Didier Henrion , Mauricio Velasco

We represent an algorithm allowing one to construct new classes of partially integrable multidimensional nonlinear partial differential equations (PDEs) starting with the special type of solutions to the (1+1)-dimensional hierarchy of…

Exactly Solvable and Integrable Systems · Physics 2015-05-13 A. I. Zenchuk

In this paper we show that our Machine Learning (ML) approach, CoMLSim (Composable Machine Learning Simulator), can simulate PDEs on highly-resolved grids with higher accuracy and generalization to out-of-distribution source terms and…

Machine Learning · Computer Science 2022-10-13 Rishikesh Ranade , Chris Hill , Lalit Ghule , Jay Pathak

Machine learning force fields (MLFFs) are gradually evolving towards enabling molecular dynamics simulations of molecules and materials with ab initio accuracy but at a small fraction of the computational cost. However, several challenges…

Diffusion models (DMs) excel in image generation but suffer from slow inference and training-inference discrepancies. Although gradient-based solvers for DMs accelerate denoising inference, they often lack theoretical foundations in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shigui Li , Wei Chen , Delu Zeng

The paper introduces a very simple and fast computation method for high-dimensional integrals to solve high-dimensional Kolmogorov partial differential equations (PDEs). The new machine learning-based method is obtained by solving a…

Numerical Analysis · Mathematics 2021-02-12 Riu Naito , Toshihiro Yamada

A rising research challenge is running costly machine learning (ML) networks locally on resource-constrained edge devices. ML networks with large convolutional layers can easily exceed available memory, increasing latency due to excessive…

Machine Learning · Computer Science 2023-07-20 Jackson Farley , Andreas Gerstlauer