English
Related papers

Related papers: Variational (Energy-Based) Spectral Learning: A Ma…

200 papers

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

We propose machine learning methods for solving fully nonlinear partial differential equations (PDEs) with convex Hamiltonian. Our algorithms are conducted in two steps. First the PDE is rewritten in its dual stochastic control…

Computational Finance · Quantitative Finance 2022-05-23 William Lefebvre , Grégoire Loeper , Huyên Pham

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Solving partial differential equations (PDEs) using an annealing-based approach involves solving generalized eigenvalue problems. Discretizing a PDE yields a system of linear equations (SLE). Solving an SLE can be formulated as a general…

Numerical Analysis · Mathematics 2026-05-11 Kazue Kudo

In this paper, we propose a novel variable-separation (NVS) method for generic multivariate functions. The idea of NVS is extended to to obtain the solution in tensor product structure for stochastic partial differential equations (SPDEs).…

Numerical Analysis · Mathematics 2016-11-15 Qiuqi Li , Lijian Jiang

Numerical solution of partial differential equations (PDEs) plays a vital role in various fields of science and engineering. In recent years, deep neural networks (DNNs) have emerged as a powerful tool for solving PDEs, leveraging their…

Numerical Analysis · Mathematics 2026-02-16 Shuo Ling , Wenjun Ying , Zhen Zhang

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

Variational Physics-Informed Neural Networks (VPINNs) utilize a variational loss function to solve partial differential equations, mirroring Finite Element Analysis techniques. Traditional hp-VPINNs, while effective for high-frequency…

Machine Learning · Computer Science 2024-04-19 Thivin Anandh , Divij Ghose , Himanshu Jain , Sashikumaar Ganesan

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni

Simulating nonlinear partial differential equations (PDEs) such as the Navier--Stokes (NS) equations remains computationally intensive, especially when implicit time integration is used to capture multiscale flow dynamics. This work…

Fluid Dynamics · Physics 2025-08-29 Shaobo Yao , Zhiyu Duan , Ziteng Wang , Wenwen Zhao , Shiying Xiong

Weak signal learning (WSL) is a common challenge in many fields like fault diagnosis, medical imaging, and autonomous driving, where critical information is often masked by noise and interference, making feature identification difficult.…

Machine Learning · Computer Science 2025-12-30 Xianqi Liu , Xiangru Li , Lefeng He , Ziyu Fang

A universal rule-based self-learning approach using deep reinforcement learning (DRL) is proposed for the first time to solve nonlinear ordinary differential equations and partial differential equations. The solver consists of a deep neural…

Machine Learning · Computer Science 2019-05-30 Shiyin Wei , Xiaowei Jin , Hui Li

The learning and evaluation of energy-based latent variable models (EBLVMs) without any structural assumptions are highly challenging, because the true posteriors and the partition functions in such models are generally intractable. This…

Machine Learning · Computer Science 2021-06-08 Fan Bao , Kun Xu , Chongxuan Li , Lanqing Hong , Jun Zhu , Bo Zhang

We detail a novel class of implicit neural models. Leveraging time-parallel methods for differential equations, Multiple Shooting Layers (MSLs) seek solutions of initial value problems via parallelizable root-finding algorithms. MSLs…

Machine Learning · Computer Science 2021-06-09 Stefano Massaroli , Michael Poli , Sho Sonoda , Taji Suzuki , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Partial Differential Equations (PDEs) are fundamental tools for modeling physical phenomena, yet most PDEs of practical interest cannot be solved analytically and require numerical approximations. The feasibility of such numerical methods,…

Numerical Analysis · Mathematics 2025-12-03 Juan Esteban Suarez Cardona , Holger Boche , Gitta Kutyniok

We introduce a deterministic variational formulation for training Bayesian last layer neural networks. This yields a sampling-free, single-pass model and loss that effectively improves uncertainty estimation. Our variational Bayesian last…

Machine Learning · Computer Science 2024-04-18 James Harrison , John Willes , Jasper Snoek

A hybrid computational approach that integrates the finite element method (FEM) with least squares support vector regression (LSSVR) is introduced to solve partial differential equations. The method combines FEM's ability to provide the…

Numerical Analysis · Mathematics 2026-01-01 Maryam Babaei , Peter Rucz , Manfred Kaltenbacher , Stefan Schoder

Spectrum prediction is considered to be a promising technology that enhances spectrum efficiency by assisting dynamic spectrum access (DSA) in cognitive radio networks (CRN). Nonetheless, the highly nonlinear nature of spectrum data across…

Signal Processing · Electrical Eng. & Systems 2024-12-16 Guangliang Pan , David K. Y. Yau , Bo Zhou , Qihui Wu

We propose a novel framework for discovering Stochastic Partial Differential Equations (SPDEs) from data. The proposed approach combines the concepts of stochastic calculus, variational Bayes theory, and sparse learning. We propose the…

Machine Learning · Statistics 2023-06-29 Yogesh Chandrakant Mathpati , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty