English
Related papers

Related papers: Extended Galerkin neural network approximation of …

200 papers

Quadratic programming (QP) is the most widely applied category of problems in nonlinear programming. Many applications require real-time/fast solutions, though not necessarily with high precision. Existing methods either involve matrix…

Machine Learning · Computer Science 2025-09-23 Ziang Chen , Xiaohan Chen , Jialin Liu , Xinshang Wang , Wotao Yin

In this paper, we present a unified analysis of the superconvergence property for a large class of mixed discontinuous Galerkin methods. This analysis applies to both the Poisson equation and linear elasticity problems with symmetric stress…

Numerical Analysis · Mathematics 2021-07-28 Limin Ma

Gaussian process regression networks (GPRN) are powerful Bayesian models for multi-output regression, but their inference is intractable. To address this issue, existing methods use a fully factorized structure (or a mixture of such…

Machine Learning · Computer Science 2020-05-19 Shibo Li , Wei Xing , Mike Kirby , Shandian Zhe

The generalized Gauss-Newton (GGN) approximation is often used to make practical Bayesian deep learning approaches scalable by replacing a second order derivative with a product of first order derivatives. In this paper we argue that the…

Machine Learning · Statistics 2021-02-26 Alexander Immer , Maciej Korzepa , Matthias Bauer

The proximal Galerkin finite element method is a high-order, low-iteration complexity, nonlinear numerical method that preserves the geometric and algebraic structure of point-wise bound constraints in infinite-dimensional function spaces.…

Numerical Analysis · Mathematics 2024-12-18 Brendan Keith , Thomas M. Surowiec

In many real-world problems, there is a limited set of training data, but an abundance of unlabeled data. We propose a new method, Generative Posterior Networks (GPNs), that uses unlabeled data to estimate epistemic uncertainty in…

Machine Learning · Computer Science 2024-01-01 Melrose Roderick , Felix Berkenkamp , Fatemeh Sheikholeslami , Zico Kolter

Mixed optimal stopping and stochastic control problems define variational inequalities with non-linear Hamilton-Jacobi-Bellman (HJB) operators, whose numerical solution is notoriously difficult and lack of reliable benchmarks. We first use…

Optimization and Control · Mathematics 2025-05-27 Yun Zhao , Harry Zheng

We introduce the proximal Galerkin (PG) method for non-symmetric variational inequalities. The proposed approach is asymptotically mesh-independent and yields constraint-preserving approximations. We present both a conforming PG formulation…

Numerical Analysis · Mathematics 2026-02-17 Guosheng Fu , Brendan Keith , Dohyun Kim , Rami Masri , Will Pazner

In this work, we study scaling limits of shallow Bayesian neural networks (BNNs) via their connection to Gaussian processes (GPs), with an emphasis on statistical modeling, identifiability, and scalable inference. We first establish a…

Machine Learning · Statistics 2026-02-27 Gracielle Antunes de Araújo , Flávio B. Gonçalves

The paper deals with a stochastic Galerkin approximation of elliptic Dirichlet boundary control problems with random input data. The expectation of a tracking cost functional with the deterministic constrained control is minimized. Error…

Optimization and Control · Mathematics 2025-06-16 Max Winkler , Hamdullah Yücel

Using neural networks to solve variational problems, and other scientific machine learning tasks, has been limited by a lack of consistency and an inability to exactly integrate expressions involving neural network architectures. We address…

Machine Learning · Computer Science 2021-10-28 Jonas A. Actor , Andy Huang , Nathaniel Trask

First-order methods such as stochastic gradient descent (SGD) are currently the standard algorithm for training deep neural networks. Second-order methods, despite their better convergence rate, are rarely used in practice due to the…

Machine Learning · Computer Science 2019-09-26 Tianle Cai , Ruiqi Gao , Jikai Hou , Siyu Chen , Dong Wang , Di He , Zhihua Zhang , Liwei Wang

In this work, we establish that discontinuous Galerkin methods are capable of producing reliable approximations for a broad class of nonlinear variational problems. In particular, we demonstrate that these schemes provide essential…

Numerical Analysis · Mathematics 2025-01-22 Georgios Grekas , Konstantinos Koumatos , Charalambos Makridakis , Andreas Vikelis

In this paper, we present and analyze an interior penalty discontinuous Galerkin method for the distributed elliptic optimal control problems. It is based on a reconstructed discontinuous approximation which admits arbitrarily high-order…

Numerical Analysis · Mathematics 2026-01-05 Ruo Li , Haoyang Liu , Jun Yin

In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such…

Machine Learning · Computer Science 2025-02-14 Adrian Celaya , Yimo Wang , David Fuentes , Beatrice Riviere

We develop the Randomized Neural Networks with Petrov-Galerkin Methods (RNN-PG methods) to solve linear elasticity problems. RNN-PG methods use Petrov-Galerkin variational framework, where the solution is approximated by randomized neural…

Numerical Analysis · Mathematics 2023-08-08 Yong Shang , Fei Wang

Driven by the outstanding performance of neural networks in the structured Euclidean domain, recent years have seen a surge of interest in developing neural networks for graphs and data supported on graphs. The graph is leveraged at each…

Machine Learning · Computer Science 2021-07-28 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Recently, message-passing graph neural networks (MPNNs) have shown potential for solving combinatorial and continuous optimization problems due to their ability to capture variable-constraint interactions. While existing approaches leverage…

Artificial Intelligence · Computer Science 2025-02-05 Chendi Qian , Christopher Morris

We propose a boundary-corrected weak Galerkin mixed finite element method for solving elliptic interface problems in 2D domains with curved interfaces. The method is formulated on body-fitted polygonal meshes, where interface edges are…

Numerical Analysis · Mathematics 2025-02-06 Yongli Hou , Yi Liu , Yanqiu Wang

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song