English
Related papers

Related papers: A Single-Layer Asymmetric RNN: Potential Low Hardw…

200 papers

In this paper, we put forward a neural network framework to solve the nonlinear hyperbolic systems. This framework, named relaxation neural networks(RelaxNN), is a simple and scalable extension of physics-informed neural networks(PINN). It…

Numerical Analysis · Mathematics 2024-04-02 Nan Zhou , Zheng Ma

Encoding constraints into neural networks is attractive. This paper studies how to introduce the popular positive linear satisfiability to neural networks. We propose the first differentiable satisfiability layer based on an extension of…

Artificial Intelligence · Computer Science 2024-07-22 Runzhong Wang , Yunhao Zhang , Ziao Guo , Tianyi Chen , Xiaokang Yang , Junchi Yan

The article discusses the development of various methods and techniques for initializing and training neural networks with a single hidden layer, as well as training a separable physics-informed neural network consisting of neural networks…

Numerical Analysis · Mathematics 2025-07-08 Vasiliy A. Es'kin , Alexey O. Malkhanov , Mikhail E. Smorkalov

Neural networks have shown significant potential in solving partial differential equations (PDEs). While deep networks are capable of approximating complex functions, direct one-shot training often faces limitations in both accuracy and…

Numerical Analysis · Mathematics 2025-03-10 Mingxing Weng , Zhiping Mao , Jie Shen

Solving Singularly Perturbed Differential Equations (SPDEs) presents challenges due to the rapid change of their solutions at the boundary layer. In this manuscript, We propose Asymptotic Physics-Informed Neural Networks (ASPINN), a…

Machine Learning · Computer Science 2024-09-23 Sen Wang , Peizhi Zhao , Tao Song

The structure of continuous Hopfield networks is revisited from a system-theoretic point of view. After adopting a novel electrical network interpretation involving nonlinear capacitors, it is shown that Hopfield networks admit a…

Optimization and Control · Mathematics 2026-01-07 Arjan van der Schaft

This paper proposes distributed algorithms for solving linear equations to seek a least square solution via multi-agent networks. We consider that each agent has only access to a small and imcomplete block of linear equations rather than…

Numerical Analysis · Mathematics 2021-05-20 Yi Huang , Ziyang Meng

We derive upper bounds on the complexity of ReLU neural networks approximating the solution of a linear system given the matrix and the right-hand side. We focus on matrices which are symmetric positive definite and sparse, as they appear…

Numerical Analysis · Mathematics 2026-03-20 Benjamin Dörich , Roland Maier , Lukas Ullmer

Solving the Schr\"odinger equation is key to many quantum mechanical properties. However, an analytical solution is only tractable for single-electron systems. Recently, neural networks succeeded at modeling wave functions of many-electron…

Machine Learning · Computer Science 2022-03-30 Nicholas Gao , Stephan Günnemann

Simplicial map neural networks (SMNNs) are topology-based neural networks with interesting properties such as universal approximation ability and robustness to adversarial examples under appropriate conditions. However, SMNNs present some…

Machine Learning · Computer Science 2024-03-22 Eduardo Paluzo-Hidalgo , Miguel A. Gutiérrez-Naranjo , Rocio Gonzalez-Diaz

Conventional AC Power Flow (ACPF) solvers like Newton-Raphson (NR) face significant computational and convergence challenges in modern, large-scale power systems. This paper proposes a novel, two-stage hybrid method that integrates a…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Mohamed Shamseldein

Linear system solving is one of the main workhorses in applied mathematics. Recently, theoretical computer scientists have contributed sophisticated algorithms for solving linear systems with symmetric diagonally dominant matrices (a class…

Data Structures and Algorithms · Computer Science 2015-03-02 Daniel Hoske , Dimitar Lukarski , Henning Meyerhenke , Michael Wegner

The Hopfield recurrent neural network is a classical auto-associative model of memory, in which collections of symmetrically-coupled McCulloch-Pitts neurons interact to perform emergent computation. Although previous researchers have…

Adaptation and Self-Organizing Systems · Physics 2015-06-09 Christopher Hillar , Ngoc M. Tran

Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating…

Machine Learning · Computer Science 2023-10-17 Chendi Qian , Didier Chételat , Christopher Morris

The single-layer feedforward neural network with random weights is a recurring motif in the neural networks literature. The advantage of these networks is their simplified training, which reduces to solving a ridge-regression problem. A…

Machine Learning · Computer Science 2025-02-25 M. Andrecut

Due to the complex behavior arising from non-uniqueness, symmetry, and bifurcations in the solution space, solving inverse problems of nonlinear differential equations (DEs) with multiple solutions is a challenging task. To address this, we…

Machine Learning · Computer Science 2024-01-18 Haoyang Zheng , Yao Huang , Ziyang Huang , Wenrui Hao , Guang Lin

The Painleve test is very useful to construct not only the Laurent-series solutions but also the elliptic and trigonometric ones. Such single-valued functions are solutions of some polynomial first order differential equations. To find the…

Exactly Solvable and Integrable Systems · Physics 2012-11-06 S. Yu. Vernov

We consider the homogenized linear feasibility problem, to find an $x$ on the unit sphere, satisfying $n$ line ar inequalities $a_i^Tx\ge 0$. To solve this problem we consider the centers of the insphere of spherical simpl ices, whose…

Optimization and Control · Mathematics 2007-05-23 Ulrich Betke

We propose physics-informed holomorphic neural networks (PIHNNs) as a method to solve boundary value problems where the solution can be represented via holomorphic functions. Specifically, we consider the case of plane linear elasticity…

Computational Engineering, Finance, and Science · Computer Science 2024-09-30 Matteo Calafà , Emil Hovad , Allan P. Engsig-Karup , Tito Andriollo

In this paper, we propose a novel algorithm called Neuron-wise Parallel Subspace Correction Method (NPSC) for the finite neuron method that approximates numerical solutions of partial differential equations (PDEs) using neural network…

Numerical Analysis · Mathematics 2025-11-11 Jongho Park , Jinchao Xu , Xiaofeng Xu