English
Related papers

Related papers: Neural Preconditioned Born Series: A Metric-Matche…

200 papers

Convolution-type integral equations arise from various fields, \textit{e.g.}, finite impulse response filters in signal processing and deblurring problems in image processing. When solving these equations, conventional numerical methods,…

Numerical Analysis · Mathematics 2026-05-11 Raymond Chan , Lingfeng Li

Recent years have witnessed a growing call for renewed emphasis on neuroscience-inspired approaches in artificial intelligence research, under the banner of NeuroAI. A prime example of this is predictive coding networks (PCNs), based on the…

Machine Learning · Computer Science 2026-03-09 Björn van Zwol , Ro Jefferson , Egon L. van den Broek

This work proposes a solution for the problem of training physics-informed networks under partial integro-differential equations. These equations require an infinite or a large number of neural evaluations to construct a single residual for…

Machine Learning · Computer Science 2024-06-12 Ehsan Saleh , Saba Ghaffari , Timothy Bretl , Luke Olson , Matthew West

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

Hyperbolic neural networks have emerged as a powerful tool for modeling hierarchical data structures prevalent in real-world datasets. Notably, residual connections, which facilitate the direct flow of information across layers, have been…

Machine Learning · Computer Science 2025-01-14 Neil He , Menglin Yang , Rex Ying

In this paper we are concerned with fast algorithms for the systems arising from the plane wave discretizations for two-dimensional Helmholtz equations with large wave numbers. We consider the plane wave weighted least squares (PWLS) method…

Numerical Analysis · Mathematics 2016-07-19 Qiya Hu , Xuan Li

The convergence of the conjugate gradient method for solving large-scale and sparse linear equation systems depends on the spectral properties of the system matrix, which can be improved by preconditioning. In this paper, we develop a…

Optimization and Control · Mathematics 2024-10-25 Paul Häusner , Ozan Öktem , Jens Sjölund

Transcription factors are proteins that regulate the expression of genes by binding to specific genomic regions known as Transcription Factor Binding Sites (TFBSs), typically located in the promoter regions of those genes. Accurate…

Machine Learning · Computer Science 2025-02-04 Nimisha Ghosh , Pratik Dutta , Daniele Santoni

Deep Convolutional Neural Networks (CNNs) achieve high accuracy but often rely on purely global, gradient-based optimisation, which can lead to overfitting, redundant filters, and reduced interpretability. To address these limitations, we…

Machine Learning · Computer Science 2025-08-28 Davorin Miličević , Ratko Grbić

We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets…

Machine Learning · Computer Science 2024-03-20 Konrad Mundinger , Max Zimmer , Sebastian Pokutta

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Deep unfolding neural networks derived from iterative optimization schemes and numerical ordinary/partial differential equations (ODEs/PDEs) have attracted much attention in data science over the last decade. Therein, numerous important…

Machine Learning · Computer Science 2026-05-27 Xuan Lin , Chunlin Wu

Solving parametric Partial Differential Equations (PDEs) for a broad range of parameters is a critical challenge in scientific computing. To this end, neural operators, which \textcolor{black}{predicts the PDE solution with variable PDE…

Numerical Analysis · Mathematics 2024-11-14 Weiheng Zhong , Hadi Meidani

Nonlinear Parametric Optimization Network (NLPOpt-Net) is an unsupervised learning architecture to solve constrained nonlinear programs (NLP). Given the structure of an NLP, it learns the parametric solution maps with guaranteed constraint…

Machine Learning · Computer Science 2026-05-04 Bimol Nath Roy , Rahul Golder , MM Faruque Hasan

We present a unified hard-constraint framework for solving geometrically complex PDEs with neural networks, where the most commonly used Dirichlet, Neumann, and Robin boundary conditions (BCs) are considered. Specifically, we first…

Machine Learning · Computer Science 2023-06-06 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Ze Cheng

We present a novel block-preconditioner for the elastic Helmholtz equation, based on a reduction to acoustic Helmholtz equations. Both versions of the Helmholtz equations are challenging numerically. The elastic Helmholtz equation is…

Numerical Analysis · Mathematics 2025-12-09 Rachel Yovel , Eran Treister

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

In this thesis we look into programming by example (PBE), which is about finding a program mapping given inputs to given outputs. PBE has traditionally seen a split between formal versus neural approaches, where formal approaches typically…

Software Engineering · Computer Science 2020-09-18 Kiara Grouwstra

Deep neural networks excel at function approximation, yet they are typically trained from scratch for each new function. On the other hand, Bayesian methods, such as Gaussian Processes (GPs), exploit prior knowledge to quickly infer the…

In symbolic regression, the goal is to find an analytical expression that accurately fits experimental data with the minimal use of mathematical symbols such as operators, variables, and constants. However, the combinatorial space of…

Machine Learning · Computer Science 2023-04-21 Tommaso Bendinelli , Luca Biggio , Pierre-Alexandre Kamienny