English
Related papers

Related papers: Neural Preconditioned Born Series: A Metric-Matche…

200 papers

Across scientific domains, a fundamental challenge is to characterize and compute the mappings from underlying physical processes to observed signals and measurements. While nonlinear neural networks have achieved considerable success, they…

Machine Learning · Computer Science 2025-08-11 Alexander DeLise , Kyle Loh , Krish Patel , Meredith Teague , Andrea Arnold , Matthias Chung

Bayesian predictive coding is a putative neuromorphic method for acquiring higher-level neural representations to account for sensory input. Although originating in the neuroscience community, there are also efforts in the machine learning…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Matin Hosseini , Anthony Maida

Neural networks are commonly trained to make predictions through learning algorithms. Contrastive Hebbian learning, which is a powerful rule inspired by gradient backpropagation, is based on Hebb's rule and the contrastive divergence…

Machine Learning · Computer Science 2018-06-21 Georgios Detorakis , Travis Bartley , Emre Neftci

Efficient numerical solution of the acoustic Helmholtz equation in heterogeneous media remains challenging, particularly for large-scale problems with spatially-varying density - a limitation that restricts applications in biomedical…

Computational Physics · Physics 2025-07-23 Antonio Stanziola , Simon R. Arridge , Bradley E. Treeby , Benjamin T. Cox

A pre-trained generator has been frequently adopted in compressed sensing (CS) due to its ability to effectively estimate signals with the prior of NNs. In order to further refine the NN-based prior, we propose a framework that allows the…

Machine Learning · Computer Science 2020-11-03 Kyung-Su Kim , Jung Hyun Lee , Eunho Yang

We present a fast method for numerically solving the inhomogeneous Helmholtz equation. Our iterative method is based on the Born series, which we modified to achieve convergence for scattering media of arbitrary size and scattering…

Computational Physics · Physics 2016-07-14 Gerwin Osnabrugge , Saroch Leedumrongwatthanakun , Ivo M. Vellekoop

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate…

Numerical Analysis · Mathematics 2022-03-02 Davide Papapicco , Nicola Demo , Michele Girfoglio , Giovanni Stabile , Gianluigi Rozza

We introduce a learning-based algorithm to obtain a measurement matrix for compressive sensing related recovery problems. The focus lies on matrices with a constant modulus constraint which typically represent a network of analog phase…

Signal Processing · Electrical Eng. & Systems 2021-10-15 Michael Koller , Wolfgang Utschick

Deep neural networks have become the dominant approach in natural language processing (NLP). However, in recent years, it has become apparent that there are shortcomings in systematicity that limit the performance and data efficiency of…

Computation and Language · Computer Science 2021-03-11 Radha Kopparti , Tillman Weyde

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. In many applications, the spatial distribution of a field needs to be…

Machine Learning · Computer Science 2021-09-01 Roberto Ponciroli , Andrea Rovinelli , Lander Ibarra

Understanding how biological constraints shape neural computation is a central goal of computational neuroscience. Spatially embedded recurrent neural networks provide a promising avenue to study how modelled constraints shape the combined…

Neural and Evolutionary Computing · Computer Science 2024-09-27 Cornelia Sheeran , Andrew S. Ham , Duncan E. Astle , Jascha Achterberg , Danyal Akarca

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

Numerical Analysis · Mathematics 2021-03-17 Yating Wang , Wei Deng , Lin Guang

This paper introduces an approach for detecting differences in the first-order structures of spatial point patterns. The proposed approach leverages the kernel mean embedding in a novel way by introducing its approximate version tailored to…

Methodology · Statistics 2020-06-15 Raif M. Rustamov , James T. Klosowski

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Neural PDE surrogates can improve the cost-accuracy tradeoff of classical solvers, but often generalize poorly to new initial conditions and accumulate errors over time. Physical and symmetry constraints have shown promise in closing this…

Machine Learning · Computer Science 2025-06-09 Yunfei Huang , David S. Greenberg

In this paper, we present a data-driven approach to iteratively solve the discrete heterogeneous Helmholtz equation at high wavenumbers. In our approach, we combine classical iterative solvers with convolutional neural networks (CNNs) to…

Numerical Analysis · Mathematics 2022-03-22 Yael Azulay , Eran Treister

We propose a new approach to learned optimization where we represent the computation of an optimizer's update step using a neural network. The parameters of the optimizer are then learned by training on a set of optimization tasks with the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Erik Gärtner , Luke Metz , Mykhaylo Andriluka , C. Daniel Freeman , Cristian Sminchisescu

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial…

Numerical Analysis · Mathematics 2023-05-03 Lianghao Cao , Thomas O'Leary-Roseberry , Prashant K. Jha , J. Tinsley Oden , Omar Ghattas

Differential cross section measurements are the currency of scientific exchange in particle and nuclear physics. A key challenge for these analyses is the correction for detector distortions, known as deconvolution or unfolding. Binned…

High Energy Physics - Phenomenology · Physics 2025-09-09 Fernando Torales Acosta , Jay Chan , Krish Desai , Vinicius Mikuni , Benjamin Nachman , Jingjing Pan , Francesco Rubbo

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie