English
Related papers

Related papers: Learning Generalizable Neural Operators for Invers…

200 papers

We propose a novel composite framework to find unknown fields in the context of inverse problems for partial differential equations (PDEs). We blend the high expressibility of deep neural networks as universal function estimators with the…

Numerical Analysis · Mathematics 2021-06-02 Samira Pakravan , Pouria A. Mistani , Miguel Angel Aragon-Calvo , Frederic Gibou

Deep neural networks are an attractive alternative for simulating complex dynamical systems, as in comparison to traditional scientific computing methods, they offer reduced computational costs during inference and can be trained directly…

Machine Learning · Computer Science 2024-05-01 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

We propose the Inverse Neural Operator (INO), a two-stage framework for recovering hidden ODE parameters from sparse, partial observations. In Stage 1, a Conditional Fourier Neural Operator (C-FNO) with cross-attention learns a…

Machine Learning · Computer Science 2026-03-13 Zhi-Song Liu , Wenqing Peng , Helmi Toropainen , Ammar Kheder , Andreas Rupp , Holger Froning , Xiaojie Lin , Michael Boy

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Computational imaging, especially non-line-of-sight (NLOS) imaging, the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Lianfang Wang , Kuilin Qin , Xueying Liu , Huibin Chang , Yong Wang , Yuping Duan

We consider end-to-end learning approaches for inverse problems of gravimetry. Due to ill-posedness of the inverse gravimetry, the reliability of learning approaches is questionable. To deal with this problem, we propose the strategy of…

Geophysics · Physics 2024-03-13 Yihang Chen , Wenbin Li

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

Machine Learning · Computer Science 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Recently, deep generative models have been used for posterior inference in inverse problems, including high-stakes applications in medical imaging and scientific discovery, where the uncertainty of a prediction can matter as much as the…

Machine Learning · Computer Science 2026-05-15 Yuxin Guo , Dongrui Deng , Pulkit Grover

Despite the remarkable success of foundation models, their task-specific fine-tuning paradigm makes them inconsistent with the goal of general perception modeling. The key to eliminating this inconsistency is to use generalist models for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Hao Li , Jinguo Zhu , Xiaohu Jiang , Xizhou Zhu , Hongsheng Li , Chun Yuan , Xiaohua Wang , Yu Qiao , Xiaogang Wang , Wenhai Wang , Jifeng Dai

Out-of-distribution generalization of machine learning models remains challenging since the models are inherently bound to the training data distribution. This especially manifests, when the learned models rely on spurious correlations.…

Machine Learning · Computer Science 2025-02-27 Martin Surner , Abdelmajid Khelil , Ludwig Bothmann

Machine Learning (ML) methods and tools have gained great success in many data, signal, image and video processing tasks, such as classification, clustering, object detection, semantic segmentation, language processing, Human-Machine…

Machine Learning · Computer Science 2023-09-06 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

We introduce learning to condition (L2C), a scalable, data-driven framework for accelerating Most Probable Explanation (MPE) inference in Probabilistic Graphical Models (PGMs), a fundamentally intractable problem. L2C trains a neural…

Machine Learning · Computer Science 2025-10-01 Brij Malhotra , Shivvrat Arya , Tahrima Rahman , Vibhav Giridhar Gogate

Neural networks have become a powerful tool as surrogate models to provide numerical solutions for scientific problems with increased computational efficiency. This efficiency can be advantageous for numerically challenging problems where…

Machine Learning · Statistics 2023-10-25 Pelin Ersin , Emma Hayes , Peter Matthews , Paramjyoti Mohapatra , Elisa Negrini , Karl Schulz

Neural operators have proven to be a promising approach for modeling spatiotemporal systems in the physical sciences. However, training these models for large systems can be quite challenging as they incur significant computational and…

Machine Learning · Computer Science 2023-12-12 Michael McCabe , Peter Harrington , Shashank Subramanian , Jed Brown

Mechanistic interpretability aims to understand how neural networks generalize beyond their training data by reverse-engineering their internal structures. We introduce patterning as the dual problem: given a desired form of generalization,…

Machine Learning · Computer Science 2026-01-21 George Wang , Daniel Murfet

Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Rebecca Pattichis , Sebastian Janampa , Constantinos S. Pattichis , Marios S. Pattichis

To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Yanni Wu , Peijun Li , Deyu Meng

Recently, with the significant developments in deep learning techniques, solving underdetermined inverse problems has become one of the major concerns in the medical imaging domain. Typical examples include undersampled magnetic resonance…

Image and Video Processing · Electrical Eng. & Systems 2020-06-29 Chang Min Hyun , Seong Hyeon Baek , Mingyu Lee , Sung Min Lee , Jin Keun Seo

Compositional generalization-a key open challenge in modern machine learning-requires models to predict unknown combinations of known concepts. However, assessing compositional generalization remains a fundamental challenge due to the lack…

Machine Learning · Computer Science 2025-11-06 Giacomo Camposampiero , Pietro Barbiero , Michael Hersche , Roger Wattenhofer , Abbas Rahimi

Learned graph neural networks (GNNs) have recently been established as fast and accurate alternatives for principled solvers in simulating the dynamics of physical systems. In many application domains across science and engineering,…

Machine Learning · Computer Science 2022-06-03 Qingqing Zhao , David B. Lindell , Gordon Wetzstein