English
Related papers

Related papers: Benchmarking Invertible Architectures on Inverse P…

200 papers

Several recent works have empirically observed that Convolutional Neural Nets (CNNs) are (approximately) invertible. To understand this approximate invertibility phenomenon and how to leverage it more effectively, we focus on a theoretical…

Machine Learning · Statistics 2017-05-25 Anna C. Gilbert , Yi Zhang , Kibok Lee , Yuting Zhang , Honglak Lee

Whenever invertible generative networks are needed for LHC physics, normalizing flows show excellent performance. In this work, we investigate their performance for fast calorimeter shower simulations with increasing phase space dimension.…

High Energy Physics - Phenomenology · Physics 2025-03-06 Florian Ernst , Luigi Favaro , Claudius Krause , Tilman Plehn , David Shih

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

Despite the significant progress over the last 50 years in simulating flow problems using numerical discretization of the Navier-Stokes equations (NSE), we still cannot incorporate seamlessly noisy data into existing algorithms,…

Fluid Dynamics · Physics 2021-05-21 Shengze Cai , Zhiping Mao , Zhicheng Wang , Minglang Yin , George Em Karniadakis

We show that standard ResNet architectures can be made invertible, allowing the same model to be used for classification, density estimation, and generation. Typically, enforcing invertibility requires partitioning dimensions or restricting…

Machine Learning · Computer Science 2019-05-21 Jens Behrmann , Will Grathwohl , Ricky T. Q. Chen , David Duvenaud , Jörn-Henrik Jacobsen

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

Inverse problems challenge existing neural operator architectures because ill-posed inverse maps violate continuity, uniqueness, and stability assumptions. We introduce B2B${}^{-1}$, an inverse basis-to-basis neural operator framework that…

Machine Learning · Computer Science 2025-12-23 Adam J. Thorpe , Stepan Tretiakov , Dibakar Roy Sarkar , Krishna Kumar , Ufuk Topcu

Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of…

Machine Learning · Computer Science 2024-06-11 Peimeng Guan , Naveed Iqbal , Mark A. Davenport , Mudassir Masood

Inverse problems correspond to a certain type of optimization problems formulated over appropriate input distributions. Recently, there has been a growing interest in understanding the computational hardness of these optimization problems,…

Machine Learning · Statistics 2018-09-03 Alex Nowak , Soledad Villar , Afonso S. Bandeira , Joan Bruna

Neural networks allow solving many ill-posed inverse problems with unprecedented performance. Physics informed approaches already progressively replace carefully hand-crafted reconstruction algorithms in real applications. However, these…

Machine Learning · Computer Science 2023-12-19 Alban Gossard , Pierre Weiss

The last decade of machine learning has seen drastic increases in scale and capabilities. Deep neural networks (DNNs) are increasingly being deployed in the real world. However, they are difficult to analyze, raising concerns about using…

Machine Learning · Computer Science 2023-08-22 Tilman Räuker , Anson Ho , Stephen Casper , Dylan Hadfield-Menell

The astounding success of these methods has made it imperative to obtain more explainable and trustworthy estimates from these models. In hydrology, basin characteristics can be noisy or missing, impacting streamflow prediction. For solving…

In this work, we describe a new data-driven approach for inverse problems that exploits technologies from machine learning, in particular autoencoder network structures. We consider a paired autoencoder framework, where two autoencoders are…

Machine Learning · Computer Science 2025-01-27 Emma Hart , Julianne Chung , Matthias Chung

Fourier Neural Operator (FNO) is a powerful and popular operator learning method. However, FNO is mainly used in forward prediction, yet a great many applications rely on solving inverse problems. In this paper, we propose an invertible…

Machine Learning · Computer Science 2025-05-07 Da Long , Zhitong Xu , Qiwei Yuan , Yin Yang , Shandian Zhe

Invertible neural networks based on coupling flows (CF-INNs) have various machine learning applications such as image synthesis and representation learning. However, their desirable characteristics such as analytic invertibility come at the…

Machine Learning · Computer Science 2020-11-05 Takeshi Teshima , Isao Ishikawa , Koichi Tojo , Kenta Oono , Masahiro Ikeda , Masashi Sugiyama

Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Yizeng Han , Gao Huang , Shiji Song , Le Yang , Honghui Wang , Yulin Wang

Normalizing flows model complex probability distributions using maps obtained by composing invertible layers. Special linear layers such as masked and 1x1 convolutions play a key role in existing architectures because they increase…

Machine Learning · Computer Science 2022-09-29 Chenlin Meng , Linqi Zhou , Kristy Choi , Tri Dao , Stefano Ermon

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The…

Artificial Intelligence · Computer Science 2025-05-27 Nikita Durasov , Doruk Oner , Jonathan Donier , Hieu Le , Pascal Fua

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan