English
Related papers

Related papers: Understanding and Mitigating Exploding Inverses in…

200 papers

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

Electrolysis is crucial for eco-friendly hydrogen production, but gas bubbles generated during the process hinder reactions, reduce cell efficiency, and increase energy consumption. Additionally, these gas bubbles cause changes in the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-29 Nishant Kumar , Lukas Krause , Thomas Wondrak , Sven Eckert , Kerstin Eckert , Stefan Gumhold

Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Di You , Andreas Floros , Pier Luigi Dragotti

Neural networks are known to be vulnerable to adversarial attacks, which are small, imperceptible perturbations that can significantly alter the network's output. Conversely, there may exist large, meaningful perturbations that do not…

Machine Learning · Computer Science 2023-05-18 Tianqi Cui , Thomas Bertalan , George J. Pappas , Manfred Morari , Ioannis G. Kevrekidis , Mahyar Fazlyab

While the deployment of neural networks, yielding impressive results, becomes more prevalent in various applications, their interpretability and understanding remain a critical challenge. Network inversion, a technique that aims to…

Machine Learning · Computer Science 2024-02-20 Pirzada Suhail , Supratik Chakraborty , Amit Sethi

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

Inverse problems challenge existing neural operator architectures because ill-posed inverse maps violate continuity, uniqueness, and stability assumptions. We introduce B2B${}^{-1}$, an inverse basis-to-basis neural operator framework that…

Machine Learning · Computer Science 2025-12-23 Adam J. Thorpe , Stepan Tretiakov , Dibakar Roy Sarkar , Krishna Kumar , Ufuk Topcu

While the interaction of ultra-intense ultra-short laser pulses with near- and overcritical plasmas cannot be directly observed, experimentally accessible quantities (observables) often only indirectly give information about the underlying…

Plasma Physics · Physics 2022-12-13 Thomas Miethlinger , Nico Hoffmann , Thomas Kluge

Bayesian Neural Networks (BayNNs) naturally provide uncertainty in their predictions, making them a suitable choice in safety-critical applications. Additionally, their realization using memristor-based in-memory computing (IMC)…

Machine Learning · Computer Science 2024-01-24 Soyed Tuhin Ahmed , Kamal Danouchi , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

Flow-based generative models parameterize probability distributions through an invertible transformation and can be trained by maximum likelihood. Invertible residual networks provide a flexible family of transformations where only…

Machine Learning · Statistics 2020-07-27 Ricky T. Q. Chen , Jens Behrmann , David Duvenaud , Jörn-Henrik Jacobsen

Normalizing flow models have been used successfully for generative image super-resolution (SR) by approximating complex distribution of natural images to simple tractable distribution in latent space through Invertible Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Min Zhang , Zhihong Pan , Xin Zhou , C. -C. Jay Kuo

Inverse design, the process of matching a device or process parameters to exhibit a desired performance, is applied in many disciplines ranging from material design over chemical processes and to engineering. Machine learning has emerged as…

Machine Learning · Computer Science 2022-08-31 Michel Frising , Jorge Bravo-Abad , Ferry Prins

Neural networks have emerged as effective tools for solving ill-posed inverse problems. In many scientific applications, however, observational training data are insufficient, and learned inverse operators must instead be trained on…

Numerical Analysis · Mathematics 2026-05-26 Sandra R. Babyale , Jodi Mead

Recently, deep residual networks have been successfully applied in many computer vision and natural language processing tasks, pushing the state-of-the-art performance with deeper and wider architectures. In this work, we interpret deep…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Bo Chang , Lili Meng , Eldad Haber , Lars Ruthotto , David Begert , Elliot Holtham

Machine learning techniques for the solution of inverse problems have become an attractive approach in the last decade, while their theoretical foundations are still in their infancy. In this chapter we want to pursue the study of…

Numerical Analysis · Mathematics 2025-12-10 Martin Burger , Samira Kabri , Gitta Kutyniok , Yunseok Lee , Lukas Weigand

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, using adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Kanchana Vaishnavi Gandikota , Jonas Geiping , Zorah Lähner , Adam Czapliński , Michael Moeller

In certain situations, neural networks are trained upon data that obey underlying symmetries. However, the predictions do not respect the symmetries exactly unless embedded in the network structure. In this work, we introduce architectures…

Machine Learning · Computer Science 2022-04-28 Anwesh Bhattacharya , Marios Mattheakis , Pavlos Protopapas

Artificial intelligence (AI) has revolutionized software development, shifting from task-specific codes (Software 1.0) to neural network-based approaches (Software 2.0). However, applying this transition in engineering software presents…

Sparsity-based methods have a long history in the field of signal processing and have been successfully applied to various image reconstruction problems. The involved sparsifying transformations or dictionaries are typically either…

Image and Video Processing · Electrical Eng. & Systems 2022-06-10 Andreas Kofler , Christian Wald , Tobias Schaeffter , Markus Haltmeier , Christoph Kolbitsch