English
Related papers

Related papers: Stability Bounds for the Unfolded Forward-Backward…

200 papers

We consider the variational reconstruction framework for inverse problems and propose to learn a data-adaptive input-convex neural network (ICNN) as the regularization functional. The ICNN-based convex regularizer is trained adversarially…

Solving inverse problems with neural networks benefits from very few theoretical guarantees when it comes to the recovery guarantees. We provide in this work convergence and recovery guarantees for self-supervised neural networks applied to…

Machine Learning · Computer Science 2025-06-04 Nathan Buskulic , Jalal Fadil , Yvain Quéau

A variety of approaches has been developed to deal with uncertain optimization problems. Often, they start with a given set of uncertainties and then try to minimize the influence of these uncertainties. Depending on the approach used, the…

Optimization and Control · Mathematics 2023-07-14 Holger Berthold , Till Heller , Tobias Seidel

Solving ill-posed inverse problems necessitates effective regularization strategies to stabilize the inversion process against measurement noise. While classical methods like Tikhonov regularization require heuristic parameter tuning, and…

Machine Learning · Statistics 2026-03-24 Hang-Cheng Dong , Pengcheng Cheng , Shuhuan Li

Invertible neural networks (INNs) have been used to design generative models, implement memory-saving gradient computation, and solve inverse problems. In this work, we show that commonly-used INN architectures suffer from exploding…

Machine Learning · Computer Science 2021-12-28 Jens Behrmann , Paul Vicol , Kuan-Chieh Wang , Roger Grosse , Jörn-Henrik Jacobsen

With the development of neural networks based machine learning and their usage in mission critical applications, voices are rising against the \textit{black box} aspect of neural networks as it becomes crucial to understand their limits and…

Machine Learning · Statistics 2017-08-08 El Mahdi El Mhamdi , Rachid Guerraoui , Sebastien Rouault

Inverse problems exist in a wide variety of physical domains from aerospace engineering to medical imaging. The goal is to infer the underlying state from a set of observations. When the forward model that produced the observations is…

Machine Learning · Computer Science 2023-01-06 Chelsea Sidrane , Sydney Katz , Anthony Corso , Mykel J. Kochenderfer

Many applications require the robustness, or ideally the invariance, of a neural network to certain transformations of input data. Most commonly, this requirement is addressed by either augmenting the training data, using adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Kanchana Vaishnavi Gandikota , Jonas Geiping , Zorah Lähner , Adam Czapliński , Michael Moeller

Deep Neural Networks (DNNs) are vulnerable to adversarial attacks. Existing methods are devoted to developing various robust training strategies or regularizations to update the weights of the neural network. But beyond the weights, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Minjing Dong , Yanxi Li , Yunhe Wang , Chang Xu

Despite their success in massive engineering applications, deep neural networks are vulnerable to various perturbations due to their black-box nature. Recent study has shown that a deep neural network can misclassify the data even if the…

Machine Learning · Computer Science 2021-04-29 Zhuotong Chen , Qianxiao Li , Zheng Zhang

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

Recurrent neural networks (RNNs) are a class of nonlinear dynamical systems often used to model sequence-to-sequence maps. RNNs have excellent expressive power but lack the stability or robustness guarantees that are necessary for many…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

Deep learning has achieved remarkable success across a wide range of domains, significantly expanding the frontiers of what is achievable in artificial intelligence. Yet, despite these advances, critical challenges remain -- most notably,…

Machine Learning · Computer Science 2026-02-05 Róisín Luo

Ill-posed linear inverse problems appear frequently in various signal processing applications. It can be very useful to have theoretical characterizations that quantify the level of ill-posedness for a given inverse problem and the degree…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Justin P. Haldar

Iterative algorithms solve problems by taking steps until a solution is reached. Models in the form of Deep Thinking (DT) networks have been demonstrated to learn iterative algorithms in a way that can scale to different sized problems at…

Machine Learning · Computer Science 2024-11-01 Jay Bear , Adam Prügel-Bennett , Jonathon Hare

Neural networks are very successful at detecting patterns in noisy data, and have become the technology of choice in many fields. However, their usefulness is hampered by their susceptibility to adversarial attacks. Recently, many methods…

Machine Learning · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Matthew L. Daggitt , Wen Kokke , Guy Katz , Guy Amir , Idan Refaeli

Neural networks allow solving many ill-posed inverse problems with unprecedented performance. Physics informed approaches already progressively replace carefully hand-crafted reconstruction algorithms in real applications. However, these…

Machine Learning · Computer Science 2023-12-19 Alban Gossard , Pierre Weiss

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard