English
Related papers

Related papers: Total Deep Variation: A Stable Regularizer for Inv…

200 papers

The total generalized variation (TGV) is a popular regularizer in inverse problems and imaging combining discontinuous solutions and higher order smoothing. In particular, empirical observations suggest that its order two version strongly…

Optimization and Control · Mathematics 2023-01-03 José A. Iglesias , Daniel Walter

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

Learning maps between data samples is fundamental. Applications range from representation learning, image translation and generative modeling, to the estimation of spatial deformations. Such maps relate feature vectors, or map between…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Hastings Greer , Roland Kwitt , Francois-Xavier Vialard , Marc Niethammer

Regularization is critical for solving ill-posed geophysical inverse problems. Explicit regularization is often used, but there are opportunities to explore the implicit regularization effects that are inherent in a Neural Network…

Machine Learning · Computer Science 2024-07-10 Anran Xu , Lindsey J. Heagy

Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial…

Numerical Analysis · Mathematics 2024-03-22 Ke Chen , Chunmei Wang , Haizhao Yang

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

Multidimensional imaging, capturing image data in more than two dimensions, has been an emerging field with diverse applications. Due to the limitation of two-dimensional detectors in obtaining the high-dimensional image data, computational…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Didem Dogan , Figen S. Oktem

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

We study iterative regularization for linear models, when the bias is convex but not necessarily strongly convex. We characterize the stability properties of a primal-dual gradient based approach, analyzing its convergence in the presence…

Machine Learning · Statistics 2020-10-30 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

In this paper we explore the relation between distributionally robust learning and different forms of regularization to enforce robustness of deep neural networks. In particular, starting from a concrete min-max distributionally robust…

Optimization and Control · Mathematics 2022-03-29 Camilo Garcia Trillos , Nicolas Garcia Trillos

Regularization is commonly used for alleviating overfitting in machine learning. For convolutional neural networks (CNNs), regularization methods, such as DropBlock and Shake-Shake, have illustrated the improvement in the generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yi Wang , Zhen-Peng Bian , Junhui Hou , Lap-Pui Chau

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

In the last decades, unsupervised deep learning based methods have caught researchers attention, since in many real applications, such as medical imaging, collecting a great amount of training examples is not always feasible. Moreover, the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-24 Pasquale Cascarano , Andrea Sebastiani , Maria Colomba Comes , Giorgia Franchini , Federica Porta

Image restoration is one of the most fundamental issues in imaging science. Total variation (TV) regularization is widely used in image restoration problems for its capability to preserve edges. In the literature, however, it is also well…

Computer Vision and Pattern Recognition · Computer Science 2013-10-22 Jun Liu , Ting-Zhu Huang , Ivan W. Selesnick , Xiao-Guang Lv , Po-Yu Chen

We propose an extended full-waveform inversion formulation that includes general convex constraints on the model. Though the full problem is highly nonconvex, the overarching optimization scheme arrives at geologically plausible results by…

Optimization and Control · Mathematics 2016-08-23 Ernie Esser , Lluis Guasch , Tristan van Leeuwen , Aleksandr Y. Aravkin , Felix J. Herrmann

Variational methods for revealing visual concepts learned by convolutional neural networks have gained significant attention during the last years. Being based on noisy gradients obtained via back-propagation such methods require the…

Machine Learning · Computer Science 2018-05-02 Maximilian Baust , Florian Ludwig , Christian Rupprecht , Matthias Kohl , Stefan Braunewell

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

While deep learning methods have achieved state-of-the-art performance in many challenging inverse problems like image inpainting and super-resolution, they invariably involve problem-specific training of the networks. Under this approach,…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 J. H. Rick Chang , Chun-Liang Li , Barnabas Poczos , B. V. K. Vijaya Kumar , Aswin C. Sankaranarayanan