English
Related papers

Related papers: FISTA-Net: Learning A Fast Iterative Shrinkage Thr…

200 papers

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

The most popular first-order accelerated black-box methods for solving large-scale convex optimization problems are the Fast Gradient Method (FGM) and the Fast Iterative Shrinkage Thresholding Algorithm (FISTA). FGM requires that the…

Optimization and Control · Mathematics 2021-09-29 Mihai I. Florea , Sergiy A. Vorobyov

In this paper we develop a new perspective on generalization of neural networks by proposing and investigating the concept of a neural network stiffness. We measure how stiff a network is by looking at how a small gradient step in the…

Machine Learning · Computer Science 2020-03-17 Stanislav Fort , Paweł Krzysztof Nowak , Stanislaw Jastrzebski , Srini Narayanan

Deep learning (DL) is a powerful tool in computational imaging for many applications. A common strategy is to reconstruct a preliminary image as the input of a neural network to achieve an optimized image. Usually, the preliminary image is…

Image and Video Processing · Electrical Eng. & Systems 2021-05-12 Ruibo Shang , Kevin Hoffer-Hawlik , Geoffrey P. Luke

Instance segmentation is a form of image detection which has a range of applications, such as object refinement, medical image analysis, and image/video editing, all of which demand a high degree of accuracy. However, this precision is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Muhammed Korkmaz , T. Metin Sezgin

We propose a new method that uses deep learning techniques to solve the inverse problems. The inverse problem is cast in the form of learning an end-to-end mapping from observed data to the ground-truth. Inspired by the splitting strategy…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Kai Fan , Qi Wei , Wenlin Wang , Amit Chakraborty , Katherine Heller

We propose several deep-learning accelerated optimization solvers with convergence guarantees. We use ideas from the analysis of accelerated forward-backward schemes like FISTA, but instead of the classical approach of proving convergence…

Optimization and Control · Mathematics 2021-05-12 Sebastian Banert , Jevgenija Rudzusika , Ozan Öktem , Jonas Adler

The total variation (TV) penalty, as many other analysis-sparsity problems, does not lead to separable factors or a proximal operatorwith a closed-form expression, such as soft thresholding for the $\ell\_1$ penalty. As a result, in a…

Neurons and Cognition · Quantitative Biology 2015-12-23 Gaël Varoquaux , Michael Eickenberg , Elvis Dohmatob , Bertand Thirion

Convex-composite optimization, which minimizes an objective function represented by the sum of a differentiable function and a convex one, is widely used in machine learning and signal/image processing. Fast Iterative Shrinkage Thresholding…

Optimization and Control · Mathematics 2022-05-12 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

U-Nets have been established as a standard architecture for image-to-image learning problems such as segmentation and inverse problems in imaging. For large-scale data, as it for example appears in 3D medical imaging, the U-Net however has…

Machine Learning · Computer Science 2020-07-01 Christian Etmann , Rihuan Ke , Carola-Bibiane Schönlieb

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

Recently, the study on learned iterative shrinkage thresholding algorithm (LISTA) has attracted increasing attentions. A large number of experiments as well as some theories have proved the high efficiency of LISTA for solving sparse coding…

Machine Learning · Computer Science 2021-06-24 Lin Kong , Wei Sun , Fanhua Shang , Yuanyuan Liu , Hongying Liu

Proximal gradient-based optimization is one of the most common strategies to solve inverse problem of images, and it is easy to implement. However, these techniques often generate heavy artifacts in image reconstruction. One of the most…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Xiaohong Fan , Yin Yang , Ke Chen , Yujie Feng , Jianping Zhang

Tomographic SAR technique has attracted remarkable interest for its ability of three-dimensional resolving along the elevation direction via a stack of SAR images collected from different cross-track angles. The emerged compressed sensing…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Muhan Wang , Zhe Zhang , Xiaolan Qiu , Silin Gao , Yue Wang

Physics-informed neural networks and operator networks have shown promise for effectively solving equations modeling physical systems. However, these networks can be difficult or impossible to train accurately for some systems of equations.…

Machine Learning · Computer Science 2023-11-22 Amanda A Howard , Sarah H Murphy , Shady E Ahmed , Panos Stinis

We consider a combined restarting and adaptive backtracking strategy for the popular Fast Iterative Shrinking-Thresholding Algorithm frequently employed for accelerating the convergence speed of large-scale structured convex optimization…

Optimization and Control · Mathematics 2023-07-27 Jean-François Aujol , Luca Calatroni , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

Synthetic aperture radar (SAR) tomography (TomoSAR) has attracted remarkable interest for its ability in achieving three-dimensional reconstruction along the elevation direction from multiple observations. In recent years, compressed…

Signal Processing · Electrical Eng. & Systems 2022-05-06 Muhan Wang , Zhe Zhang , Yue Wang , Silin Gao , Xiaolan Qiu

In this paper we propose an adaptively extrapolated proximal gradient method, which is based on the accelerated proximal gradient method (also known as FISTA), however we locally optimize the extrapolation parameter by carrying out an exact…

Optimization and Control · Mathematics 2019-07-02 Peter Ochs , Thomas Pock

Solving variational image segmentation problems with hidden physics is often expensive and requires different algorithms and manually tunes model parameter. The deep learning methods based on the U-Net structure have obtained outstanding…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Hui Zhu , Shi Shu , Jianping Zhang

Deep neural networks achieve remarkable performance in many computer vision tasks. Most state-of-the-art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jiemin Fang , Yuzhu Sun , Qian Zhang , Kangjian Peng , Yuan Li , Wenyu Liu , Xinggang Wang