English
Related papers

Related papers: Acceleration of RED via Vector Extrapolation

200 papers

Since the introduction of deep learning, a wide scope of representation properties, such as decorrelation, whitening, disentanglement, rank, isotropy, and mutual information, have been studied to improve the quality of representation.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jaeill Kim , Suhyun Kang , Duhun Hwang , Jungwook Shin , Wonjong Rhee

The renormalization method which is a type of perturbation method is extended to a tool to study weakly nonlinear time-delay systems. For systems with order-one delay, we show that the renormalization method leads to reduced systems without…

Pattern Formation and Solitons · Physics 2009-11-13 Shin-itiro Goto

This paper proposes a novel approach to regularize the \textit{ill-posed} and \textit{non-linear} blind image deconvolution (blind deblurring) using deep generative networks as priors. We employ two separate generative models --- one…

Computer Vision and Pattern Recognition · Computer Science 2019-02-28 Muhammad Asim , Fahad Shamshad , Ali Ahmed

Image restoration refers to the process of reconstructing noisy, destroyed, or missing parts of an image, which is an ill-posed inverse problem. A specific regularization term and image degradation are typically assumed to achieve…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Jianwei Ke

Traditional image processing methods employing partial differential equations (PDEs) offer a multitude of meaningful regularizers, along with valuable theoretical foundations for a wide range of image-related tasks. This makes their…

Machine Learning · Computer Science 2024-07-02 Chaoyu Liu , Zhonghua Qiao , Chao Li , Carola-Bibiane Schönlieb

The successes achieved by deep neural networks in computer vision tasks have led in recent years to the emergence of a new research area dubbed Multi-Dimensional Encoding (MDE). Methods belonging to this family aim to transform tabular data…

Machine Learning · Computer Science 2025-03-26 Paweł Zyblewski , Szymon Wojciechowski

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

Optimizing Neural networks is a difficult task which is still not well understood. On the other hand, fixed representation methods such as kernels and random features have provable optimization guarantees but inferior performance due to…

Machine Learning · Computer Science 2024-01-17 Amit Daniely , Mariano Schain , Gilad Yehudai

One key ingredient of image restoration is to define a realistic prior on clean images to complete the missing information in the observation. State-of-the-art restoration methods rely on a neural network to encode this prior. Typical image…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Marien Renaud , Eliot Guez , Arthur Leclaire , Nicolas Papadakis

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

Vector tomography methods intend to reconstruct and visualize vector fields in restricted domains by measuring line integrals of projections of these vector fields. Here, we deal with the reconstruction of irrotational vector functions from…

Quantitative Methods · Quantitative Biology 2017-05-03 Alexandra Koulouri

In this paper we explore acceleration techniques for large scale nonconvex optimization problems with special focuses on deep neural networks. The extrapolation scheme is a classical approach for accelerating stochastic gradient descent for…

Machine Learning · Statistics 2018-05-18 Guangzeng Xie , Yitan Wang , Shuchang Zhou , Zhihua Zhang

This paper introduces a novel variational approach for image compression motivated by recent PDE-based approaches combining edge detection and Laplacian inpainting. The essential feature is to encode the image via a sparse vector field,…

Optimization and Control · Mathematics 2015-03-09 Eva-Maria Brinkmann , Martin Burger , Joana Grah

Denoising, the process of reducing random fluctuations in a signal to emphasize essential patterns, has been a fundamental problem of interest since the dawn of modern scientific inquiry. Recent denoising techniques, particularly in…

Machine Learning · Computer Science 2024-12-04 Peyman Milanfar , Mauricio Delbracio

In this note, we give a convergence result for a modified ''regularization-by-denoising''(RED) algorithm under a restricted isometry condition on measurements and a restricted Lipschitz condition on the considered deep projective prior.…

Optimization and Control · Mathematics 2026-03-03 Yann Traonmilin , J. -F Aujol

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to…

Instrumentation and Methods for Astrophysics · Physics 2023-07-26 A. Asensio Ramos , S. Esteban Pozuelo , C. Kuckein

Recovering a signal from its Fourier intensity underlies many important applications, including lensless imaging and imaging through scattering media. Conventional algorithms for retrieving the phase suffer when noise is present but display…

Image and Video Processing · Electrical Eng. & Systems 2020-03-05 Yaotian Wang , Xiaohang Sun , Jason W. Fleischer

Recent denoising algorithms based on the "blind-spot" strategy show impressive blind image denoising performances, without utilizing any external dataset. While the methods excel in recovering highly contaminated images, we observe that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-07 Chaewon Kim , Jaeho Lee , Jinwoo Shin

This paper proposes a Transformer-based model to generate equations for math word problems. It achieves much better results than RNN models when copy and align mechanisms are not used, and can outperform complex copy and align RNN models.…

Machine Learning · Computer Science 2019-08-30 Yuanliang Meng , Anna Rumshisky