English
Related papers

Related papers: Revisiting L1 Loss in Super-Resolution: A Probabil…

200 papers

In this paper, we introduce a computational framework for recovering a high-resolution approximation of an unknown function from its low-resolution indirect measurements as well as high-resolution training observations by merging the…

Statistics Theory · Mathematics 2021-10-15 Milana Gataric

We investigate compressed sensing (CS) techniques for reducing the number of measurements in photoacoustic tomography (PAT). High resolution imaging from CS data requires particular image reconstruction algorithms. The most established…

Numerical Analysis · Mathematics 2024-12-20 Stephan Antholzer , Johannes Schwab , Markus Haltmeier

When a high-resolution (HR) image is degraded into a low-resolution (LR) image, the image loses some of the existing information. Consequently, multiple HR images can correspond to the LR image. Most of the existing methods do not consider…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Hanbyel Cho , Yekang Lee , Jaemyung Yu , Junmo Kim

In this paper, we propose a new framework to remove parts of the systematic errors affecting popular restoration algorithms, with a special focus for image processing tasks. Generalizing ideas that emerged for $\ell_1$ regularization, we…

Statistics Theory · Mathematics 2016-09-16 C-A. Deledalle , N. Papadakis , J. Salmon , S. Vaiter

Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Yaghoub Rahimi , Sung Ha Kang , Yifei Lou

Many common loss functions such as mean-squared-error, cross-entropy, and reconstruction loss are unnecessarily rigid. Under a probabilistic interpretation, these common losses correspond to distributions with fixed shapes and scales. We…

Machine Learning · Computer Science 2020-10-05 Mark Hamilton , Evan Shelhamer , William T. Freeman

Neural networks have become standard tools in the analysis of data, but they lack comprehensive mathematical theories. For example, there are very few statistical guarantees for learning neural networks from data, especially for classes of…

Machine Learning · Computer Science 2020-11-12 Mahsa Taheri , Fang Xie , Johannes Lederer

Overparametrized neural networks trained by gradient descent (GD) can provably overfit any training data. However, the generalization guarantee may not hold for noisy data. From a nonparametric perspective, this paper studies how well…

Machine Learning · Statistics 2021-09-28 Tianyang Hu , Wenjia Wang , Cong Lin , Guang Cheng

We propose a new approach for the problem of relative depth estimation from a single image. Instead of directly regressing over depth scores, we formulate the problem as estimation of a probability distribution over depth and aim to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Alican Mertan , Yusuf Huseyin Sahin , Damien Jade Duff , Gozde Unal

We propose a new approach for the image super-resolution (SR) task that progressively restores a high-resolution (HR) image from an input low-resolution (LR) image on the basis of a neural ordinary differential equation. In particular, we…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Seobin Park , Tae Hyun Kim

This paper addresses the problem of super-resolution: constructing a highly resolved (HR) image from a low resolved (LR) one. Recent unsupervised approaches search the latent space of a StyleGAN pre-trained on HR images, for the image that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Marzieh Gheisari , Auguste Genovesio

In this paper we introduce a nonuniform sparsity model and analyze the performance of an optimized weighted $\ell_1$ minimization over that sparsity model. In particular, we focus on a model where the entries of the unknown vector fall into…

Information Theory · Computer Science 2010-09-21 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

Advancing loss function design is pivotal for optimizing neural network training and performance. This work introduces Random Linear Projections (RLP) loss, a novel approach that enhances training efficiency by leveraging geometric…

Machine Learning · Computer Science 2024-06-03 Shyam Venkatasubramanian , Ahmed Aloui , Vahid Tarokh

Single-image super-resolution (SISR) typically focuses on restoring various degraded low-resolution (LR) images to a single high-resolution (HR) image. However, during SISR tasks, it is often challenging for models to simultaneously…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Xin Wang , Jing-Ke Yan , Jing-Ye Cai , Jian-Hua Deng , Qin Qin , Yao Cheng

Learning non-linear systems from noisy, limited, and/or dependent data is an important task across various scientific fields including statistics, engineering, computer science, mathematics, and many more. In general, this learning task is…

Information Theory · Computer Science 2018-11-27 Lam Si Tung Ho , Hayden Schaeffer , Giang Tran , Rachel Ward

In this paper we aim to tackle the problem of reconstructing a high-resolution image from a single low-resolution input image, known as single image super-resolution. In the literature, sparse representation has been used to address this…

Computer Vision and Pattern Recognition · Computer Science 2016-03-23 Mohammad Rostami , Zhou Wang

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2010-04-06 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

This work proposes a new loss function targeting classification problems, utilizing a source of information overlooked by cross entropy loss. First, we derive a series of the tightest upper and lower bounds for the probability of a random…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ali Ghobadzadeh , Amir Lashkari

In latest years, deep learning has gained a leading role in the pansharpening of multiresolution images. Given the lack of ground truth data, most deep learning-based methods carry out supervised training in a reduced-resolution domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Matteo Ciotola , Giovanni Poggi , Giuseppe Scarpa

We study network loss tomography based on observing average loss rates over a set of paths forming a tree -- a severely underdetermined linear problem for the unknown link loss probabilities. We examine in detail the role of sparsity as a…

Networking and Internet Architecture · Computer Science 2015-03-19 Vijay Arya , Darryl Veitch