English
Related papers

Related papers: Signal Recovery from Pooling Representations

200 papers

We investigate to what extent it is possible to solve linear inverse problems with $ReLu$ networks. Due to the scaling invariance arising from the linearity, an optimal reconstruction function $f$ for such a problem is positive homogeneous,…

Machine Learning · Computer Science 2023-08-08 Stefan Bamberger , Reinhard Heckel , Felix Krahmer

We prove local Lipschitz regularity for bounded minimizers of functionals with nonstandard $p,q$-growth with the source term in the Lorentz space $L(N,1)$ under the restriction $q<p+1+p\,\min\left\{\frac 1N,\frac{2(p-1)}{Np-2p+2}\right\}$.…

Analysis of PDEs · Mathematics 2022-03-08 Karthik Adimurthi , Vivek Tewary

In this paper we study recovery conditions of weighted $\ell_1$ minimization for signal reconstruction from compressed sensing measurements when partial support information is available. We show that if at least 50% of the (partial) support…

Information Theory · Computer Science 2011-07-26 Michael P. Friedlander , Hassan Mansour , Rayan Saab , Ozgur Yilmaz

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic…

Statistics Theory · Mathematics 2013-02-28 Anatoli Juditsky , Fatma Kılınç Karzan , Arkadi Nemirovski , Boris Polyak

We show that the log-likelihood of several probabilistic graphical models is Lipschitz continuous with respect to the lp-norm of the parameters. We discuss several implications of Lipschitz parametrization. We present an upper bound of the…

Machine Learning · Computer Science 2018-11-16 Jean Honorio

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

Data Structures and Algorithms · Computer Science 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

The objective of this paper is to develop methods for solving image recovery problems subject to constraints on the solution. More precisely, we will be interested in problems which can be formulated as the minimization over a closed convex…

Optimization and Control · Mathematics 2012-12-12 Caroline Chaux , Jean-Christophe Pesquet , Nelly Pustelnik

Obtaining sharp Lipschitz constants for feed-forward neural networks is essential to assess their robustness in the face of perturbations of their inputs. We derive such constants in the context of a general layered network model involving…

Optimization and Control · Mathematics 2020-06-23 Patrick L. Combettes , Jean-Christophe Pesquet

Peral/Miyachi's celebrated theorem on fixed time $L^{p}$ estimates with loss of derivatives for the wave equation states that the operator $(I-\Delta)^{- \frac{\alpha}{2}}\exp(i \sqrt{-\Delta})$ is bounded on $L^{p}(\mathbb{R}^{d})$ if and…

Analysis of PDEs · Mathematics 2022-03-08 Dorothee Frey , Pierre Portal

In signal processing, several applications involve the recovery of a function given noisy modulo samples. The setting considered in this paper is that the samples corrupted by an additive Gaussian noise are wrapped due to the modulo…

Statistics Theory · Mathematics 2021-12-06 Michaël Fanuel , Hemant Tyagi

We study the linearized maximal operator associated with dilates of the hyperbolic cross multiplier in dimension two. Assuming a Lipschitz condition and a lower bound on the linearizing function, we obtain $L^{p}(\mathbb{R}^{2}) \to…

Classical Analysis and ODEs · Mathematics 2021-02-23 Olli Saari , Christoph Thiele

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

We provide recovery guarantees for compressible signals that have been corrupted with noise and extend the framework introduced in \cite{bafna2018thwarting} to defend neural networks against $\ell_0$-norm, $\ell_2$-norm, and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Jasjeet Dhaliwal , Kyle Hambrook

Lipschitz constants of neural networks allow for guarantees of robustness in image classification, safety in controller design, and generalizability beyond the training data. As calculating Lipschitz constants is NP-hard, techniques for…

Machine Learning · Computer Science 2024-01-09 Anton Xue , Lars Lindemann , Alexander Robey , Hamed Hassani , George J. Pappas , Rajeev Alur

This paper is concerned with the computation of the local Lipschitz constant of feedforward neural networks (FNNs) with activation functions being rectified linear units (ReLUs). The local Lipschitz constant of an FNN for a target input is…

Optimization and Control · Mathematics 2024-04-09 Yoshio Ebihara , Xin Dai , Victor Magron , Dimitri Peaucelle , Sophie Tarbouriech

We consider the problem of reconstructing a signal from under-determined modulo observations (or measurements). This observation model is inspired by a (relatively) less well-known imaging mechanism called modulo imaging, which can be used…

Machine Learning · Statistics 2019-07-18 Viraj Shah , Chinmay Hegde

Let $\Delta_{\Lambda}\le \lambda_{\Lambda}$ be a semi-bounded self-adjoint realization of the Laplace operator with boundary conditions (Dirichlet, Neumann, semi-transparent) assigned on the Lipschitz boundary of a bounded obstacle…

Analysis of PDEs · Mathematics 2020-06-15 Andrea Mantile , Andrea Posilicano

Despite the large success of deep neural networks (DNN) in recent years, most neural networks still lack mathematical guarantees in terms of stability. For instance, DNNs are vulnerable to small or even imperceptible input perturbations, so…

Machine Learning · Computer Science 2022-11-02 Leon Bungert , René Raab , Tim Roith , Leo Schwinn , Daniel Tenbrinck