English
Related papers

Related papers: Thouless-Anderson-Palmer Approach for Lossy Compre…

200 papers

Hardware trends have motivated the development of mixed precision algo-rithms in numerical linear algebra, which aim to decrease runtime while maintaining acceptable accuracy. One recent development is the development of an adaptive…

Numerical Analysis · Mathematics 2023-07-11 Noaman Khan , Erin Carson

Compressed sensing allows for the recovery of sparse signals from few measurements, whose number is proportional to the sparsity of the unknown signal, up to logarithmic factors. The classical theory typically considers either random linear…

Functional Analysis · Mathematics 2025-04-02 Giovanni S. Alberti , Alessandro Felisi , Matteo Santacesaria , S. Ivan Trapasso

Learning governing equations allows for deeper understanding of the structure and dynamics of data. We present a random sampling method for learning structured dynamical systems from under-sampled and possibly noisy state-space…

Information Theory · Computer Science 2018-05-14 Hayden Schaeffer , Giang Tran , Rachel Ward , Linan Zhang

This paper proposes a standard way to represent sparse tensors. A broad theoretical framework for tensor data scattering methods used in various deep learning frameworks is established. This paper presents a theorem that is very important…

Machine Learning · Computer Science 2021-09-06 Wuming Pan

We propose a new estimator of high-dimensional spectral density matrices, called UNshrunk ALgebraic Spectral Estimator (UNALSE), under the assumption of an underlying low rank plus sparse structure, as typically assumed in dynamic factor…

Statistics Theory · Mathematics 2021-04-06 Matteo Barigozzi , Matteo Farnè

Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources…

Information Theory · Computer Science 2021-02-24 Maxime Ferreira Da Costa , Yuejie Chi

This paper proposes an adaptive hyper-reduction method to reduce the computational cost associated with the simulation of parametric particle-based kinetic plasma models, specifically focusing on the Vlasov-Poisson equation. Conventional…

Numerical Analysis · Mathematics 2026-02-05 Cecilia Pagliantini , Federico Vismara

This paper presents an adaptive and intelligent sparse model for digital image sampling and recovery. In the proposed sampler, we adaptively determine the number of required samples for retrieving image based on space-frequency-gradient…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Ali Taimori , Farokh Marvasti

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

An efficient nonlinear contrast source inversion scheme for electromagnetic imaging of sparse two-dimensional investigation domains is proposed. To avoid generating a sequence of linear sparse optimization problems, the non-linearity is…

Signal Processing · Electrical Eng. & Systems 2021-04-13 Ali I. Sandhu , Abdulla Desmal , Hakan Bagci

Exact matrix completion and low rank matrix estimation problems has been studied in different underlying conditions. In this work we study exact low-rank completion under non-degenerate noise model. Non-degenerate random noise model has…

Machine Learning · Computer Science 2022-04-06 Jafar Jafarov

Sparse neural networks are becoming increasingly important as the field seeks to improve the performance of existing models by scaling them up, while simultaneously trying to reduce power consumption and computational footprint.…

Machine Learning · Computer Science 2021-06-08 Siddhant M. Jayakumar , Razvan Pascanu , Jack W. Rae , Simon Osindero , Erich Elsen

In this paper we consider Basis Pursuit De-Noising (BPDN) problems in which the sparse original signal is drawn from a finite alphabet. To solve this problem we propose an iterative message passing algorithm, which capitalises not only on…

Information Theory · Computer Science 2016-11-17 Andreas Muller , Dino Sejdinovic , Robert Piechocki

We study the problem of recovering the underlining sparse signals from clean or noisy phaseless measurements. Due to the sparse prior of signals, we adopt an L0regularized variational model to ensure only a small number of nonzero elements…

Optimization and Control · Mathematics 2016-12-09 Yuping Duan , Chunlin Wu , Zhi-Feng Pang , Huibin Chang

This paper extends the sample complexity theory for ill-posed inverse problems developed in a recent work by the authors [`Compressed sensing for inverse problems and the sample complexity of the sparse Radon transform', J. Eur. Math. Soc.,…

Functional Analysis · Mathematics 2025-01-06 Giovanni S. Alberti , Alessandro Felisi , Matteo Santacesaria , S. Ivan Trapasso

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

In this paper, we study the sparse nonnegative tensor factorization and completion problem from partial and noisy observations for third-order tensors. Because of sparsity and nonnegativity, the underlying tensor is decomposed into the…

Machine Learning · Statistics 2021-10-22 Xiongjun Zhang , Michael K. Ng

This paper considers the design of tunable decision schemes capable of rejecting with high probability mismatched signals embedded in Gaussian interference with unknown covariance matrix. To this end, a sparse recovery technique is…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Sudan Han , Luca Pallotta , Xiaotao Huang , Gaetano Giunta , Danilo Orlando

We study sparse recovery with structured random measurement matrices having independent, identically distributed, and uniformly bounded rows and with a nontrivial covariance structure. This class of matrices arises from random sampling of…

Information Theory · Computer Science 2020-05-15 Simone Brugiapaglia , Sjoerd Dirksen , Hans Christian Jung , Holger Rauhut

Sparse auto-encoders are useful for extracting low-dimensional representations from high-dimensional data. However, their performance degrades sharply when the input noise at test time differs from the noise employed during training. This…

Machine Learning · Computer Science 2024-07-01 Nelson Goldenstein , Jeremias Sulam , Yaniv Romano