English
Related papers

Related papers: Optimal Spectral Transitions in High-Dimensional M…

200 papers

We study the problem of sampling a random signal with sparse support in frequency domain. Shannon famously considered a scheme that instantaneously samples the signal at equispaced times. He proved that the signal can be reconstructed as…

Information Theory · Computer Science 2012-11-22 Adel Javanmard , Andrea Montanari

The problem of learning a computational model from examples has been receiving growing attention. For the particularly challenging problem of learning models of distributed systems, existing results are restricted to models with a fixed…

Formal Languages and Automata Theory · Computer Science 2023-12-13 Dana Fisman , Noa Izsak , Swen Jacobs

Utilizing a spectral dictionary learned from a couple of similar-scene multi- and hyperspectral image, it is possible to reconstruct a desired hyperspectral image only with one single multispectral image. However, the differences between…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Xiaolin Han , Huan Zhang , Lijuan Niu , Weidong Sun

The deep image prior showed that a randomly initialized network with a suitable architecture can be trained to solve inverse imaging problems by simply optimizing it's parameters to reconstruct a single degraded image. However, it suffers…

Image and Video Processing · Electrical Eng. & Systems 2022-01-03 Zenglin Shi , Pascal Mettes , Subhransu Maji , Cees G. M. Snoek

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Magnetic resonance imaging (MRI) is known to be a slow imaging modality and undersampling in k-space has been used to increase the imaging speed. However, image reconstruction from undersampled k-space data is an ill-posed inverse problem.…

Image and Video Processing · Electrical Eng. & Systems 2019-08-08 Jing Cheng , Haifeng Wang , Leslie Ying , Dong Liang

The Hessian spectrum of trained deep networks exhibits a characteristic structure: a continuous bulk of near-zero eigenvalues and a small number of large outlier eigenvalues (spikes), confirming the relevance of Random Matrix Theory in deep…

Machine Learning · Computer Science 2026-05-19 Hugo Vigna , Samuel Bontemps

Deep neural networks can be trained in reciprocal space, by acting on the eigenvalues and eigenvectors of suitable transfer operators in direct space. Adjusting the eigenvalues, while freezing the eigenvectors, yields a substantial…

Machine Learning · Computer Science 2021-12-08 Lorenzo Chicchi , Lorenzo Giambagli , Lorenzo Buffoni , Timoteo Carletti , Marco Ciavarella , Duccio Fanelli

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

In this work we provide an analysis of the distribution of the post-adaptation parameters of Gradient-Based Meta-Learning (GBML) methods. Previous work has noticed how, for the case of image-classification, this adaptation only takes place…

Machine Learning · Computer Science 2022-10-03 Gustaf Tegnér , Alfredo Reichlin , Hang Yin , Mårten Björkman , Danica Kragic

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

In the multireference alignment model, a signal is observed by the action of a random circular translation and the addition of Gaussian noise. The goal is to recover the signal's orbit by accessing multiple independent observations. Of…

Information Theory · Computer Science 2018-11-06 Emmanuel Abbe , Tamir Bendory , William Leeb , João Pereira , Nir Sharon , Amit Singer

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

Machine Learning · Computer Science 2025-02-25 Lulu Kang , Minshen Xu

Hyperspectral unmixing is a blind source separation problem which consists in estimating the reference spectral signatures contained in a hyperspectral image, as well as their relative contribution to each pixel according to a given mixture…

Data Analysis, Statistics and Probability · Physics 2017-11-21 Pierre-Antoine Thouvenin , Nicolas Dobigeon , Jean-Yves Tourneret

We consider the problem of detecting signals in the rank-one signal-plus-noise data matrix models that generalize the spiked Wishart matrices. We show that the principal component analysis can be improved by pre-transforming the matrix…

Statistics Theory · Mathematics 2021-04-29 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

We give an overview of recent developments in the problem of reconstructing a band-limited signal from non-uniform sampling from a numerical analysis view point. It is shown that the appropriate design of the finite-dimensional model plays…

Numerical Analysis · Mathematics 2025-10-20 Thomas Strohmer

Spectral variability is one of the major issue when conducting hyperspectral unmixing. Within a given image composed of some elementary materials (herein referred to as endmember classes), the spectral signature characterizing these classes…

Image and Video Processing · Electrical Eng. & Systems 2019-06-26 Tatsumi Uezato , Mathieu Fauvel , Nicolas Dobigeon

The paper focuses on the sparse approximation of signals using overcomplete representations, such that it preserves the (prior) structure of multi-dimensional signals. The underlying optimization problem is tackled using a multi-dimensional…

Data Structures and Algorithms · Computer Science 2015-03-11 Yoann Isaac , Quentin Barthélemy , Jamal Atif , Cédric Gouy-Pailler , Michèle Sebag

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box functions. However, in settings with very few function evaluations, a successful application of BO may require transferring information from…

Machine Learning · Computer Science 2024-09-10 Aryan Deshwal , Sait Cakmak , Yuhou Xia , David Eriksson

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter