English
Related papers

Related papers: On information plus noise kernel random matrices

200 papers

This paper introduces Kernel-based Information Criterion (KIC) for model selection in regression analysis. The novel kernel-based complexity measure in KIC efficiently computes the interdependency between parameters of the model using a…

Machine Learning · Statistics 2014-12-16 Somayeh Danafar , Kenji Fukumizu , Faustino Gomez

This paper investigates properties of noisy quantum information channels. We define a new quantity called {\em coherent information} which measures the amount of quantum information conveyed in the noisy channel. This quantity can never be…

Quantum Physics · Physics 2009-10-30 Benjamin Schumacher , M. A. Nielsen

Kernel mean embedding is a useful tool to represent and compare probability measures. Despite its usefulness, kernel mean embedding considers infinite-dimensional features, which are challenging to handle in the context of differentially…

Machine Learning · Computer Science 2022-06-24 Margarita Vinaroz , Mohammad-Amin Charusaie , Frederik Harder , Kamil Adamczewski , Mijung Park

Standard kernels such as Mat\'ern or RBF kernels only encode simple monotonic dependencies within the input space. Spectral mixture kernels have been proposed as general-purpose, flexible kernels for learning and discovering more…

Machine Learning · Computer Science 2018-11-28 Sami Remes , Markus Heinonen , Samuel Kaski

Efficient simulation of stochastic partial differential equations (SPDE) on general domains requires noise discretization. This paper employs piecewise linear interpolation of noise in a fully discrete finite element approximation of a…

Numerical Analysis · Mathematics 2024-10-22 Gabriel Lord , Andreas Petersson

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

An open challenge in the context of quantum information processing and communication is improving the robustness of quantum information to environmental contributions of noise, a severe hindrance in real-world scenarios. Here, we show that…

Quantum Physics · Physics 2024-08-30 Pedro Ornelas , Isaac Nape , Robert De Mello Koch , Andrew Forbes

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

In signal analysis and synthesis, linear approximation theory considers a linear decomposition of any given signal in a set of atoms, collected into a so-called dictionary. Relevant sparse representations are obtained by relaxing the…

Information Theory · Computer Science 2014-11-04 Paul Honeine

A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal; for example, a video of a chaotic pendulums system. Assuming that we know the dynamical model up to some unknown parameters, can we estimate the…

Machine Learning · Statistics 2021-11-24 Ofir Lindenbaum , Amir Sagiv , Gal Mishne , Ronen Talmon

Noise sources unavoidably affect any quantum technological device. Noise's main features are expected to strictly depend on the physical platform on which the quantum device is realized, in the form of a distinguishable fingerprint. Noise…

Quantum Physics · Physics 2022-04-04 Stefano Martina , Lorenzo Buffoni , Stefano Gherardini , Filippo Caruso

We consider problem of signal detection in Gaussian white noise. Test statistics are linear combinations of squares of estimators of Fourier coefficients or $\mathbb{L}_2$-norms of kernel estimators. We point out necessary and sufficient…

Statistics Theory · Mathematics 2022-07-21 Mikhail Ermakov

Low-rank approximation of kernels is a fundamental mathematical problem with widespread algorithmic applications. Often the kernel is restricted to an algebraic variety, e.g., in problems involving sparse or low-rank data. We show that…

Machine Learning · Computer Science 2023-10-02 Jason M. Altschuler , Pablo A. Parrilo

Noisy quantum channels may be used in many information carrying applications. We show that different applications may result in different channel capacities. Upper bounds on several of these capacities are proved. These bounds are based on…

Quantum Physics · Physics 2009-10-30 Howard Barnum , M. A. Nielsen , Benjamin Schumacher

This paper has two messages. First, we demonstrate that neural networks that process noisy data can learn to exploit, when available, access to auxiliary noise that is correlated with the noise on the data. In effect, the network learns to…

Quantum Physics · Physics 2020-09-17 Aida Ahmadzadegan , Petar Simidzija , Ming Li , Achim Kempf

In data science, individual observations are often assumed to come independently from an underlying probability space. Kernel matrices formed from large sets of such observations arise frequently, for example during classification tasks. It…

Machine Learning · Statistics 2026-05-27 Mikhail Lepilov

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

This paper studies the statistical complexity of kernel hyperparameter tuning in the setting of active regression under adversarial noise. We consider the problem of finding the best interpolant from a class of kernels with unknown…

Machine Learning · Computer Science 2020-06-16 Raphael A. Meyer , Christopher Musco

Bursts of images exhibit significant self-similarity across both time and space. This motivates a representation of the kernels as linear combinations of a small set of basis elements. To this end, we introduce a novel basis prediction…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Zhihao Xia , Federico Perazzi , Michaël Gharbi , Kalyan Sunkavalli , Ayan Chakrabarti

We consider the high-dimensional inference problem where the signal is a low-rank matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large dimension…

Probability · Mathematics 2018-06-01 Léo Miolane
‹ Prev 1 8 9 10 Next ›