English
Related papers

Related papers: Error Bounds for Radial Network Topology Learning …

200 papers

We consider the problem of error control in a coded, multicast network, focusing on the scenario where the errors can occur only on a proper subset of the network edges. We model this problem via an adversarial noise, presenting a formal…

Information Theory · Computer Science 2022-05-31 Allison Beemer , Altan Berdan Kilic , Alberto Ravagnani

Self-supervised representation learning follows a paradigm of withholding some part of the data and tasking the network to predict it from the remaining part. Among many techniques, data augmentation lies at the core for creating the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Huimin Wu , Chenyang Lei , Xiao Sun , Peng-Shuai Wang , Qifeng Chen , Kwang-Ting Cheng , Stephen Lin , Zhirong Wu

Introducing quantum sensors as solution to real-world problem demands reliability and controllability outside laboratory conditions. Producers and operators ought to be assumed to have limited resources ready available for calibration, and…

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the…

Machine Learning · Computer Science 2018-01-16 Ankit Pensia , Varun Jog , Po-Ling Loh

We present a binary classifier based on neural networks to detect gapped quantum phases. By considering the errors on top of a suitable reference state describing the gapped phase, we show that a neural network trained on the errors can…

Quantum Physics · Physics 2023-03-08 Amit Jamadagni , Javad Kazemi , Hendrik Weimer

Recent efforts to obtain high data rates in wireless systems have focused on what can be achieved in systems that have nonlinear or coarsely quantized transceiver architectures. Estimating the channel in such a system is challenging because…

Information Theory · Computer Science 2019-12-17 Kang Gao , J. Nicholas Laneman , N. J. Estes , Jonathan Chisum , Bertrand Hochwald

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

We show generalisation error bounds for deep learning with two main improvements over the state of the art. (1) Our bounds have no explicit dependence on the number of classes except for logarithmic factors. This holds even when formulating…

Machine Learning · Computer Science 2021-02-23 Antoine Ledent , Waleed Mustafa , Yunwen Lei , Marius Kloft

This work addressed the problem of learning a network with communication between vertices. The communication between vertices is presented in the form of perturbation on the measure. We studied the scenario where samples are drawn from a…

Machine Learning · Statistics 2021-11-23 Yihan He

In this paper, we derive upper bounds on generalization errors for deep neural networks with Markov datasets. These bounds are developed based on Koltchinskii and Panchenko's approach for bounding the generalization error of combined…

Machine Learning · Statistics 2022-10-13 Lan V. Truong

Line spectral estimation is a classical signal processing problem that aims to estimate the line spectra from their signal which is contaminated by deterministic or random noise. Despite a large body of research on this subject, the…

Information Theory · Computer Science 2020-10-15 Ping Liu , Hai Zhang

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

In this paper, a lower bound on the capacity of wireless ad hoc erasure networks is derived in closed form in the canonical case where $n$ nodes are uniformly and independently distributed in the unit area square. The bound holds almost…

Information Theory · Computer Science 2009-01-15 Rayyan G. Jaber , Jeffrey G. Andrews

The detection and estimation of sinusoids is a fundamental signal processing task for many applications related to sensing and communications. While algorithms have been proposed for this setting, quantization is a critical, but often…

Signal Processing · Electrical Eng. & Systems 2022-10-05 Ryan Dreifuerst , Robert W. Heath

Frequency estimation from measurements corrupted by noise is a fundamental challenge across numerous engineering and scientific fields. Among the pivotal factors shaping the resolution capacity of any frequency estimation technique are…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Sampath Kumar Dondapati , Omkar Nitsure , Satish Mulleti

The derivation of ultimate limits to communication over certain quantum repeater networks have provided extremely valuable benchmarks for assessing near-term quantum communication protocols. However, these bounds are usually derived in the…

Quantum Physics · Physics 2022-06-02 Riccardo Laurenza , Nathan Walk , Jens Eisert , Stefano Pirandola

Many algorithms have been recently proposed for causal machine learning. Yet, there is little to no theory on their quality, especially considering finite samples. In this work, we propose a theory based on generalization bounds that…

Machine Learning · Statistics 2024-05-16 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Overfitting data is a well-known phenomenon related with the generation of a model that mimics too closely (or exactly) a particular instance of data, and may therefore fail to predict future observations reliably. In practice, this…

Machine Learning · Statistics 2023-04-14 Matias Vera , Leonardo Rey Vega , Pablo Piantanida

Feedforward neural networks with random hidden nodes suffer from a problem with the generation of random weights and biases as these are difficult to set optimally to obtain a good projection space. Typically, random parameters are drawn…

Machine Learning · Computer Science 2019-09-18 Grzegorz Dudek