English
Related papers

Related papers: Classification and Regression Error Bounds for Inh…

200 papers

Information divergence functions play a critical role in statistics and information theory. In this paper we show that a non-parametric f-divergence measure can be used to provide improved bounds on the minimum binary classification…

Information Theory · Computer Science 2015-02-11 Visar Berisha , Alan Wisler , Alfred O. Hero , Andreas Spanias

Our main focus is on the generalization bound, which serves as an upper limit for the generalization error. Our analysis delves into regression and classification tasks separately to ensure a thorough examination. We assume the target…

Machine Learning · Statistics 2024-07-30 Wen-Liang Hwang

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…

Information Theory · Computer Science 2024-09-24 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

In this paper, a lower bound on the capacity of wireless ad hoc erasure networks is derived in closed form in the canonical case where $n$ nodes are uniformly and independently distributed in the unit area square. The bound holds almost…

Information Theory · Computer Science 2009-01-15 Rayyan G. Jaber , Jeffrey G. Andrews

The problem of distributed dynamic state estimation in wireless sensor networks is studied. Two important properties of local estimates, namely, the consistency and confidence, are emphasized. On one hand, the consistency, which means that…

Information Theory · Computer Science 2016-11-15 Shaocheng Wang , Wei Ren

Robustness and generalization ability of machine learning models are of utmost importance in various application domains. There is a wide interest in efficient ways to analyze those properties. One important direction is to analyze…

Machine Learning · Computer Science 2025-04-29 Khoat Than , Dat Phan , Giang Vu

We investigate the secure connectivity of wireless sensor networks under a heterogeneous random key predistribution scheme and a heterogeneous channel model. In particular, we study a random graph formed by the intersection of an…

Information Theory · Computer Science 2017-01-05 Rashad Eletreby , Osman Yağan

Regression evaluation has been performed for decades. Some metrics have been identified to be robust against shifting and scaling of the data but considering the different distributions of data is much more difficult to address (imbalance…

Machine Learning · Computer Science 2020-09-14 Mario Michael Krell , Bilal Wehbe

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

The degree heterogeneity and homophily are two typical features in network data. In this paper, we formulate a general model for undirected networks with these two features and present the moment estimation for inferring the degree and…

Methodology · Statistics 2019-10-08 Ting Yan

We probabilistically bound the error of a solution to a radial network topology learning problem where both connectivity and line parameters are estimated. In our model, data errors are introduced by the precision of the sensors, i.e.,…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Samuel Talkington , Aditya Rangarajan , Pedro A. de Alcântara , Line Roald , Daniel K. Molzahn , Daniel R. Fuhrmann

Synchronization is a key functionality in wireless network, enabling a wide variety of services. We consider a Bayesian inference framework whereby network nodes can achieve phase and skew synchronization in a fully distributed way. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Bernhard Etzlinger , Henk Wymeersch , Andreas Springer

This work takes a critical look at the application of conventional machine learning methods to wireless communication problems through the lens of reliability and robustness. Deep learning techniques adopt a frequentist framework, and are…

Machine Learning · Computer Science 2022-07-04 Matteo Zecchin , Sangwoo Park , Osvaldo Simeone , Marios Kountouris , David Gesbert

We address the problem of timing-based localization in wireless networks, when an unknown fraction of data is corrupted by nonideal signal conditions. While timing-based techniques enable accurate localization, they are also sensitive to…

Information Theory · Computer Science 2021-09-29 Muhammad Osama , Dave Zachariah , Satyam Dwivedi , Petre Stoica

A central problem in the operation of large wireless networks is how to deal with interference -- the unwanted signals being sent by transmitters that a receiver is not interested in. This thesis looks at ways of combating such…

Information Theory · Computer Science 2011-09-07 Matthew Aldridge

In this paper, we aim to design and analyze distributed Bayesian estimation algorithms for sensor networks. The challenges we address are to (i) derive a distributed provably-correct algorithm in the functional space of probability…

Machine Learning · Computer Science 2025-03-25 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

This paper develops a general asymptotic theory for nonparametric kernel regression in the presence of cluster dependence. We examine nonparametric density estimation, Nadaraya-Watson kernel regression, and local linear estimation. Our…

Econometrics · Economics 2024-12-31 Yuya Shimizu

In the emerging paradigm of edge learning, neural networks (NNs) are partitioned across distributed edge devices that collaboratively perform inference via wireless transmission. However, deploying NNs for edge inference over wireless…

Information Theory · Computer Science 2026-05-08 Yangshuo He , Guanding Yu , Jingge Zhu

In this paper, we study Dirac-type theorems for an inhomogenous random graph (G) whose edge probabilities are not necessarily all the same. We obtain sufficient conditions for the existence of Hamiltonian paths and perfect matchings, in…

Probability · Mathematics 2024-04-04 Ghurumuruhan Ganesan