English
Related papers

Related papers: Minimax-Optimal Bounds for Detectors Based on Esti…

200 papers

The application of Compresses Sensing is a promising physical layer technology for the joint activity and data detection of signals. Detecting the activity pattern correctly has severe impact on the system performance and is therefore of…

Information Theory · Computer Science 2014-04-04 Fabian Monsees , Carsten Bockelmann , Dirk Wübben , Armin Dekorsy

Generative Artificial Intelligence (GenAI) models, with their powerful feature learning capabilities, have been applied in many fields. In mobile wireless communications, GenAI can dynamically optimize the network to enhance the user…

Signal Processing · Electrical Eng. & Systems 2025-08-27 Changyuan Zhao , Jiacheng Wang , Ruichen Zhang , Dusit Niyato , Dong In Kim , Hongyang Du

There is a known best possible upper bound on the probability of undetected error for linear codes. The $[n,k;q]$ codes with probability of undetected error meeting the bound have support of size $k$ only. In this note, linear codes of full…

Information Theory · Computer Science 2011-02-14 Torleiv Kløve , Jinquan Luo

We analyze the local Rademacher complexity of empirical risk minimization (ERM)-based multi-label learning algorithms, and in doing so propose a new algorithm for multi-label learning. Rather than using the trace norm to regularize the…

Machine Learning · Statistics 2014-10-28 Chang Xu , Tongliang Liu , Dacheng Tao , Chao Xu

A detection system with a single sensor and $\mathsf{K}$ detectors is considered, where each of the terminals observes a memoryless source sequence and the sensor sends a common message to all the detectors. The communication of this…

Information Theory · Computer Science 2018-05-17 Pierre Escamilla , Michèle Wigger , Abdellatif Zaidi

Community detection is one of the fundamental problems of network analysis, for which a number of methods have been proposed. Most model-based or criteria-based methods have to solve an optimization problem over a discrete set of labels to…

Machine Learning · Statistics 2015-05-12 Can M. Le , Elizaveta Levina , Roman Vershynin

This paper studies task adaptive pre-trained model selection, an underexplored problem of assessing pre-trained models for the target task and select best ones from the model zoo \emph{without fine-tuning}. A few pilot works addressed the…

Machine Learning · Computer Science 2021-06-24 Kaichao You , Yong Liu , Jianmin Wang , Mingsheng Long

The estimation of the probability of rare events is an important task in reliability and risk assessment. We consider failure events that are expressed in terms of a limit-state function, which depends on the solution of a partial…

Numerical Analysis · Mathematics 2021-06-21 Fabian Wagner , Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

The predictive normalized maximum likelihood (pNML) approach has recently been proposed as the min-max optimal solution to the batch learning problem where both the training set and the test data feature are individuals, known sequences.…

Machine Learning · Computer Science 2020-11-23 Yaniv Fogel , Tal Shapira , Meir Feder

The Expected Calibration Error (ece), the dominant calibration metric in machine learning, compares predicted probabilities against empirical frequencies of binary outcomes. This is appropriate when labels are binary events. However, many…

Machine Learning · Computer Science 2026-03-17 Michael Leznik

Labeling bias arises during data collection due to resource limitations or unconscious bias, leading to unequal label error rates across subgroups or misrepresentation of subgroup prevalence. Most fairness constraints assume training labels…

Machine Learning · Computer Science 2026-02-24 Frida Jørgensen , Nina Weng , Siavash Bigdeli

We study the problem of causal structure learning over a set of random variables when the experimenter is allowed to perform at most $M$ experiments in a non-adaptive manner. We consider the optimal learning strategy in terms of minimizing…

Machine Learning · Computer Science 2017-03-01 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash

Within the realm of rapidly advancing wireless sensor networks (WSNs), distributed detection assumes a significant role in various practical applications. However, critical challenge lies in maintaining robust detection performance while…

Information Theory · Computer Science 2024-04-02 Wei Guo , Meng He , Chuan Huang , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

This study focuses on the estimation of the Emax dose-response model, a widely utilized framework in clinical trials, agriculture, and environmental experiments. Existing challenges in obtaining maximum likelihood estimates (MLE) for model…

Methodology · Statistics 2025-06-11 Giacomo Aletti , Nancy Flournoy , Caterina May , Chiara Tommasi

In Ruckdeschel[10], we derive an asymptotic expansion of the maximal mean squared error (MSE) of location M-estimators on suitably thinned out, shrinking gross error neighborhoods. In this paper, we compile several consequences of this…

Statistics Theory · Mathematics 2010-06-02 Peter Ruckdeschel

Adversarial examples pose a security threat to many critical systems built on neural networks. Given that deterministic robustness often comes with significantly reduced accuracy, probabilistic robustness (i.e., the probability of having…

Machine Learning · Computer Science 2024-05-27 Ruihan Zhang , Jun Sun

We establish risk bounds for Regularized Empirical Risk Minimizers (RERM) when the loss is Lipschitz and convex and the regularization function is a norm. In a first part, we obtain these results in the i.i.d. setup under subgaussian…

Statistics Theory · Mathematics 2021-01-07 Geoffrey Chinot , Guillaume Lecué , Matthieu Lerasle

We give an asymptotic development of the maximum likelihood estimator (MLE), or any other estimator defined implicitly, in a way which involves the limiting behavior of the score and its higher-order derivatives. This development, which is…

Statistics Theory · Mathematics 2024-04-10 Antoine Lejay , Sara Mazzonetto

Location estimation is a central problem in functional data analysis. In this paper, we investigate penalized spline estimators of location for discretely sampled functional data under a broad class of convex loss functions. Our framework…

Methodology · Statistics 2025-08-19 Ioannis Kalogridis

We consider the problem of estimating a $d$-dimensional discrete distribution from its samples observed under a $b$-bit communication constraint. In contrast to most previous results that largely focus on the global minimax error, we study…

Information Theory · Computer Science 2021-11-02 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür