English
Related papers

Related papers: A taxonomy of estimator consistency on discrete es…

200 papers

Algorithmic stability is a central concept in statistics and learning theory that measures how sensitive an algorithm's output is to small changes in the training data. Stability plays a crucial role in understanding generalization,…

Statistics Theory · Mathematics 2026-01-21 Abhinav Chakraborty , Yuetian Luo , Rina Foygel Barber

Partial multi-label learning and complementary multi-label learning are two popular weakly supervised multi-label classification paradigms that aim to alleviate the high annotation costs of collecting precisely annotated multi-label data.…

Machine Learning · Computer Science 2026-02-26 Wei Wang , Tianhao Ma , Ming-Kun Xie , Gang Niu , Masashi Sugiyama

We develop a pseudo-likelihood theory for rank one matrix estimation problems in the high dimensional limit. We prove a variational principle for the limiting pseudo-maximum likelihood which also characterizes the performance of the…

Statistics Theory · Mathematics 2025-11-10 Curtis Grant , Aukosh Jagannath , Justin Ko

We consider the problem of estimating the unconditional distribution of a post-model-selection estimator. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by…

Statistics Theory · Mathematics 2007-11-08 Hannes Leeb , Benedikt M. Poetscher

The main purpose of this paper is to introduce and study the behavior of minimum {\phi}-divergence estimators as an alternative to the maximum likelihood estimator in latent class models for binary items. As it will become clear below,…

Methodology · Statistics 2014-06-03 Ángel Felipe , Pedro Miranda , Leandro Pardo

As large language models (LLMs) often generate plausible but incorrect content, error detection has become increasingly critical to ensure truthfulness. However, existing detection methods often overlook a critical problem we term as…

Computation and Language · Computer Science 2025-09-09 Hexiang Tan , Fei Sun , Sha Liu , Du Su , Qi Cao , Xin Chen , Jingang Wang , Xunliang Cai , Yuanzhuo Wang , Huawei Shen , Xueqi Cheng

Being able to reliably assess not only the \emph{accuracy} but also the \emph{uncertainty} of models' predictions is an important endeavour in modern machine learning. Even if the model generating the data and labels is known, computing the…

Machine Learning · Computer Science 2023-09-12 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

We establish the consistency of a nonparametric maximum likelihood estimator for a class of stochastic inverse problems. We proceed by embedding the framework into the general settings of early results of Pfanzagl related to mixtures.

Statistics Theory · Mathematics 2007-10-08 Djalil Chafai , Jean-Michel Loubes

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

Computational Complexity · Computer Science 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

Optimal values and solutions of empirical approximations of stochastic optimization problems can be viewed as statistical estimators of their true values. From this perspective, it is important to understand the asymptotic behavior of these…

Optimization and Control · Mathematics 2025-07-01 Johannes Milz , Thomas M. Surowiec

We present a sample- and time-efficient differentially private algorithm for ordinary least squares, with error that depends linearly on the dimension and is independent of the condition number of $X^\top X$, where $X$ is the design matrix.…

Machine Learning · Computer Science 2024-04-25 Gavin Brown , Jonathan Hayase , Samuel Hopkins , Weihao Kong , Xiyang Liu , Sewoong Oh , Juan C. Perdomo , Adam Smith

We introduce a model of estimation in the presence of strategic, self-interested sensors. We employ a game-theoretic setup to model the interaction between the sensors and the receiver. The cost function of the receiver is equal to the…

Computer Science and Game Theory · Computer Science 2015-06-26 Farhad Farokhi , Andre M. H. Teixeira , Cedric Langbort

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

Knowing when a classifier's prediction can be trusted is useful in many applications and critical for safely using AI. While the bulk of the effort in machine learning research has been towards improving classifier performance,…

Machine Learning · Statistics 2018-10-30 Heinrich Jiang , Been Kim , Melody Y. Guan , Maya Gupta

Large Language Models (LLMs) have grown increasingly powerful, yet ensuring their decisions remain transparent and trustworthy requires self-consistency -- no contradictions in their internal reasoning. Our study reveals that even on simple…

Computation and Language · Computer Science 2025-06-24 Zhenru Lin , Jiawen Tao , Yang Yuan , Andrew Chi-Chih Yao

The replication mechanism resolves some challenges with big data such as data durability, data access, and fault tolerance. Yet, replication itself gives birth to another challenge known as the consistency in distributed systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 Hesam Nejati Sharif Aldin , Hossein Deldari , Mohammad Hossein Moattar , Mostafa Razavi Ghods

Robust estimation under multivariate normal (MVN) mixture model is always a computational challenge. A recently proposed maximum pseudo \b{eta}-likelihood estimator aims to estimate the unknown parameters of a MVN mixture model in the…

Statistics Theory · Mathematics 2023-02-14 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations.

Statistics Theory · Mathematics 2019-03-22 Amadou Diadie Ba , Gane Samb Lo

Maximum likelihood estimators are often of limited practical use due to the intensive computation they require. We propose a family of alternative estimators that maximize a stochastic variation of the composite likelihood function. Each of…

Machine Learning · Computer Science 2010-03-04 Joshua V Dillon , Guy Lebanon

In most classification tasks there are observations that are ambiguous and therefore difficult to correctly label. Set-valued classifiers output sets of plausible labels rather than a single label, thereby giving a more appropriate and…

Methodology · Statistics 2018-12-27 Mauricio Sadinle , Jing Lei , Larry Wasserman