English
Related papers

Related papers: Expected Validation Performance and Estimation of …

200 papers

We consider the problem of sequentially learning to estimate, in the mean squared error (MSE) sense, a Gaussian $K$-vector of unknown covariance by observing only $m < K$ of its entries in each round. We propose two MSE estimators, and…

Machine Learning · Computer Science 2025-05-05 Ayon Ghosh , L. A. Prashanth , Dipayan Sen , Aditya Gopalan

In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as…

Signal Processing · Electrical Eng. & Systems 2024-08-23 Michael Baur , Benedikt Fesl , Wolfgang Utschick

Large language models (LLMs) have achieved remarkable success in a wide range of tasks. However, their reasoning capabilities, particularly in complex domains like mathematics, remain a significant challenge. Value-based process verifiers,…

Artificial Intelligence · Computer Science 2026-01-28 Zetian Sun , Dongfang Li , Baotian Hu , Min Zhang

Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance…

Machine Learning · Computer Science 2020-03-25 Jiaming Song , Stefano Ermon

The problem of reducing the bias of maximum likelihood estimator in a general multivariate elliptical regression model is considered. The model is very flexible and allows the mean vector and the dispersion matrix to have parameters in…

Statistics Theory · Mathematics 2016-02-01 Tatiane F. N. Melo , Silvia L. P. Ferrari , Alexandre G. Patriota

The ability to rigorously estimate the failure rates of large language models (LLMs) is a prerequisite for their safe deployment. Currently, however, practitioners often face a tradeoff between expensive human gold standards and potentially…

Computation and Language · Computer Science 2026-04-07 Minghe Shen , Ananth Balashankar , Adam Fisch , David Madras , Miguel Rodrigues

A two-stage adaptive optimal design is an attractive option for increasing the efficiency of clinical trials. In these designs, based on interim data, the locally optimal dose is chosen for further exploration, which induces dependencies…

Methodology · Statistics 2019-05-24 Zhantao Lin , Nancy Flournoy , William F. Rosenberger

This paper studies predictor functions motivated by maximizing a measure of agreement with the predictand. Specifically, it examines distributional properties and predictive performance of the estimated maximum agreement linear predictor…

We propose to utilize a variational autoencoder (VAE) for data-driven channel estimation. The underlying true and unknown channel distribution is modeled by the VAE as a conditional Gaussian distribution in a novel way, parameterized by the…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Michael Baur , Benedikt Fesl , Michael Koller , Wolfgang Utschick

This paper considers the Liu estimator in the multinomial logistic regression model. We propose some different estimators of the biasing parameter. The mean square error (MSE) is considered as the performance criterion. In order to compare…

Methodology · Statistics 2021-11-08 Yasin Asar , Murat Erişoğlu

We consider an expected-value ranking and selection (R&S) problem where all k solutions' simulation outputs depend on a common parameter whose uncertainty can be modeled by a distribution. We define the most probable best (MPB) to be the…

Methodology · Statistics 2024-04-23 Taeho Kim , Kyoung-kuk Kim , Eunhye Song

Objectives: Highly flexible nonparametric estimators have gained popularity in causal inference and epidemiology. Popular examples of such estimators include targeted maximum likelihood estimators (TMLE) and double machine learning (DML).…

Methodology · Statistics 2024-08-20 Hongxiang Qiu

In this paper, two types of linear estimators are considered for three related estimation problems involving set-theoretic uncertainty pertaining to $\mathcal{H}_{2}$ and $\mathcal{H}_{\infty}$ balls of frequency-responses. The problems at…

Systems and Control · Electrical Eng. & Systems 2022-01-11 Gilberto O. Corrêa , Marlon M. López-Flores

The maximum mean discrepancy (MMD) is a kernel-based distance between probability distributions useful in many applications (Gretton et al. 2012), bearing a simple estimator with pleasing computational and statistical properties. Being able…

Machine Learning · Statistics 2022-11-16 Danica J. Sutherland , Namrata Deka

The lasso has been studied extensively as a tool for estimating the coefficient vector in the high-dimensional linear model; however, considerably less is known about estimating the error variance in this context. In this paper, we propose…

Methodology · Statistics 2019-07-22 Guo Yu , Jacob Bien

Estimating the expected output quality of generation systems is central to NLG. This paper qualifies the notion that automatic metrics are not as good as humans in estimating system-level quality. Statistically, humans are unbiased, high…

Computation and Language · Computer Science 2024-12-17 Johnny Tian-Zheng Wei , Robin Jia

For linear models that may have asymmetric errors, we study variable selection by cross-validation. The data are split into training and validation sets, with the number of observations in the validation set much larger than in the training…

Methodology · Statistics 2026-01-16 Bilel Bousselmi , Gabriela Ciuperca

The minimum mean-squared error (MMSE) is one of the most popular criteria for Bayesian estimation. Conversely, the signal-to-noise ratio (SNR) is a typical performance criterion in communications, radar, and generally detection theory. In…

Information Theory · Computer Science 2016-10-12 Luca Rugini , Paolo Banelli

The fundamental task of a digital receiver is to decide the transmitted symbols in the best possible way, i.e., with respect to an appropriately defined performance metric. Examples of usual performance metrics are the probability of error…

Information Theory · Computer Science 2013-03-19 Dimitrios Katselis , Cristian R. Rojas , Håkan Hjalmarsson , Mats Bengtsson , Mikael Skoglund

The bias of an estimator is defined as the difference of its expected value from the parameter to be estimated, where the expectation is with respect to the model. Loosely speaking, small bias reflects the desire that if an experiment is…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis