English
Related papers

Related papers: On shrinkage estimation for balanced loss function…

200 papers

With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neural network training to improve performance and efficiency…

Machine Learning · Computer Science 2024-08-16 Lukas Kirchdorfer , Cathrin Elich , Simon Kutsche , Heiner Stuckenschmidt , Lukas Schott , Jan M. Köhler

We present methods for estimating loss-based measures of the performance of a prediction model in a target population that differs from the source population in which the model was developed, in settings where outcome and covariate data are…

This paper considers the regularized estimation of covariance matrices (CM) of high-dimensional (compound) Gaussian data for minimum variance distortionless response (MVDR) beamforming. Linear shrinkage is applied to improve the accuracy…

Signal Processing · Electrical Eng. & Systems 2021-04-06 Lei Xie , Zishu He , Jun Tong , Jun Li , Jiangtao Xi

We study the convergence of $Z$-estimators $\widehat \theta(\eta)\in \mathbb R^p$ for which the objective function depends on a parameter $\eta$ that belongs to a Banach space $\mathcal H$. Our results include the uniform consistency over…

Statistics Theory · Mathematics 2015-09-16 François Portier

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

Wavelet shrinkage estimators are widely applied in several fields of science for denoising data in wavelet domain by reducing the magnitudes of empirical coefficients. In nonparametric regression problem, most of the shrinkage rules are…

Methodology · Statistics 2021-09-14 Alex Rodrigo dos Santos Sousa , Nancy Lopes Garcia

Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even…

Methodology · Statistics 2024-09-17 Hanmei Sun , Jiangshan Zhang , Jiming Jiang

The primary objective in this paper is to give an answer to an open question posed by J. A. Barcel\'o, J. M. Bennett, A. Carbery, A. Ruiz and M. C. Vilela concerning the problem of determining the optimal range on $s\geq0$ and $p\geq1$ for…

Analysis of PDEs · Mathematics 2019-07-24 Youngwoo Koh , Ihyeok Seo

We study unbiased estimation under Bregman losses and develop an extension of the classical theory of uniformly minimum variance unbiased estimators (UMVUEs). Exploiting bias--variance-type decompositions for Bregman divergences, we…

Information Theory · Computer Science 2026-05-11 Akira Kamatsuka , Shun Watanabe

A Boolean function of n bits is balanced if it takes the value 1 with probability 1/2. We exhibit a balanced Boolean function with a randomized evaluation procedure (with probability 0 of making a mistake) so that on uniformly random…

Probability · Mathematics 2012-06-21 Itai Benjamini , Oded Schramm , David B. Wilson

This paper presents a new Bayesian framework for quantifying discretization errors in numerical solutions of ordinary differential equations. By modelling the errors as random variables, we impose a monotonicity constraint on the variances,…

Numerical Analysis · Mathematics 2024-11-14 Yuto Miyatake , Kaoru Irie , Takeru Matsuda

We consider estimating the shared mean of a sequence of heavy-tailed random variables taking values in a Banach space. In particular, we revisit and extend a simple truncation-based mean estimator first proposed by Catoni and Giulini. While…

Statistics Theory · Mathematics 2025-03-25 Justin Whitehouse , Ben Chugg , Diego Martinez-Taboada , Aaditya Ramdas

Linear Mixed Effects (LME) models have been widely applied in clustered data analysis in many areas including marketing research, clinical trials, and biomedical studies. Inference can be conducted using maximum likelihood approach if…

Methodology · Statistics 2022-11-10 Hao Chen , Lanshan Han , Alvin Lim

The mean-variance model remains the most prevalent investment framework, built on diversification principles. However, it consistently struggles with estimation errors in expected returns and the covariance matrix, its core parameters. To…

Portfolio Management · Quantitative Finance 2026-01-29 Rupendra Yadav , Amita Sharma , Aparna Mehra

Data valuation quantifies data importance, but existing methods cannot ensure validity in a single training process. The neural dynamic data valuation (NDDV) method [3] addresses this limitation. Based on NDDV, we are the first to explore…

Machine Learning · Computer Science 2025-12-19 Zhangyong Liang , Huanhuan Gao , Ji Zhang

We develop a novel Empirical Bayes methodology for prediction under check loss in high-dimensional Gaussian models. The check loss is a piecewise linear loss function having differential weights for measuring the amount of underestimation…

Statistics Theory · Mathematics 2016-06-24 Gourab Mukherjee , Lawrence D. Brown , Paat Rusmevichientong

We introduce into the classical perceptron algorithm with margin a mechanism that shrinks the current weight vector as a first step of the update. If the shrinking factor is constant the resulting algorithm may be regarded as a…

Machine Learning · Computer Science 2013-02-08 Constantinos Panagiotakopoulos , Petroula Tsampouka

Multiple importance sampling estimators are widely used for computing intractable constants due to its reliability and robustness. The celebrated balance heuristic estimator belongs to this class of methods and has proved very successful in…

Computation · Statistics 2019-09-05 Felipe J Medina-Aguayo , Richard G Everitt

In this paper, we establish an optimal dual version of trace estimate involving angular regularity. Based on this estimate, we get the generalized Morawetz estimates and weighted Strichartz estimates for the solutions to a large class of…

Analysis of PDEs · Mathematics 2011-02-08 Daoyuan Fang , Chengbo Wang

Randomized experiments are the gold standard for investigating causal relationships, with comparisons of potential outcomes under different treatment groups used to estimate treatment effects. However, outcomes with heavy-tailed…

Methodology · Statistics 2024-07-09 Hongzi Li , Wei Ma , Yingying Ma , Hanzhong Liu
‹ Prev 1 8 9 10 Next ›