English
Related papers

Related papers: A prediction criterion for working correlation str…

200 papers

Penalized likelihood and quasi-likelihood methods dominate inference in high-dimensional linear mixed-effects models. Sampling-based Bayesian inference is less explored due to the computational bottlenecks introduced by the random effects…

Methodology · Statistics 2025-07-24 Sreya Sarkar , Kshitij Khare , Sanvesh Srivastava

The use of cumulative incidence functions for characterizing the risk of one type of event in the presence of others has become increasingly popular over the past decade. The problems of modeling, estimation and inference have been treated…

Methodology · Statistics 2021-06-25 Youngjoo Cho , Annette M. Molinaro , Chen Hu , Robert L. Strawderman

Although linear classifiers are one of the oldest methods in machine learning, they are still very popular in the machine learning community. This is due to their low computational complexity and robustness to overfitting. Consequently,…

Machine Learning · Computer Science 2022-03-29 Pawel Trajdos , Robert Burduk

The generalized Ridge penalty is a powerful tool for dealing with overfitting and for high-dimensional regressions. The generalized Ridge regression can be derived as the mean of a posterior distribution with a Normal prior and a given…

Methodology · Statistics 2022-08-10 Said Obakrim , Pierre Ailliot , Valérie Monbet , Nicolas Raillard

Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological…

Methodology · Statistics 2021-12-07 Solmaz Seifollahi , Kaniav Kamary , Hossein Bevrani

Shape constrained regression analysis has applications in dose-response modeling, environmental risk assessment, disease screening and many other areas. Incorporating the shape constraints can improve estimation efficiency and avoid…

Methodology · Statistics 2013-06-19 Lizhen Lin , David B. Dunson

We propose information criteria that measure the prediction risk of a predictive density based on the Bayesian marginal likelihood from a frequentist point of view. We derive criteria for selecting variables in linear regression models,…

Methodology · Statistics 2017-10-20 Yuki Kawakubo , Tatsuya Kubokawa , Muni S. Srivastava

In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the…

Statistics Theory · Mathematics 2017-09-07 Bahadır Yüzbaşı , Yasin Asar , M. Şamil Şık , Ahmet Demiralp

The minimum error entropy (MEE) criterion has been verified as a powerful approach for non-Gaussian signal processing and robust machine learning. However, the implementation of MEE on robust classification is rather a vacancy in the…

Machine Learning · Computer Science 2025-08-07 Yuanhao Li , Badong Chen , Natsue Yoshimura , Yasuharu Koike

Multi-period cluster randomized trials (CRTs) are increasingly used for the evaluation of interventions delivered at the group level. While generalized estimating equations (GEE) are commonly used to provide population-averaged inference in…

Computation · Statistics 2022-05-31 Ying Zhang , John S. Preisser , Fan Li , Elizabeth L. Turner , Paul J. Rathouz

We consider component-wise estimation of order restricted location/scale parameters $\theta_1$ and $\theta_2$ ($\theta_1\leq \theta_2$) of a general bivariate distribution under the squared error loss function. To find improvements over the…

Statistics Theory · Mathematics 2022-07-05 Naresh Garg , Neeraj Misra

Computing expected information gain (EIG) from prior to posterior (equivalently, mutual information between candidate observations and model parameters or other quantities of interest) is a fundamental challenge in Bayesian optimal…

Methodology · Statistics 2026-01-30 Fengyi Li , Ricardo Baptista , Youssef Marzouk

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

Methodology · Statistics 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

Principal Component Analysis (PCA) is a widely used technique in exploratory data analysis, visualization, and data preprocessing, leveraging the concept of variance to identify key dimensions in datasets. In this study, we focus on the…

Applications · Statistics 2024-07-03 Reza Dastranj , Martin Kolar

This note examines the behavior of generalization capabilities - as defined by out-of-sample mean squared error (MSE) - of Linear Gaussian (with a fixed design matrix) and Linear Least Squares regression. Particularly, we consider a…

Statistics Theory · Mathematics 2021-09-21 Karthik Duraisamy

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

Gaussian Graphical Models (GGM) are often used to describe the conditional correlations between the components of a random vector. In this article, we compare two families of GGM inference methods: nodewise edge selection and penalised…

This paper describes the RRMSE (Relative Root Mean Square Error) based weights to weight the occurrences of predictive values before averaging for the ensemble voting regression. The core idea behind ensemble regression is to combine…

Machine Learning · Computer Science 2022-07-12 Shikun Chen , Nguyen Manh Luc

Aims: To propose a general sample size framework for developing or updating a clinical prediction model using any statistical or machine learning method, based on drawing samples from anticipated posterior distributions and targeting…

Graphical models are a framework for representing and exploiting prior conditional independence structures within distributions using graphs. In the Gaussian case, these models are directly related to the sparsity of the inverse covariance…

Statistics Theory · Mathematics 2015-10-28 Ami Wiesel , Yonina C. Eldar , Alfred O. Hero