English
Related papers

Related papers: Nonparametric Mean and Variance Adaptive Classific…

200 papers

Federated learning (FL) has been a promising approach in the field of medical imaging in recent years. A critical problem in FL, specifically in medical scenarios is to have a more accurate shared model which is robust to noisy and out-of…

Machine Learning · Computer Science 2020-08-19 Yousef Yeganeh , Azade Farshad , Nassir Navab , Shadi Albarqouni

We present a randomized Kaczmarz method for linear discriminant analysis (rkLDA), an iterative randomized approach to binary-class Gaussian model linear discriminant analysis (LDA) for very large data. We harness a least squares formulation…

Computation · Statistics 2025-01-09 Jocelyn T. Chi , Deanna Needell

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Evaluating the performance of large language models (LLMs) from human preference data is crucial for obtaining LLM leaderboards. However, many existing approaches either rely on restrictive parametric assumptions or lack valid uncertainty…

Machine Learning · Computer Science 2026-01-30 Dennis Frauen , Athiya Deviyani , Mihaela van der Schaar , Stefan Feuerriegel

We introduce a generic class of dynamic nonlinear heterogeneous parameter models that incorporate individual and time fixed effects in both the intercept and slope. These models are subject to the incidental parameter problem, in that the…

Econometrics · Economics 2026-01-27 Xuan Leng , Jiaming Mao , Yutao Sun

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

This paper proposes a new method for estimating high-dimensional binary choice models. We consider a semiparametric model that places no distributional assumptions on the error term, allows for heteroskedastic errors, and permits endogenous…

Econometrics · Economics 2025-07-15 Fu Ouyang , Thomas Tao Yang

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

Maximum Mean Discrepancy (MMD) is widely used in a number of domain adaptation (DA) methods and shows its effectiveness in aligning data distributions across domains. However, in previous DA research, MMD-based DA methods focus mostly on…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Lingkun Luo , Shiqiang Hu , Jie Yang , Liming Chen

We design an $(\varepsilon, \delta)$-differentially private algorithm to estimate the mean of a $d$-variate distribution, with unknown covariance $\Sigma$, that is adaptive to $\Sigma$. To within polylogarithmic factors, the estimator…

Machine Learning · Statistics 2023-01-18 John Duchi , Saminul Haque , Rohith Kuditipudi

Asymmetry along with heteroscedasticity or contamination often occurs with the growth of data dimensionality. In ultra-high dimensional data analysis, such irregular settings are usually overlooked for both theoretical and computational…

Statistics Theory · Mathematics 2022-07-20 Bin Luo , Xiaoli Gao

Consider the nonparametric logistic regression problem. In the logistic regression, we usually consider the maximum likelihood estimator, and the excess risk is the expectation of the Kullback-Leibler (KL) divergence between the true and…

Statistics Theory · Mathematics 2025-02-26 Atsutomo Yara , Yoshikazu Terada

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

The nested error regression model is a useful tool for analyzing clustered (grouped) data, and is especially used in small area estimation. The classical nested error regression model assumes normality of random effects and error terms, and…

Methodology · Statistics 2016-05-16 Shonosuke Sugasawa , Tatsuya Kubokawa

Remote sensing image classification exploiting multiple sensors is a very challenging problem: data from different modalities are affected by spectral distortions and mis-alignments of all kinds, and this hampers re-using models built for…

Signal Processing · Electrical Eng. & Systems 2020-12-09 Devis Tuia , Diego Marcos , Gustau Camps-Valls

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

In practical applications, one often does not know the "true" structure of the underlying conditional quantile function, especially in the ultra-high dimensional setting. To deal with ultra-high dimensionality, quantile-adaptive marginal…

Methodology · Statistics 2024-04-26 Daoji Li , Yinfei Kong , Dawit Zerom

The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that…

Methodology · Statistics 2022-10-11 Bowen Gang , Yuantao Shi , Wenguang Sun

Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer…

Machine Learning · Computer Science 2026-05-07 Andrea Napoli , Paul White

We propose a new sufficient dimension reduction approach designed deliberately for high-dimensional classification. This novel method is named maximal mean variance (MMV), inspired by the mean variance index first proposed by Cui, Li and…

Methodology · Statistics 2018-12-11 Xin Chen , Jingjing Wu , Zhigang Yao , Jia Zhang