English
Related papers

Related papers: Reduction of Restricted Maximum Likelihood for Ran…

200 papers

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

Multivariate random effects with unstructured variance-covariance matrices of large dimensions, $q$, can be a major challenge to estimate. In this paper, we introduce a new implementation of a reduced-rank approach to fit large dimensional…

Methodology · Statistics 2024-11-08 Maeve McGillycuddy , Gordana Popovic , Benjamin M. Bolker , David I. Warton

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

In the present work, we have investigated the problem of estimating parameters of several exponential distributions with ordered scale parameters under the linex loss function. We have considered estimating ordered scale parameters when the…

Statistics Theory · Mathematics 2023-02-08 Suchandan Kayal , Lakshmi Kanta Patra

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

This paper proves, in very general settings, that convex risk minimization is a procedure to select a unique conditional probability model determined by the classification problem. Unlike most previous work, we give results that are general…

Machine Learning · Computer Science 2015-06-16 Matus Telgarsky , Miroslav Dudík , Robert Schapire

We propose a new method for multivariate response regression and covariance estimation when elements of the response vector are of mixed types, for example some continuous and some discrete. Our method is based on a model which assumes the…

Methodology · Statistics 2022-03-04 Karl Oskar Ekvall , Aaron J. Molstad

Consider the communication-constrained estimation of discrete distributions under $\ell^p$ losses, where each distributed terminal holds multiple independent samples and uses limited number of bits to describe the samples. We obtain the…

Machine Learning · Computer Science 2024-11-11 Deheng Yuan , Tao Guo , Zhongyi Huang

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi

This paper deals with a situation when one is interested in the dependence structure of a multidimensional response variable in the presence of a multivariate covariate. It is assumed that the covariate affects only the marginal…

Statistics Theory · Mathematics 2019-03-12 Marek Omelka , Šárka Hudecová , Natalie Neumeyer

The random coefficients model $Y_i={\beta_0}_i+{\beta_1}_i {X_1}_i+{\beta_2}_i {X_2}_i+\ldots+{\beta_d}_i {X_d}_i$, with $\mathbf{X}_i$, $Y_i$, $\mathbf{\beta}_i$ i.i.d, and $\mathbf{\beta}_i$ independent of $X_i$ is often used to capture…

Methodology · Statistics 2021-08-17 Fabian Dunker , Emil Mendoza , Marco Reale

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile method to estimate rare events probabilities. It is an iterative procedure on an interacting particle system, where at each step, the $k$ less well-adapted…

Probability · Mathematics 2014-05-07 Charles-Edouard Bréhier , Tony Lelievre , Mathias Rousset

Elliptically symmetric distributions are widely used in portfolio modeling, as well as in signal processing applications for modeling impulsive background noises. Of particular interest are algorithms for covariance estimation and subspace…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

A discrete statistical model is a subset of a probability simplex. Its maximum likelihood estimator (MLE) is a retraction from that simplex onto the model. We characterize all models for which this retraction is a rational function. This is…

Statistics Theory · Mathematics 2020-06-16 Eliana Duarte , Orlando Marigliano , Bernd Sturmfels

This paper presents a novel estimation approach for cumulative link models, based on median bias reduction as developed in Kenne Pagui et al. (2017). The median bias reduced estimator is obtained as solution of an estimating equation based…

Methodology · Statistics 2020-09-16 Vincenzo Gioia , Euloge Clovis Kenne Pagui , Alessandra Salvan

Robust estimators for generalized linear models (GLMs) are not easy to develop due to the nature of the distributions involved. Recently, there has been growing interest in robust estimation methods, particularly in contexts involving a…

Methodology · Statistics 2025-07-08 Marina Valdora , Claudio Agostinelli

Cox proportional hazard regression model is a popular tool to analyze the relationship between a censored lifetime variable with other relevant factors. The semi-parametric Cox model is widely used to study different types of data arising…

Methodology · Statistics 2018-10-09 Abhik Ghosh , Ayanendranath Basu

In this work we investigate to which extent one can recover class probabilities within the empirical risk minimization (ERM) paradigm. The main aim of our paper is to extend existing results and emphasize the tight relations between…

Machine Learning · Computer Science 2020-07-22 Alexander Mey , Marco Loog

The Rasch model has been widely used to analyse item response data in psychometrics and educational assessments. When the number of individuals and items are large, it may be impractical to provide all possible responses. It is desirable to…

Statistics Theory · Mathematics 2025-01-15 Pai Peng , Lianqiang Qu , Qiuping Wang , Shufang Wang , Ting Yan

Moment restrictions and their conditional counterparts emerge in many areas of machine learning and statistics ranging from causal inference to reinforcement learning. Estimators for these tasks, generally called methods of moments, include…

Machine Learning · Computer Science 2023-06-14 Heiner Kremer , Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu