English
Related papers

Related papers: Distribution of the elemental regression weights w…

200 papers

The problem of learning functions over spaces of probabilities - or distribution regression - is gaining significant interest in the machine learning community. A key challenge behind this problem is to identify a suitable representation…

Machine Learning · Statistics 2022-06-20 Dimitri Meunier , Massimiliano Pontil , Carlo Ciliberto

Concerning bivariate least squares linear regression, the classical results obtained for extreme structural models in earlier attempts are reviewed using a new formalism in terms of deviation (matrix) traces which, for homoscedastic data,…

Instrumentation and Methods for Astrophysics · Physics 2017-11-17 R. Caimmi

The approximation of a discrete probability distribution $\mathbf{t}$ by an $M$-type distribution $\mathbf{p}$ is considered. The approximation error is measured by the informational divergence $\mathbb{D}(\mathbf{t}\Vert\mathbf{p})$, which…

Information Theory · Computer Science 2016-07-28 Bernhard C. Geiger , Georg Böcherer

This paper deals with improvement of linear quantile regression, when there are a few distinct values of the covariates but many replicates. On can improve asymptotic efficiency of the estimated regression coefficients by using suitable…

Applications · Statistics 2020-11-30 Kaushik Jana , Debasis Sengupta

Empirical Bayes small area estimation based on the well-known Fay-Herriot model may produce unreliable estimates when outlying areas exist. Existing robust methods against outliers or model misspecification are generally inefficient when…

Methodology · Statistics 2022-06-28 Daisuke Kurisu , Takuya Ishihara , Shonosuke Sugasawa

In real data analysis with structural equation modeling, data are unlikely to be exactly normally distributed. If we ignore the non-normality reality, the parameter estimates, standard error estimates, and model fit statistics from normal…

Methodology · Statistics 2021-06-21 Han Du , Peter M. Bentler

Linear regression models have been extensively considered in the literature. However, in some practical applications they may not be appropriate all over the range of the covariate. In this paper, a more flexible model is introduced by…

Statistics Theory · Mathematics 2023-12-19 Graciela Boente , Florencia Leonardi , Daniela Rodriguez , Mariela Sued

This paper is concerned with functional learning by utilizing two-stage sampled distribution regression. We study a multi-penalty regularization algorithm for distribution regression under the framework of learning theory. The algorithm…

Machine Learning · Computer Science 2023-11-30 Zhan Yu , Daniel W. C. Ho

Stochastic linear combinations of some random vectors are studied where the distribution of the random vectors and the joint distribution of their coefficients are Dirichlet. A method is provided for calculating the distribution of these…

Statistics Theory · Mathematics 2016-03-03 Hazhir Homei

We consider a static linear panel model with both correlated and uncorrelated random coefficients, where the former can depend arbitrarily on observable regressors while the latter are independent of them. We provide sufficient conditions…

Econometrics · Economics 2026-05-21 Irene Botosaru , James L. Powell

Let $i=1,\ldots,N$ index a simple random sample of units drawn from some large population. For each unit we observe the vector of regressors $X_{i}$ and, for each of the $N\left(N-1\right)$ ordered pairs of units, an outcome $Y_{ij}$. The…

Statistics Theory · Mathematics 2021-03-05 Bryan S. Graham , Fengshi Niu , James L. Powell

Graphical Gaussian models have proven to be useful tools for exploring network structures based on multivariate data. Applications to studies of gene expression have generated substantial interest in these models, and resulting recent…

Methodology · Statistics 2011-08-10 Michael Finegold , Mathias Drton

In QM/MM indirect free energy simulation, QM/MM corrections can be obtained from integration of partial derivatives of alchemical Hamiltonians or from perturbation-based estimators including free energy perturbation (FEP) and acceptance…

Chemical Physics · Physics 2018-10-05 Xiaohui Wang , Zhaoxi Sun

The goal of this paper is to provide theorems on convergence rates of posterior distributions that can be applied to obtain good convergence rates in the context of density estimation as well as regression. We show how to choose priors so…

Statistics Theory · Mathematics 2007-06-13 Tzee-Ming Huang

In this paper, we propose a new distribution over the unit interval which can be characterized as a ratio of the type $Z=Y/(X+Y)$ where $X$ and $Y$ are two correlated Birnbaum-Saunders random variables. The density of $Z$ may be unimodal or…

Methodology · Statistics 2024-11-05 Roberto Vila , Helton Saulo , Felipe Quintino , Peter Zörnig

We consider fitting a bivariate spline regression model to data using a weighted least-squares cost function, with weights that sum to one to form a discrete probability distribution. By applying the principle of maximum entropy, the weight…

Methodology · Statistics 2025-08-05 Pierluigi Amodio , Luigi Brugnano , Felice Iavernaro

This paper studies the prediction of a target $\mathbf{z}$ from a pair of random variables $(\mathbf{x},\mathbf{y})$, where the ground-truth predictor is additive $\mathbb{E}[\mathbf{z} \mid \mathbf{x},\mathbf{y}] = f_\star(\mathbf{x})…

Machine Learning · Computer Science 2023-10-30 Max Simchowitz , Anurag Ajay , Pulkit Agrawal , Akshay Krishnamurthy

Using the standard finite element method (FEM) to solve general partial differential equations, the round-off error is found to be proportional to $N^{\beta_{\rm R}}$, with $N$ the number of degrees of freedom (DoFs) and $\beta_{\rm R}$ a…

Numerical Analysis · Mathematics 2022-02-08 Jie Liu , Henk M. Schuttelaars , Matthias Möller

We study the problem of robust estimation under heterogeneous corruption rates, where each sample may be independently corrupted with a known but non-identical probability. This setting arises naturally in distributed and federated…

Machine Learning · Computer Science 2025-10-02 Syomantak Chaudhuri , Jerry Li , Thomas A. Courtade

A decision must often be made between heavy-tailed and Gaussian errors for a regression or a time series model, and the t-distribution is frequently used when it is assumed that the errors are heavy-tailed distributed. The performance of…

Computation · Statistics 2015-05-11 J. Martin van Zyl