English
Related papers

Related papers: Generalized Linear Models for Aggregated Data

200 papers

In the setting of entangled single-sample distributions, the goal is to estimate some common parameter shared by a family of distributions, given one \emph{single} sample from each distribution. We study mean estimation and linear…

Machine Learning · Computer Science 2020-07-08 Hui Yuan , Yingyu Liang

In this note, I show how to fit a generalised linear model to $N$ observations on $p$ variables stored in a relational database, using one sampling query and one aggregation queries, as long as $N^{\frac{1}{2}+\delta}$ observations can be…

Computation · Statistics 2018-03-15 Thomas Lumley

We consider the problem of aggregating models learned from sequestered, possibly heterogeneous datasets. Exploiting tools from Bayesian nonparametrics, we develop a general meta-modeling framework that learns shared global latent structures…

Machine Learning · Statistics 2019-11-04 Mikhail Yurochkin , Mayank Agarwal , Soumya Ghosh , Kristjan Greenewald , Trong Nghia Hoang

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

We consider marginal log-linear models for parameterizing distributions on multidimensional contingency tables. These models generalize ordinary log-linear and multivariate logistic models, besides several others. First, we obtain some…

Statistics Theory · Mathematics 2019-10-25 S. Ghosh , P. Vellaisamy

Predicting patient features from single-cell data can help identify cellular states implicated in health and disease. Linear models and average cell type expressions are typically favored for this task for their efficiency and robustness,…

Machine Learning · Computer Science 2024-03-11 Jan P. Engelmann , Alessandro Palma , Jakub M. Tomczak , Fabian J. Theis , Francesco Paolo Casale

This work demonstrates that applying a fixed-effect multiple linear regression (MLR) model to an overparameterized dataset is mathematically equivalent to fitting a hyper-curve parameterized by a single scalar. This reformulation shifts the…

Machine Learning · Statistics 2026-02-26 E. Atza , N. Budko

Permutation methods are commonly used to test significance of regressors of interest in general linear models (GLMs) for functional (image) data sets, in particular for neuroimaging applications as they rely on mild assumptions. Permutation…

Methodology · Statistics 2021-11-23 Tomas Mrkvicka , Mari Myllymaki , Mikko Kuronen , Naveen Naidu Narisetty

Logistic regression (LR) is widely used in clinical prediction because it is simple to deploy and easy to interpret. Nevertheless, being a linear model, LR has limited expressive capability and often has unsatisfactory performance.…

Machine Learning · Computer Science 2019-07-31 Zhicheng Cui , Bradley A Fritz , Christopher R King , Michael S Avidan , Yixin Chen

This paper introduces the generalized Hausman test as a novel method for detecting non-normality of the latent variable distribution of unidimensional Item Response Theory (IRT) models for binary data. The test utilizes the pairwise maximum…

Methodology · Statistics 2024-02-14 Lucia Guastadisegni , Silvia Cagnone , Irini Moustaki , Vassilis Vasdekis

A tacit assumption in linear regression is that (response, predictor)-pairs correspond to identical observational units. A series of recent works have studied scenarios in which this assumption is violated under terms such as ``Unlabeled…

Machine Learning · Statistics 2020-06-30 Martin Slawski , Emanuel Ben-David , Ping Li

Group testing, a problem with diverse applications across multiple disciplines, traditionally assumes independence across nodes' states. Recent research, however, focuses on real-world scenarios that often involve correlations among nodes,…

Information Theory · Computer Science 2025-04-02 Hesam Nikpey , Saswati Sarkar , Shirin Saeedi Bidokhti

Federated Learning (FL) offers a decentralized approach to model training, where data remains local and only model parameters are shared between the clients and the central server. Traditional methods, such as Federated Averaging (FedAvg),…

Machine Learning · Computer Science 2025-02-12 Jiahao Lai , Jiaqi Li , Jian Xu , Yanru Wu , Boshi Tang , Siqi Chen , Yongfeng Huang , Wenbo Ding , Yang Li

Fragmentary data is becoming more and more popular in many areas which brings big challenges to researchers and data analysts. Most existing methods dealing with fragmentary data consider a continuous response while in many applications the…

Methodology · Statistics 2022-02-07 Chaoxia Yuan , Yang Wu , Fang Fang

The Generalized Linear Model (GLM) for the Gamma distribution (glmGamma) is widely used in modeling continuous, non-negative and positive-skewed data, such as insurance claims and survival data. However, model selection for GLM depends on…

Methodology · Statistics 2018-04-24 Xin Chen , Aleksandr Y. Aravkin , R. Douglas Martin

The generalized linear model is widely used in all areas of applied statistics and while correct asymptotic inference can be achieved under misspecification of the distributional assumptions, a correctly specified mean structure is crucial…

Methodology · Statistics 2015-07-07 Klaus K. Holst

Distributed statistical learning problems arise commonly when dealing with large datasets. In this setup, datasets are partitioned over machines, which compute locally, and communicate short messages. Communication is often the bottleneck.…

Statistics Theory · Mathematics 2022-10-25 Edgar Dobriban , Yue Sheng

This paper presents a significant advancement in the estimation of the Composite Link Model within a penalized likelihood framework, specifically designed to address indirect observations of grouped count data. While the model is effective…

Methodology · Statistics 2025-12-16 Carlo G. Camarda , María Durbán

In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are $K$ clients whose individually chosen models are…

Machine Learning · Statistics 2022-11-23 Milad Sefidgaran , Romain Chor , Abdellatif Zaidi