English
Related papers

Related papers: Robust Finite Mixture Regression for Heterogeneous…

200 papers

The amount of high-dimensional large-scale RNA sequencing data derived from multiple heterogeneous sources has increased exponentially in biological science. During data collection, significant technical noise or errors may occur. To…

Applications · Statistics 2025-06-24 Xiaolu Jiang , Wei Liu

Federated learning is a distributed paradigm that aims at training models using samples distributed across multiple users in a network while keeping the samples on users' devices with the aim of efficiency and protecting users privacy. In…

Machine Learning · Computer Science 2020-06-17 Amirhossein Reisizadeh , Farzan Farnia , Ramtin Pedarsani , Ali Jadbabaie

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee

Linear Mixed-Effects (LME) models are a fundamental tool for modeling clustered data, including cohort studies, longitudinal data analysis, and meta-analysis. The design and analysis of variable selection methods for LMEs is considerably…

Methodology · Statistics 2022-09-28 Aleksandr Aravkin , James Burke , Aleksei Sholokhov , Peng Zheng

Mixed linear regression (MLR) has attracted increasing attention because of its great theoretical and practical importance in capturing nonlinear relationships by utilizing a mixture of linear regression sub-models. Although considerable…

Machine Learning · Statistics 2025-03-25 Yujing Liu , Zhixin Liu , Lei Guo

In this paper, we propose a novel random-forest scheme, namely Joint Maximum Purity Forest (JMPF), for classification, clustering, and regression tasks. In the JMPF scheme, the original feature space is transformed into a compactly…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Hailiang Li , Kin-Man Lam , Dong Li

The increasing size of data generated by smartphones and IoT devices motivated the development of Federated Learning (FL), a framework for on-device collaborative training of machine learning models. First efforts in FL focused on learning…

Machine Learning · Computer Science 2022-11-08 Othmane Marfoq , Giovanni Neglia , Aurélien Bellet , Laetitia Kameni , Richard Vidal

The success of pretrain-finetune paradigm brings about the release of numerous model weights. In this case, merging models finetuned on different tasks to enable a single model with multi-task capabilities is gaining increasing attention…

Machine Learning · Computer Science 2024-09-30 Chenyu Huang , Peng Ye , Tao Chen , Tong He , Xiangyu Yue , Wanli Ouyang

Multi-modal distributions are commonly used to model clustered data in statistical learning tasks. In this paper, we consider the Mixed Linear Regression (MLR) problem. We propose an optimal transport-based framework for MLR problems,…

Machine Learning · Statistics 2021-06-17 Theo Diamandis , Yonina C. Eldar , Alireza Fallah , Farzan Farnia , Asuman Ozdaglar

Mixtures-of-Experts (MoE) are conditional mixture models that have shown their performance in modeling heterogeneity in data in many statistical learning approaches for prediction, including regression and classification, as well as for…

Methodology · Statistics 2019-07-17 Bao Tuyen Huynh , Faicel Chamroukhi

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by…

Machine Learning · Computer Science 2025-07-22 Ukjo Hwang , Songnam Hong

Linear mixed models (LMMs) are a popular class of methods for analyzing longitudinal and clustered data. However, such models can be sensitive to outliers, and this can lead to biased inference on model parameters and inaccurate prediction…

Methodology · Statistics 2025-03-28 Shonosuke Sugasawa , Francis K. C. Hui , Alan H. Welsh

This article develops a class of models called Sender/Receiver Finite Mixture Exponential Random Graph Models (SRFM-ERGMs) that enables inference on networks. This class of models extends the existing Exponential Random Graph Modeling…

Methodology · Statistics 2019-09-06 Teague R Henry , Kathleen M Gates , Mitchell J Prinstein , Douglas Steinley

Large-scale data are often characterized by some degree of inhomogeneity as data are either recorded in different time regimes or taken from multiple sources. We look at regression models and the effect of randomly changing coefficients,…

Methodology · Statistics 2016-08-11 Nicolai Meinshausen , Peter Bühlmann

The original Finite Selection Model (FSM) was developed in the 1970s to enhance the design of the RAND Health Insurance Experiment (HIE; Newhouse et al. 1993). At the time of its development by Carl Morris (Morris 1979), there were…

Methodology · Statistics 2021-05-07 Ambarish Chattopadhyay , Carl N. Morris , Jose R. Zubizarreta

Finite mixtures of regressions with fixed covariates are a commonly used model-based clustering methodology to deal with regression data. However, they assume assignment independence, i.e. the allocation of data points to the clusters is…

Methodology · Statistics 2021-04-27 Salvatore D. Tomarchio , Paul D. McNicholas , Antonio Punzo

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an…

Machine Learning · Statistics 2026-05-21 Xin Huang , Jia Li , Jun Yu

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Mixture modeling, which considers the potential heterogeneity in data, is widely adopted for classification and clustering problems. Mixture models can be estimated using the Expectation-Maximization algorithm, which works with the complete…

Methodology · Statistics 2022-03-18 Shonosuke Sugasawa , Genya Kobayashi