English
Related papers

Related papers: Robust Finite Mixture Regression for Heterogeneous…

200 papers

Identifying relationships between molecular variations and their clinical presentations has been challenged by the heterogeneous causes of a disease. It is imperative to unveil the relationship between the high dimensional molecular…

Methodology · Statistics 2021-09-02 Wennan Chang , Changlin Wan , Yong Zang , Chi Zhang , Sha Cao

To avoid specification of the error distribution in a regression model, we propose a general nonparametric scale mixture model for the error distribution. For fitting such mixtures, the predictive recursion method is a simple and…

Methodology · Statistics 2015-09-03 Ryan Martin , Zhen Han

We propose a novel approach for modeling multivariate longitudinal data in the presence of unobserved heterogeneity for the analysis of the Health and Retirement Study (HRS) data. Our proposal can be cast within the framework of linear…

Methodology · Statistics 2015-09-17 Laura Anderlucci , Cinzia Viroli

Federated learning (FL) based magnetic resonance (MR) image reconstruction can facilitate learning valuable priors from multi-site institutions without violating patient's privacy for accelerating MR imaging. However, existing methods rely…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Juan Zou , Cheng Li , Ruoyou Wu , Tingrui Pei , Hairong Zheng , Shanshan Wang

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Clustered data is ubiquitous in a variety of scientific fields. In this paper, we propose a flexible and interpretable modeling approach, called grouped heterogenous mixture modeling, for clustered data, which models cluster-wise…

Methodology · Statistics 2020-02-10 Shonosuke Sugasawa

Mixed membership models are an extension of finite mixture models, where each observation can partially belong to more than one mixture component. A probabilistic framework for mixed membership models of high-dimensional continuous data is…

Modern complex datasets often consist of various sub-populations with known group information. In the presence of sub-population heterogeneity, it is crucial to develop robust and generalizable learning methods that (1) can enjoy robust…

Methodology · Statistics 2025-09-30 Weibin Mo , Weijing Tang , Songkai Xue , Yufeng Liu , Ji Zhu

Model merging has emerged as a crucial technique in Deep Learning, enabling the integration of multiple models into a unified system while preserving perfor-mance and scalability. In this respect, the compositional properties of low-rank…

Machine Learning · Computer Science 2025-03-11 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Jacopo Bonato , Luigi Sabetta , Simone Calderara

Recent research has established sufficient conditions for finite mixture models to be identifiable from grouped observations. These conditions allow the mixture components to be nonparametric and have substantial (or even total) overlap.…

Machine Learning · Statistics 2020-06-16 Alexander Ritchie , Robert A. Vandermeulen , Clayton Scott

Many real-world datasets are labeled with natural orders, i.e., ordinal labels. Ordinal regression is a method to predict ordinal labels that finds a wide range of applications in data-rich domains, such as natural, health and social…

Machine Learning · Computer Science 2020-04-28 Lu Wang , Dongxiao Zhu

Random Forests (RF) are among the most powerful and widely used predictive models for centralized tabular data, yet few methods exist to adapt them to the federated learning setting. Unlike most federated learning approaches, the…

Machine Learning · Statistics 2026-05-08 Rémi Khellaf , Erwan Scornet , Aurélien Bellet , Julie Josse

In the field of federated learning, addressing non-independent and identically distributed (non-i.i.d.) data remains a quintessential challenge for improving global model performance. This work introduces the Feature Norm Regularized…

Machine Learning · Computer Science 2023-12-13 Ke Hu , WeiDong Qiu , Peng Tang

Envelope model also known as multivariate regression model was proposed to solve the multiple response regression problems. It measures the linear association between predictors and multiple responses by using the minimal reducing subspace…

Methodology · Statistics 2018-05-07 Bochao Jia

Model merging aims to integrate multiple expert models into a single model that inherits their complementary strengths without incurring the inference-time cost of ensembling. Recent progress has shown that merging can be highly effective…

Artificial Intelligence · Computer Science 2026-05-19 Shilian Chen , Jie Zhou , Qin Chen , Wen Wu , Xin Li , Qi Feng , Liang He

This work introduces a new method for selecting the number of components in finite mixture models (FMMs) using variational Bayes, inspired by the large-sample properties of the Evidence Lower Bound (ELBO) derived from mean-field (MF)…

Methodology · Statistics 2026-04-23 Chenyang Wang , Yun Yang

Client selection schemes are widely adopted to handle the communication-efficient problems in recent studies of Federated Learning (FL). However, the large variance of the model updates aggregated from the randomly-selected unrepresentative…

Machine Learning · Computer Science 2022-08-24 Guangyuan Shen , Dehong Gao , Duanxiao Song , Libin Yang , Xukai Zhou , Shirui Pan , Wei Lou , Fang Zhou

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun

This paper proposes a novel graph-based regularized regression estimator - the hierarchical feature regression (HFR) -, which mobilizes insights from the domains of machine learning and graph theory to estimate robust parameters for a…

Machine Learning · Statistics 2022-01-11 Johann Pfitzinger

Federated learning (FL) has become a promising paradigm for collaborative medical image analysis, yet existing frameworks remain tightly coupled to task-specific backbones and are fragile under heterogeneous imaging modalities. Such…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Meilin Liu , Jiaying Wang , Jing Shan