English
Related papers

Related papers: Identifying Heterogeneity in Regression Compositio…

200 papers

Compositional data have two unique characteristics compared to typical multivariate data: the observed values are nonnegative and their summand is exactly one. To reflect these characteristics, a specific regularized regression model with…

Machine Learning · Computer Science 2018-12-24 Jong-June Jeon , Yongdai Kim , Sungho Won , Hosik Choi

This study analyzes the impact of heterogeneity ("Variety") in Big Data by comparing classification strategies across structured (Epsilon) and unstructured (Rest-Mex, IMDB) domains. A dual methodology was implemented: evolutionary and…

One important problem in microbiome analysis is to identify the bacterial taxa that are associated with a response, where the microbiome data are summarized as the composition of the bacterial taxa at different taxonomic levels. This paper…

Applications · Statistics 2016-03-04 Pixu Shi , Anru Zhang , Hongzhe Li

Heart rate prediction is vital for personalized health monitoring and fitness, while it frequently faces a critical challenge in real-world deployment: data heterogeneity. We classify it in two key dimensions: source heterogeneity from…

Machine Learning · Computer Science 2026-02-25 Zhengdong Huang , Zicheng Xie , Wentao Tian , Jingyu Liu , Lunhong Dong , Peng Yang

We propose a method to detect model misspecifications in nonlinear causal additive and potentially heteroscedastic noise models. We aim to identify predictor variables for which we can infer the causal effect even in cases of such…

Methodology · Statistics 2024-03-28 Christoph Schultheiss , Peter Bühlmann

This paper proposes a regularized pairwise difference approach for estimating the linear component coefficient in a partially linear model, with consistency and exact rates of convergence obtained in high dimensions under mild scaling…

Statistics Theory · Mathematics 2018-01-15 Fang Han , Zhao Ren , Yuxin Zhu

Multidimensional network data can have different levels of complexity, as nodes may be characterized by heterogeneous individual-specific features, which may vary across the networks. This paper introduces a class of models for…

Methodology · Statistics 2021-04-01 Silvia D'Angelo , Marco Alfò , Thomas Brendan Murphy

Modern data analysis often involves massive datasets with hundreds of thousands of observations, making traditional inference algorithms computationally prohibitive. Coresets are selection methods designed to choose a smaller subset of…

Computation · Statistics 2025-02-13 Bernardo Flores

A computationally efficient protocol for machine learning in chemical space using Boltzmann ensembles of conformers as input is proposed; the method is based on rewriting Kernel Ridge Regression expressions in terms of Structured Orthogonal…

Chemical Physics · Physics 2025-07-11 Konstantin Karandashev

The analysis of human microbiome data is often based on dimension-reduced graphical displays and clustering derived from vectors of microbial abundances in each sample. Common to these ordination methods is the use of biologically motivated…

Applications · Statistics 2017-01-11 Timothy W. Randolph , Sen Zhao , Wade Copeland , Meredith Hullar , Ali Shojaie

High-dimensional compositional data arise naturally in many applications such as metagenomic data analysis. The observed data lie in a high-dimensional simplex, and conventional statistical methods often fail to produce sensible results due…

Methodology · Statistics 2016-01-19 Yuanpei Cao , Wei Lin , Hongzhe Li

Detecting the components common or correlated across multiple data sets is challenging due to a large number of possible correlation structures among the components. Even more challenging is to determine the precise structure of these…

Information Theory · Computer Science 2019-02-01 Tanuj Hasija , Christian Lameiro , Timothy Marrinan , Peter J. Schreier

This paper addresses the problem of summarizing the posterior distributions that typically arise, in a Bayesian framework, when dealing with signal decomposition problems with unknown number of components. Such posterior distributions are…

Computation · Statistics 2011-11-29 Alireza Roodaki , Julien Bect , Gilles Fleury

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

The Classification on high-dimension low-sample-size data (HDLSS) is a challenging problem and it is common to have class-imbalanced data in most application fields. We term this as Imbalanced HDLSS (IHDLSS). Recent theoretical results…

Machine Learning · Computer Science 2022-06-09 Liran Shen , Meng Joo Er , Qingbo Yin

Linear regression models depend directly on the design matrix and its properties. Techniques that efficiently estimate model coefficients by partitioning rows of the design matrix are increasingly popular for large-scale problems because…

Machine Learning · Statistics 2019-07-23 Michael J. Kane , Bryan Lewis , Sekhar Tatikonda , Simon Urbanek

The model for homogeneity of proportions in a two-way contingency-table/cross-tabulation is the same as the model of independence, except that the probabilistic process generating the data is viewed as fixing the column totals (but not the…

Methodology · Statistics 2012-01-09 Mark Tygert

We consider an additive partially linear framework for modelling massive heterogeneous data. The major goal is to extract multiple common features simultaneously across all sub-populations while exploring heterogeneity of each…

Methodology · Statistics 2019-01-01 Binhuan Wang , Yixin Fang , Heng Lian , Hua Liang

Detection heterogeneity is inherent to ecological data, arising from factors such as varied terrain or weather conditions, inconsistent sampling effort, or heterogeneity of individuals themselves. Incorporating additional covariates into a…

Applications · Statistics 2021-08-27 Daniel Turek , Claudia Wehrhahn , Olivier Gimenez

We propose a Kullback-Leibler Divergence (KLD) filter to extract anomalies within data series generated by a broad class of proximity sensors, along with the anomaly locations and their relative sizes. The technique applies to devices…

Signal Processing · Electrical Eng. & Systems 2024-05-07 Ruikun Zhou , Wail Gueaieb , Davide Spinello