English
Related papers

Related papers: Robust Regression with Compositional Covariates

200 papers

We consider the estimation of average treatment effects in observational studies and propose a new framework of robust causal inference with unobserved confounders. Our approach is based on distributionally robust optimization and proceeds…

Methodology · Statistics 2023-02-06 Dimitris Bertsimas , Kosuke Imai , Michael Lingzhi Li

High-dimensional compositional covariates, often derived from count data, are subject to measurement error and are frequently analyzed after aggregation along a prespecified tree to improve interpretability in applications such as…

Methodology · Statistics 2026-05-18 Zhenghan Li , Tianying Wang

In many machine learning tasks, a common approach for dealing with large-scale data is to build a small summary, {\em e.g.,} coreset, that can efficiently represent the original input. However, real-world datasets usually contain outliers…

Machine Learning · Computer Science 2022-01-24 Zixiu Wang , Yiwen Guo , Hu Ding

We develop a new robust geographically weighted regression method in the presence of outliers. We embed the standard geographically weighted regression in robust objective function based on $\gamma$-divergence. A novel feature of the…

Methodology · Statistics 2021-10-15 Shonosuke Sugasawa , Daisuke Murakami

Identifying co-varying causal elements in very high dimensional feature space with internal structures, e.g., a space with as many as millions of linearly ordered features, as one typically encounters in problems such as whole genome…

Methodology · Statistics 2012-06-18 Seyoung Kim , Eric P. Xing

We propose a robust variable selection procedure using a divergence based M-estimator combined with a penalty function. It produces robust estimates of the regression parameters and simultaneously selects the important explanatory…

Methodology · Statistics 2020-01-01 Abhijit Mandal , Samiran Ghosh

Corrupted data sets containing noisy or missing observations are prevalent in various contemporary applications such as economics, finance and bioinformatics. Despite the recent methodological and algorithmic advances in high-dimensional…

Methodology · Statistics 2020-05-12 J. Wu , Z. Zheng , Y. Li , Y. Zhang

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu

This paper proposes an adaptive penalized weighted mean regression for outlier detection of high-dimensional data. In comparison to existing approaches based on the mean shift model, the proposed estimators demonstrate robustness against…

Statistics Theory · Mathematics 2023-06-27 Jiaqi Li , Linglong Kong , Bei Jiang , Wei Tu

From an engineering perspective, a design should not only perform well in an ideal condition, but should also resist noises. Such a design methodology, namely robust design, has been widely implemented in the industry for product quality…

Machine Learning · Computer Science 2021-12-09 Jia-Qi Yang , Ke-Bin Fan , Hao Ma , De-Chuan Zhan

This study deals with the problem of outliers in ordinal response model, which is a regression on ordered categorical data as the response variable. ``Outlier" means that the combination of ordered categorical data and its covariates is…

Methodology · Statistics 2022-12-29 Tomotaka Momozaki , Tomoyuki Nakagawa

In this paper, we deduce a new multivariate regression model designed to fit correlated binary data. The multivariate distribution is derived from a Bernoulli mixed model with a nonnormal random intercept on the marginal approach. The…

Methodology · Statistics 2024-06-10 Lizandra C. Fabio , Vanessa Barros , Cristian Villegas , Jalmar M. F. Carrasco

Classification of high-dimensional spectroscopic data is a common task in analytical chemistry. Well-established procedures like support vector machines (SVMs) and partial least squares discriminant analysis (PLS-DA) are the most common…

Applications · Statistics 2021-01-29 Andrea Cappozzo , Ludovic Duponchel , Francesca Greselin , Thomas Brendan Murphy

Compositional data (i.e., data comprising random variables that sum up to a constant) arises in many applications including microbiome studies, chemical ecology, political science, and experimental designs. Yet when compositional data serve…

Methodology · Statistics 2025-01-03 Ritwik Bhaduri , Siyuan Ma , Lucas Janson

Modern network data analysis often involves analyzing network structures alongside covariate features to gain deeper insights into underlying patterns. However, traditional covariate-assisted statistical network models may not adequately…

Methodology · Statistics 2025-05-07 Peng Zhao , Yabo Niu

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an…

Machine Learning · Statistics 2026-05-21 Xin Huang , Jia Li , Jun Yu

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

Machine Learning · Statistics 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

Despite their numerous successes, there are many scenarios where adversarial risk metrics do not provide an appropriate measure of robustness. For example, test-time perturbations may occur in a probabilistic manner rather than being…

Machine Learning · Statistics 2021-08-03 Benjie Wang , Stefan Webb , Tom Rainforth

Genome-wide association studies (GWAS) have identified thousands of genetic variants associated with complex traits, and some variants are shown to be associated with multiple complex traits. Genetic covariance between two traits is defined…

Methodology · Statistics 2023-10-06 Jianqiao Wang , Sai Li , Hongzhe Li