English
Related papers

Related papers: How to improve the regression factor score predict…

200 papers

Massive amounts of data are the foundation of data-driven recommendation models. As an inherent nature of big data, data heterogeneity widely exists in real-world recommendation systems. It reflects the differences in the properties among…

Information Retrieval · Computer Science 2023-05-26 Zimu Wang , Jiashuo Liu , Hao Zou , Xingxuan Zhang , Yue He , Dongxu Liang , Peng Cui

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when…

Methodology · Statistics 2018-09-12 Jianqing Fan , Yuan Ke , Kaizheng Wang

Trustworthy classifiers are essential to the adoption of machine learning predictions in many real-world settings. The predicted probability of possible outcomes can inform high-stakes decision making, particularly when assessing the…

Machine Learning · Computer Science 2023-02-22 Kiri L. Wagstaff , Thomas G. Dietterich

In this paper, we study a new two-way factor model for high-dimensional matrix-variate time series. To estimate the number of factors in this two-way factor model, we decompose the series into two parts: one being a non-weakly correlated…

Methodology · Statistics 2025-01-28 Qiang Xia

In this paper, we conduct a simulation study with subject-level data to evaluate conventional meta-regression approaches (study-level random, fixed, and mixed effects) against seven methodology specifications new to meta-regressions that…

Econometrics · Economics 2025-07-18 Ali Habibnia , Jonathan Gendron

Factor analysis is a widely used statistical tool in many scientific disciplines, such as psychology, economics, and sociology. As observations linked by networks become increasingly common, incorporating network structures into factor…

Methodology · Statistics 2024-03-27 Jinming Li , Gongjun Xu , Ji Zhu

Treatment effect heterogeneity occurs when individual characteristics influence the effect of a treatment. We propose a novel approach that combines prognostic score matching and conditional inference trees to characterize effect…

Estimating how a treatment affects units individually, known as heterogeneous treatment effect (HTE) estimation, is an essential part of decision-making and policy implementation. The accumulation of large amounts of data in many domains,…

Machine Learning · Computer Science 2022-06-28 Christopher Tran , Elena Zheleva

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an…

Estimating treatment effects conditional on observed covariates can improve the ability to tailor treatments to particular individuals. Doing so effectively requires dealing with potential confounding, and also enough data to adequately…

Accurately estimating the proportion of true signals among a large number of variables is crucial for enhancing the precision and reliability of scientific research. Traditional signal proportion estimators often assume independence among…

Statistics Theory · Mathematics 2026-05-15 Jingtian Bai , Xinge Jessie Jeng

The digitalization of credit scoring has become essential for financial institutions and commercial banks, especially in the era of digital transformation. Machine learning techniques are commonly used to evaluate customers'…

Machine Learning · Computer Science 2026-03-06 Huyen Giang Thi Thu , Thang Viet Doan , Ha-Bang Ban , Tai Le Quy

Decision support systems for classification tasks are predominantly designed to predict the value of the ground truth labels. However, since their predictions are not perfect, these systems also need to make human experts understand when…

Machine Learning · Computer Science 2024-07-17 Eleni Straitouri , Manuel Gomez Rodriguez

Gene expression and phenotype association can be affected by potential unmeasured confounders from multiple sources, leading to biased estimates of the associations. Since genetic variants largely explain gene expression variations, they…

Methodology · Statistics 2019-10-23 Jiarui Lu , Hongzhe Li

The causal effect of a treatment can vary from person to person based on their individual characteristics and predispositions. Mining for patterns of individual-level effect differences, a problem known as heterogeneous treatment effect…

Machine Learning · Computer Science 2019-09-04 Christopher Tran , Elena Zheleva

We investigate individual fairness in generative probabilistic classifiers by analysing the robustness of posterior inferences to perturbations in private features. Building on established results in robustness analysis, we hypothesise a…

Machine Learning · Computer Science 2025-09-17 Alessandro Antonucci , Eric Rossetto , Ivan Duvnjak

We determine the number of statistically significant factors in a forecast model using a random matrices test. The applied forecast model is of the type of Reduced Rank Regression (RRR), in particular, we chose a flavor which can be seen as…

Statistical Finance · Quantitative Finance 2025-03-10 Andrés García Medina , Graciela González-Farías

Genetic studies often involve quantitative traits. Identifying genetic features that influence quantitative traits can help to uncover the etiology of diseases. Quantile regression method considers the conditional quantiles of the response…

Statistics Theory · Mathematics 2015-11-04 Qianchuan He , Linglong Kong , Yanhua Wang , Sijian Wang , Timothy A. Chan , Eric Holland

Strategic classification, where individuals modify their features to influence machine learning (ML) decisions, presents critical fairness challenges. While group fairness in this setting has been widely studied, individual fairness remains…

Machine Learning · Computer Science 2026-02-06 Zhiqun Zuo , Mohammad Mahdi Khalili

In epidemiology, obtaining accurate individual exposure measurements can be costly and challenging. Thus, these measurements are often subject to error. Regression calibration with a validation study is widely employed as a study design and…

Methodology · Statistics 2026-02-24 Zexiang Li , Donna Spiegelman , Molin Wang , Zuoheng Wang , Xin Zhou