English
Related papers

Related papers: Removing batch effects for prediction problems wit…

200 papers

Reproducible translation of transcriptomics data has been hampered by the ubiquitous presence of batch effects. Statistical methods for managing batch effects were initially developed in the setting of sample group comparison and later…

Methodology · Statistics 2022-09-09 Ai Ni , Mengling Liu , Li-Xuan Qin

Estimating long-term causal effects based on short-term surrogates is a significant but challenging problem in many real-world applications, e.g., marketing and medicine. Despite its success in certain domains, most existing methods…

Machine Learning · Computer Science 2023-11-22 Ruichu Cai , Weilin Chen , Zeqin Yang , Shu Wan , Chen Zheng , Xiaoqing Yang , Jiecheng Guo

Biomedical research often produces high-dimensional data confounded by batch effects such as systematic experimental variations, different protocols and subject identifiers. Without proper correction, low-dimensional representation of…

Gene expression depends on thousands of factors and we usually only have access to tens or hundreds of observations of gene expression levels meaning we are in a high-dimensional setting. Additionally we don't always observe or care about…

Applications · Statistics 2017-04-04 Emiliano Diaz

Many biological data analysis processes like Cytometry or Next Generation Sequencing (NGS) produce massive amounts of data which needs to be processed in batches for down-stream analysis. Such datasets are prone to technical variations due…

Machine Learning · Computer Science 2019-06-24 Uddeshya Upadhyay , Arjun Jain

Inferring causal effects on long-term outcomes using short-term surrogates is crucial to rapid innovation. However, even when treatments are randomized and surrogates fully mediate their effect on outcomes, it's possible that we get the…

Methodology · Statistics 2023-11-09 Aurélien Bibaut , Nathan Kallus , Simon Ejdemyr , Michael Zhao

Extended resolution shows that auxiliary variables are very powerful in theory. However, attempts to exploit this potential in practice have had limited success. One reasonably effective method in this regard is bounded variable addition…

Logic in Computer Science · Computer Science 2023-07-06 Andrew Haberlandt , Harrison Green , Marijn J. H. Heule

Conducting genome-wide association studies (GWAS) in copy number variation (CNV) level is a field where few people involves and little statistical progresses have been achieved, traditional methods suffer from many problems such as batch…

Methodology · Statistics 2020-11-17 Han Wang , Changhu Wang , Linjie Wu , Ruibin Xi

Batch effects are pervasive in biomedical studies. One approach to address the batch effects is repeatedly measuring a subset of samples in each batch. These remeasured samples are used to estimate and correct the batch effects. However,…

Methodology · Statistics 2023-11-07 Hanxuan Ye , Xianyang Zhang , Chen Wang , Ellen L. Goode , Jun Chen

Surrogate endpoints are very important in regulatory decision-making in healthcare, in particular if they can be measured early compared to the long-term final clinical outcome and act as good predictors of clinical benefit. Bivariate…

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

We study a class of prediction problems in which relatively few observations have associated responses, but all observations include both standard covariates as well as additional "helper" covariates. While the end goal is to make…

Statistics Theory · Mathematics 2024-12-13 Eric Xia , Martin J. Wainwright

Sources of variability in experimentally derived data include measurement error in addition to the physical phenomena of interest. This measurement error is a combination of systematic components, originating from the measuring instrument,…

Machine Learning · Statistics 2018-01-10 Uri Shaham , Kelly P. Stanton , Jun Zhao , Huamin Li , Khadir Raddassi , Ruth Montgomery , Yuval Kluger

In many randomized trials, outcomes such as essays or open-ended responses must be manually scored as a preliminary step to impact analysis, a process that is costly and limiting. Model-assisted estimation offers a way to combine surrogate…

Methodology · Statistics 2026-02-16 Reagan Mozer , Nicole E. Pashley , Luke Miratrix

Estimating effects of spatially structured exposures is complicated by unmeasured spatial confounders, which undermine identifiability in spatial linear regression models unless structural assumptions are imposed. We develop a general…

Methodology · Statistics 2025-12-30 Anik Burman , Elizabeth L. Ogburn , Abhirup Datta

The Stable Unit Treatment Value Assumption (SUTVA) includes the condition that there are no multiple versions of treatment in causal inference. Though we could not control the implementation of treatment in observational studies, multiple…

Methodology · Statistics 2026-01-05 Kohei Yoshikawa , Shuichi Kawano

In many real-world causal inference applications, the primary outcomes (labels) are often partially missing, especially if they are expensive or difficult to collect. If the missingness depends on covariates (i.e., missingness is not…

Machine Learning · Statistics 2024-05-24 Zhenghao Zeng , David Arbour , Avi Feller , Raghavendra Addanki , Ryan Rossi , Ritwik Sinha , Edward H. Kennedy

The surrogate-assisted optimization algorithm is a promising approach for solving expensive multi-objective optimization problems. However, most existing surrogate-assisted multi-objective optimization algorithms have three main drawbacks:…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

As an important problem in causal inference, we discuss the identification and estimation of treatment effects (TEs) under limited overlap; that is, when subjects with certain features belong to a single treatment group. We use a latent…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu

High-Content Screening routinely generates massive volumes of cell painting images for phenotypic profiling. However, technical variations across experimental executions inevitably induce biological batch (bio-batch) effects. These cause…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Lei Tong , Xujing Yao , Adam Corrigan , Long Chen , Navin Rathna Kumar , Kerry Hallbrook , Jonathan Orme , Yinhai Wang , Huiyu Zhou
‹ Prev 1 2 3 10 Next ›