English
Related papers

Related papers: Removing batch effects for prediction problems wit…

200 papers

Estimating causal effects with propensity scores relies upon the availability of treated and untreated units observed at each value of the estimated propensity score. In settings with strong confounding, limited so-called "overlap" in…

Methodology · Statistics 2017-10-25 Corwin M Zigler , Matthew Cefalu

Many scientific questions in biomedical, environmental, and psychological research involve understanding the effects of multiple factors on outcomes. While factorial experiments are ideal for this purpose, randomized controlled treatment…

Methodology · Statistics 2025-12-03 Ruoqi Yu , Peng Ding

High-dimensional mean vector testing problem for two or more groups remain a very active research area. In these setting, traditional tests are not applicable because they involve the inversion of rank deficient group covariance matrix. In…

Methodology · Statistics 2022-09-12 Roger S Zoh , Fangzheng Xie

Data from both a randomized trial and an observational study are sometimes simultaneously available for evaluating the effect of an intervention. The randomized data typically allows for reliable estimation of average treatment effects but…

Methodology · Statistics 2021-12-01 David Cheng , Tianxi Cai

In numerous applications, surrogate models are used as a replacement for accurate parameter-to-observable mappings when solving large-scale inverse problems governed by partial differential equations (PDEs). The surrogate model may be a…

Optimization and Control · Mathematics 2025-12-08 Ruanui Nicholson , Radoslav Vuchkov , Umberto Villa , Noemi Petra

The paper proposes an estimator to make inference of heterogeneous treatment effects sorted by impact groups (GATES) for non-randomised experiments. The groups can be understood as a broader aggregation of the conditional average treatment…

Econometrics · Economics 2020-03-30 Daniel Jacob

High-quality labeled data are essential for reliable statistical inference, but are often limited by validation costs. While surrogate labels provide cost-effective alternatives, their noise can introduce non-negligible bias. To address…

Methodology · Statistics 2025-12-29 Jianmin Chen , Huiyuan Wang , Thomas Lumley , Xiaowu Dai , Yong Chen

We introduce a local surrogate approach for explainable time-series forecasting. An initially non-interpretable predictive model to improve the forecast of a classical time-series 'base model' is used. 'Explainability' of the correction is…

Machine Learning · Statistics 2025-01-17 Alfredo Lopez , Florian Sobieczky

Recent large-scale Vision Language Action (VLA) models have shown superior performance in robotic manipulation tasks guided by natural language. However, current VLA models suffer from two drawbacks: (i) generation of massive tokens leading…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Juyi Lin , Amir Taherin , Arash Akbari , Arman Akbari , Lei Lu , Guangyu Chen , Taskin Padir , Xiaomeng Yang , Weiwei Chen , Yiqian Li , Xue Lin , David Kaeli , Pu Zhao , Yanzhi Wang

The synthetic control method (SCM) has become a popular tool for estimating causal effects in policy evaluation, where a single treated unit is observed, and a heterogeneous set of untreated units with pre- and post-policy change data are…

Methodology · Statistics 2023-08-21 Jizhou Liu , Eric J. Tchetgen Tchetgen , Carlos Varjão

Supervised classifying of biological samples based on genetic information, (e.g. gene expression profiles) is an important problem in biostatistics. In order to find both accurate and interpretable classification rules variable selection is…

Methodology · Statistics 2012-08-09 Bernd Klaus

A key condition for obtaining reliable estimates of the causal effect of a treatment is overlap (a.k.a. positivity): the distributions of the features used to perform causal adjustment cannot be too different in the treated and control…

Methodology · Statistics 2021-04-14 Alexander D'Amour , Alexander Franks

While seasonality inherent to raw macroeconomic data is commonly removed by seasonal adjustment techniques before it is used for structural inference, this may distort valuable information in the data. As an alternative method to commonly…

Econometrics · Economics 2025-08-12 Daniel Dzikowski , Carsten Jentsch

A mean field variational Bayes approach to support vector machines (SVMs) using the latent variable representation on Polson & Scott (2012) is presented. This representation allows circumvention of many of the shortcomings associated with…

Methodology · Statistics 2013-05-14 Jan Luts , John T. Ormerod

We propose a new approach to safe variable preselection in high-dimensional penalized regression, such as the lasso. Preselection - to start with a manageable set of covariates - has often been implemented without clear appreciation of its…

Bayesian inference has been broadly applied to statistical network analysis, but suffers from the expensive computational costs due to the nature of Markov chain Monte Carlo sampling algorithms. This paper proposes a novel and…

Computation · Statistics 2025-09-03 Dingbo Wu , Fangzheng Xie

Fisher discriminant analysis (FDA) is a widely used method for classification and dimensionality reduction. When the number of predictor variables greatly exceeds the number of observations, one of the alternatives for conventional FDA is…

Machine Learning · Statistics 2018-11-30 Agniva Chowdhury , Jiasen Yang , Petros Drineas

A wide range of approaches for batch processes monitoring can be found in the literature. This kind of process generates a very peculiar data structure, in which successive measurements of many process variables in each batch run are…

Methodology · Statistics 2021-09-03 Batista Nunes de Oliveira , Marcio Valk , Danilo Marcondes Filho

Motivation: Computational methods are essential to extract actionable information from raw sequencing data, and to thus fulfill the promise of next-generation sequencing technology. Unfortunately, computational tools developed to call…

This paper considers stochastic convex optimization problems where the objective and constraint functions involve expectations with respect to the data indices or environmental variables, in addition to deterministic convex constraints on…

Optimization and Control · Mathematics 2021-07-21 Zeeshan Akhtar , Amrit Singh Bedi , Ketan Rajawat