English
Related papers

Related papers: A Framework for Mediation Analysis with Massive Da…

200 papers

Disparities in health or well-being experienced by minority groups can be difficult to study using the traditional exposure-outcome paradigm in causal inference, since potential outcomes in variables such as race or sexual minority status…

Methodology · Statistics 2025-01-22 Andy A. Shen , Elina Visoki , Ran Barzilay , Samuel D. Pimentel

Boosting has garnered significant interest across both machine learning and statistical communities. Traditional boosting algorithms, designed for fully observed random samples, often struggle with real-world problems, particularly with…

Machine Learning · Statistics 2026-02-19 Yuan Bian , Grace Y. Yi , Wenqing He

Data sets for statistical analysis become extremely large even with some difficulty of being stored on one single machine. Even when the data can be stored in one machine, the computational cost would still be intimidating. We propose a…

Methodology · Statistics 2020-02-18 Ya Su

Over the past few decades, statistical methods for causal inference have made impressive strides, enabling progress across a range of scientific fields. However, much of this methodological development has been confined to individual…

Methodology · Statistics 2025-09-30 Wenqi Shi , José R. Zubizarreta

In modern data analysis, one is frequently faced with statistical inference problems involving massive datasets. Processing such large datasets is usually viewed as a substantial computational challenge. However, if data are a…

Statistics Theory · Mathematics 2015-06-12 Venkat Chandrasekaran , Michael I. Jordan

Causal inference is a fundamental research topic for discovering the cause-effect relationships in many disciplines. However, not all algorithms are equally well-suited for a given dataset. For instance, some approaches may only be able to…

Machine Learning · Computer Science 2024-03-11 Zhipeng Ma , Marco Kemmerling , Daniel Buschmann , Chrismarie Enslin , Daniel Lütticke , Robert H. Schmitt

In this paper, we present a new way of matching in observational studies that overcomes three limitations of existing matching approaches. First, it directly balances covariates with multi-valued treatments without requiring the generalized…

Applications · Statistics 2019-07-11 Magdalena Bennett , Juan Pablo Vielma , Jose R. Zubizarreta

Equilibrium statistical mechanics is intended to link the microscopic dynamics of particles to the thermodynamic laws for macroscopic quantities. However, the modern statistical theory is faced with significant difficulties, as applied to…

Statistical Mechanics · Physics 2016-03-15 A. G. Godizov , A. A. Godizov

For massive data sets, efficient computation commonly relies on distributed algorithms that store and process subsets of the data on different machines, minimizing communication costs. Our focus is on regression and classification problems…

Machine Learning · Statistics 2014-10-27 Xiangyu Wang , Peichao Peng , David Dunson

We consider assessing causal mediation in the presence of a post-treatment event (examples include noncompliance, a clinical event, or death). We identify natural mediation effects for the entire study population and for each principal…

Methodology · Statistics 2024-09-13 Chao Cheng , Fan Li

The recent development of compressed sensing has led to spectacular advances in the understanding of sparse linear estimation problems as well as in algorithms to solve them. It has also triggered a new wave of developments in the related…

Information Theory · Computer Science 2016-07-05 Christophe Schülke

To estimate direct and indirect effects of an exposure on an outcome from observed data strong assumptions about unconfoundedness are required. Since these assumptions cannot be tested using the observed data, a mediation analysis should…

Statistics Theory · Mathematics 2018-03-29 Anita Lindmark , Xavier de Luna , Marie Eriksson

Although the exposure can be randomly assigned in studies of mediation effects, any form of direct intervention on the mediator is often infeasible. As a result, unmeasured mediator-outcome confounding can seldom be ruled out. We propose…

Methodology · Statistics 2021-09-30 BaoLuo Sun , Ting Ye

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal…

Methodology · Statistics 2021-06-01 Lin Wang , Jake Elmstedt , Weng Kee Wong , Hongquan Xu

Data is evolving with the rapid progress of population and communication for various types of devices such as networks, cloud computing, Internet of Things (IoT), actuators, and sensors. The increment of data and communication content goes…

Machine Learning · Computer Science 2021-02-05 Swarajya Lakshmi V Papineni , Snigdha Yarlagadda , Harita Akkineni , A. Mallikarjuna Reddy

The paper presents an investigation of estimating treatment effect using different matching methods. The study proposed a new method which is computationally efficient and convenient in implication-'largest caliper matching' and compared…

Applications · Statistics 2018-06-07 Sharif Mahmood

Data rebalancing techniques, including oversampling and undersampling, are a common approach to addressing the challenges of imbalanced data. To tackle unresolved problems related to both oversampling and undersampling, we propose a new…

Machine Learning · Computer Science 2025-07-11 Karen Medlin , Sven Leyffer , Krishnan Raghavan

A key objective of decomposition analysis is to identify a factor (the 'mediator') contributing to disparities in an outcome between social groups. In decomposition analysis, a scholarly interest often centers on estimating how much the…

Methodology · Statistics 2022-05-27 Soojin Park , Suyeon Kang , Chioun Lee , Shujie Ma

With reference to a stratified case-control procedure based on a binary variable of primary interest, we derive the expression of the distortion induced by the sampling design on the parameters of the logistic model of a secondary variable.…

Methodology · Statistics 2024-01-18 Marco Doretti , Minna Genbäck , Elena Stanghellini

Data sharing barriers are paramount challenges arising from multicenter clinical trials where multiple data sources are stored in a distributed fashion at different local study sites. Merging such data sources into a common data storage for…

Methodology · Statistics 2022-04-05 Mengtong Hu , Xu Shi , Peter X. -K. Song