English
Related papers

Related papers: TERRA: A Transformer-Enabled Recursive R-learner f…

200 papers

As estimation of Heterogeneous Treatment Effect (HTE) is increasingly adopted across a wide range of scientific and industrial applications, the treatment action space can naturally expand, from a binary treatment variable to a structured…

Machine Learning · Computer Science 2025-07-09 Jennifer Y. Zhang , Shuyang Du , Will Y. Zou

Efficiently and flexibly estimating treatment effect heterogeneity is an important task in a wide variety of settings ranging from medicine to marketing, and there are a considerable number of promising conditional average treatment effect…

Machine Learning · Statistics 2023-05-10 Erik Sverdrup , Yifan Cui

Linear attention offers a linear-time alternative to self-attention but often struggles to capture long-range patterns. We revisit linear attention through a prediction-correction lens and show that prevalent variants can be written as a…

Machine Learning · Computer Science 2025-10-01 Xunhao Lai , Jialiang Kang , Jianqiao Lu , Tong Lin , Pengyu Zhao

Not only does mobile health technology enable researchers to track changes in multiple longitudinal outcomes of interest and to record the occurrence of health-related events over time, but it also allows for the delivery of repeated…

We address a core problem in causal inference: estimating heterogeneous treatment effects using panel data with general treatment patterns. Many existing methods either do not utilize the potential underlying structure in panel data or have…

Machine Learning · Statistics 2024-06-11 Retsef Levi , Elisabeth Paulson , Georgia Perakis , Emily Zhang

We propose Deep Longitudinal Targeted Minimum Loss-based Estimation (Deep LTMLE), a novel approach to estimate the counterfactual mean of outcome under dynamic treatment policies in longitudinal problem settings. Our approach utilizes a…

Machine Learning · Statistics 2025-06-09 Toru Shirakawa , Yi Li , Yulun Wu , Sky Qiu , Yuxuan Li , Mingduo Zhao , Hiroyasu Iso , Mark van der Laan

While significant progress has been made in heterogeneous treatment effect (HTE) estimation, the evaluation of HTE estimators remains underdeveloped. In this article, we propose a robust evaluation framework based on relative error, which…

Machine Learning · Statistics 2025-10-21 Jiayi Guo , Haoxuan Li , Ye Tian , Peng Wu

There is strong interest in estimating how the magnitude of treatment effects of an intervention vary across sub-groups of the population of interest. In our paper, we propose a two-study approach to first propose and then test…

Methodology · Statistics 2020-06-23 Rahul Ladhania , Amelia Haviland , Neeraj Sood , Edward Kennedy , Ateev Mehrotra

Long-term traffic prediction has always been a challenging task due to its dynamic temporal dependencies and complex spatial dependencies. In this paper, we propose a model that combines hybrid Transformer and spatio-temporal…

Machine Learning · Computer Science 2024-01-31 Wang Zhu , Doudou Zhang , Baichao Long , Jianli Xiao

Conditional Average Treatment Effects (CATE) estimation is one of the main challenges in causal inference with observational data. In addition to Machine Learning based-models, nonparametric estimators called meta-learners have been…

Machine Learning · Statistics 2023-06-06 Naoufal Acharki , Ramiro Lugo , Antoine Bertoncello , Josselin Garnier

Estimating heterogeneous treatment effects (HTEs) in time-varying settings is particularly challenging, as the probability of observing certain treatment sequences decreases exponentially with longer prediction horizons. Thus, the observed…

Machine Learning · Computer Science 2026-02-12 Konstantin Hess , Dennis Frauen , Mihaela van der Schaar , Stefan Feuerriegel

Transformer-based methods have achieved impressive results in time series forecasting. However, existing Transformers still exhibit limitations in sequence modeling as they tend to overemphasize temporal dependencies. This incurs additional…

Machine Learning · Computer Science 2025-12-16 Tan Wang , Yun Wei Dong , Qi Wang

The Transformer, a breakthrough architecture in artificial intelligence, owes its success to the attention mechanism, which utilizes long-range interactions in sequential data, enabling the emergent coherence between large language models…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Zhou , Bo-Wei Qin , Kai Du , Wei Lin

The need to evaluate treatment effectiveness is ubiquitous in most of empirical science, and interest in flexibly investigating effect heterogeneity is growing rapidly. To do so, a multitude of model-agnostic, nonparametric meta-learners…

Machine Learning · Statistics 2021-02-26 Alicia Curth , Mihaela van der Schaar

The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture…

Machine Learning · Computer Science 2025-04-11 Yuanyun Zhang , Shi Li

Methods for estimating heterogeneous treatment effect in observational data have largely focused on continuous or binary outcomes, and have been relatively less vetted with survival outcomes. Using flexible machine learning methods in the…

Applications · Statistics 2021-07-09 Liangyuan Hu , Jiayi Ji , Fan Li

Recent years, large scale clinical data like patient surveys and medical record data are playing an increasing role in medical data science. These large-scale clinical data, collectively referred to as "real-world data (RWD)". It is…

Methodology · Statistics 2024-02-23 Guanwenqing He , Ke Wan , Kazushi Maruo , Toshio Shimokawa

The estimation of heterogeneous treatment effects (HTEs) has attracted considerable interest in many disciplines, most prominently in medicine and economics. Contemporary research has so far primarily focused on continuous and binary…

Methodology · Statistics 2022-10-07 Susanne Dandl , Andreas Bender , Torsten Hothorn

Neural architectures such as Recurrent Neural Networks (RNNs), Transformers, and State-Space Models have shown great success in handling sequential data by learning temporal dependencies. Decision Trees (DTs), on the other hand, remain a…

Machine Learning · Computer Science 2025-02-07 Sascha Marton , Moritz Schneider

Accuracy and interpretability are two dominant features of successful predictive models. Typically, a choice must be made in favor of complex black box models such as recurrent neural networks (RNN) for accuracy versus less accurate but…

Machine Learning · Computer Science 2017-02-28 Edward Choi , Mohammad Taha Bahadori , Joshua A. Kulas , Andy Schuetz , Walter F. Stewart , Jimeng Sun