English
Related papers

Related papers: Orthogonal Learner for Estimating Heterogeneous Lo…

200 papers

Large language models (LLMs) acquire knowledge during pre-training, but over time, this knowledge may become incorrect or outdated, necessitating updates after training. Knowledge editing techniques address this issue without the need for…

Computation and Language · Computer Science 2024-10-16 Yuchen Cai , Ding Cao

Merging finetuned Large Language Models (LLMs) has become increasingly important for integrating diverse capabilities into a single unified model. However, prevailing model merging methods rely on linear arithmetic in Euclidean space, which…

Machine Learning · Computer Science 2026-02-06 Sihan Yang , Kexuan Shi , Weiyang Liu

We propose a semiparametric two-stage least square estimator for the heterogeneous treatment effects (HTE). HTE is the solution to certain integral equation which belongs to the class of Fredholm integral equations of the first kind, which…

Econometrics · Economics 2019-02-27 Keisuke Takahata , Takahiro Hoshino

This paper examines the identification and estimation of heterogeneous treatment effects in event studies, emphasizing the importance of both lagged dependent variables and treatment effect heterogeneity. We show that omitting lagged…

Econometrics · Economics 2025-09-18 Irene Botosaru , Laura Liu

The inductive bias of a neural network is largely determined by the architecture and the training algorithm. To achieve good generalization, how to effectively train a neural network is of great importance. We propose a novel orthogonal…

Machine Learning · Computer Science 2021-06-08 Weiyang Liu , Rongmei Lin , Zhen Liu , James M. Rehg , Liam Paull , Li Xiong , Le Song , Adrian Weller

In many social, behavioral, and biomedical sciences, treatment effect estimation is a crucial step in understanding the impact of an intervention, policy, or treatment. In recent years, an increasing emphasis has been placed on…

Methodology · Statistics 2024-10-10 Xinhai Zhang , Xingye Qiao

Deep learning models have demonstrated promising results in estimating treatment effects (TEE). However, most of them overlook the variations in treatment outcomes among subgroups with distinct characteristics. This limitation hinders their…

Machine Learning · Computer Science 2024-01-31 Seungyeon Lee , Ruoqi Liu , Wenyu Song , Ping Zhang

Learning clients embeddings from sequences of their historic communications is central to financial applications. While large language models (LLMs) offer general world knowledge, their direct use on long event sequences is computationally…

Ordinal learning (OL) is a type of machine learning models with broad utility in health care applications such as diagnosis of different grades of a disease (e.g., mild, modest, severe) and prediction of the speed of disease progression…

Machine Learning · Computer Science 2023-12-18 Lujia Wang , Hairong Wang , Yi Su , Fleming Lure , Jing Li

The heterogeneous network is a robust data abstraction that can model entities of different types interacting in various ways. Such heterogeneity brings rich semantic information but presents nontrivial challenges in aggregating the…

Machine Learning · Computer Science 2020-09-18 Nhat Tran , Jean Gao

Correlated outcomes are common in many practical problems. In some settings, one outcome is of particular interest, and others are auxiliary. To leverage information shared by all the outcomes, traditional multi-task learning (MTL)…

Methodology · Statistics 2023-03-23 Muxuan Liang , Jaeyoung Park , Qing Lu , Xiang Zhong

Machine Learning requires a large amount of training data in order to build accurate models. Sometimes the data arrives over time, requiring significant storage space and recalculating the model to account for the new data. On-line learning…

Machine Learning · Computer Science 2023-07-07 Mohammad Abu-Shaira , Greg Speegle

A central goal of causal inference is to detect and estimate the treatment effects of a given treatment or intervention on an outcome variable of interest, where a member known as the heterogeneous treatment effect (HTE) is of growing…

Statistics Theory · Mathematics 2020-10-27 Zijun Gao , Yanjun Han

There is strong interest in estimating how the magnitude of treatment effects of an intervention vary across sub-groups of the population of interest. In our paper, we propose a two-study approach to first propose and then test…

Methodology · Statistics 2020-06-23 Rahul Ladhania , Amelia Haviland , Neeraj Sood , Edward Kennedy , Ateev Mehrotra

There has been significant work recently in developing machine learning (ML) models in high energy physics (HEP) for tasks such as classification, simulation, and anomaly detection. Often these models are adapted from those designed for…

High Energy Physics - Experiment · Physics 2023-06-13 Zichun Hao , Raghav Kansal , Javier Duarte , Nadezda Chernyavskaya

An individualized treatment rule (ITR) tailors treatments to a patient's specific characteristics. However, randomized controlled trials (RCTs) are often underpowered to detect the treatment effect heterogeneity needed for reliable ITR…

Methodology · Statistics 2026-04-14 Yuan Bian , Donglin Zeng , Hyun-Joon Yang , Leanne M. Williams , Yuanjia Wang

Drug-target interaction (DTI) prediction is crucial for drug development and repositioning. Methods using heterogeneous graph neural networks (HGNNs) for DTI prediction have become a promising approach, with attention-based models often…

Biomolecules · Quantitative Biology 2024-11-05 Junwei Hu , Michael Bewong , Selasi Kwashie , Wen Zhang , Vincent M. Nofong , Guangsheng Wu , Zaiwen Feng

Modern large language models (LLMs) excel at tasks that require storing and retrieving knowledge, such as factual recall and question answering. Transformers are central to this capability because they can encode information during training…

Machine Learning · Statistics 2026-03-18 Nuri Mert Vural , Alberto Bietti , Mahdi Soltanolkotabi , Denny Wu

Conditional Average Treatment Effect (CATE) estimation in practice demands three properties simultaneously: heterogeneous effects $\tau(x)$, calibrated uncertainty over them, and robustness to the heavy tails that contaminate real outcome…

Machine Learning · Statistics 2026-05-01 Eichi Uehara

An important challenge in metric learning is scalability to both size and dimension of input data. Online metric learning algorithms are proposed to address this challenge. Existing methods are commonly based on (Passive Aggressive) PA…

Machine Learning · Computer Science 2020-10-13 Davood Zabihzadeh , Amar Tuama , Ali Karami-Mollaee