English
Related papers

Related papers: Towards R-learner with Continuous Treatments

200 papers

In this article, we aim to provide a literature review of different formulations and approaches to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We begin by discussing our perspective on why RL is a…

Machine Learning · Computer Science 2022-11-15 Khimya Khetarpal , Matthew Riemer , Irina Rish , Doina Precup

We provide a statistical analysis of regularization-based continual learning on a sequence of linear regression tasks, with emphasis on how different regularization terms affect the model performance. We first derive the convergence rate…

Machine Learning · Computer Science 2024-06-11 Xuyang Zhao , Huiyuan Wang , Weiran Huang , Wei Lin

We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning…

Methodology · Statistics 2020-08-27 Daniel Jacob

This paper investigates the use of regularization priors in the context of treatment effect estimation using observational data where the number of control variables is large relative to the number of observations. First, the phenomenon of…

Methodology · Statistics 2016-12-30 P. Richard Hahn , Carlos M. Carvalho , Jingyu He , David Puelz

The theory of spectral filtering is a remarkable tool to understand the statistical properties of learning with kernels. For least squares, it allows to derive various regularization schemes that yield faster convergence rates of the excess…

Machine Learning · Computer Science 2021-11-11 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

This paper focuses on causal representation learning (CRL) under a general nonparametric latent causal model and a general transformation model that maps the latent data to the observational data. It establishes identifiability and…

Machine Learning · Computer Science 2024-02-15 Burak Varıcı , Emre Acartürk , Karthikeyan Shanmugam , Ali Tajer

Inferring the heterogeneous treatment effect is a fundamental problem in the sciences and commercial applications. In this paper, we focus on estimating Conditional Average Treatment Effect (CATE), that is, the difference in the conditional…

Methodology · Statistics 2021-03-23 Haomiao Meng , Xingye Qiao

Motivated by applications in personalized medicine and individualized policymaking, there is a growing interest in techniques for quantifying treatment effect heterogeneity in terms of the conditional average treatment effect (CATE). Some…

Methodology · Statistics 2024-06-04 Pawel Morzywolek , Johan Decruyenaere , Stijn Vansteelandt

We consider the estimation of treatment effects in settings when multiple treatments are assigned over time and treatments can have a causal effect on future outcomes or the state of the treated unit. We propose an extension of the…

Econometrics · Economics 2021-06-18 Greg Lewis , Vasilis Syrgkanis

Many practical decision-making problems in economics and healthcare seek to estimate the average treatment effect (ATE) from observational data. The Double/Debiased Machine Learning (DML) is one of the prevalent methods to estimate ATE in…

Econometrics · Economics 2022-12-07 Yiyan Huang , Cheuk Hang Leung , Xing Yan , Qi Wu , Shumin Ma , Zhiri Yuan , Dongdong Wang , Zhixiang Huang

Estimating the conditional average treatment effect (CATE) from observational data is relevant for many applications such as personalized medicine. Here, we focus on the widespread setting where the observational data come from multiple…

Machine Learning · Computer Science 2024-06-05 Jonas Schweisthal , Dennis Frauen , Mihaela van der Schaar , Stefan Feuerriegel

One of the most interesting application scenarios in anomaly detection is when sequential data are targeted. For example, in a safety-critical environment, it is crucial to have an automatic detection system to screen the streaming data…

Machine Learning · Computer Science 2020-04-23 Min-hwan Oh , Garud Iyengar

This article proposes a meta-learning method for estimating the conditional average treatment effect (CATE) from a few observational data. The proposed method learns how to estimate CATEs from multiple tasks and uses the knowledge for…

Machine Learning · Statistics 2023-05-22 Tomoharu Iwata , Yoichi Chikahara

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn new tasks and overcome forgetting the knowledge obtained from the…

Machine Learning · Computer Science 2022-02-08 Yujiang He

To enhance the cross-target and cross-scene generalization of target-driven visual navigation based on deep reinforcement learning (RL), we introduce an information-theoretic regularization term into the RL objective. The regularization…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Kai Xu , Jun Wang , Mingliang Xu , Xiaoxi Gong , Dinesh Manocha

Instrumental variable methods are fundamental to causal inference when treatment assignment is confounded by unobserved variables. In this article, we develop a general nonparametric causal framework for identification and learning with…

Methodology · Statistics 2026-02-10 Shuyuan Chen , Peng Zhang , Yifan Cui

We present a novel approach to nonlinear constrained Tikhonov regularization from the viewpoint of optimization theory. A second-order sufficient optimality condition is suggested as a nonlinearity condition to handle the nonlinearity of…

Numerical Analysis · Mathematics 2015-05-30 Kazufumi Ito , Bangti Jin

We study the benign overfitting theory in the prediction of the conditional average treatment effect (CATE), with linear regression models. As the development of machine learning for causal inference, a wide range of large-scale models for…

Econometrics · Economics 2022-02-17 Masahiro Kato , Masaaki Imaizumi

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

Machine Learning · Computer Science 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher