English
Related papers

Related papers: Orthogonal Representation Learning for Estimating …

200 papers

Estimating the average treatment effect (ATE) from observational data is challenging due to selection bias. Existing works mainly tackle this challenge in two ways. Some researchers propose constructing a score function that satisfies the…

Machine Learning · Computer Science 2022-09-07 Yiyan Huang , Cheuk Hang Leung , Shumin Ma , Qi Wu , Dongdong Wang , Zhixiang Huang

Motivated by applications in personalized medicine and individualized policymaking, there is a growing interest in techniques for quantifying treatment effect heterogeneity in terms of the conditional average treatment effect (CATE). Some…

Methodology · Statistics 2024-06-04 Pawel Morzywolek , Johan Decruyenaere , Stijn Vansteelandt

Orthogonal meta-learners, such as DR-learner, R-learner and IF-learner, are increasingly used to estimate conditional average treatment effects. They improve convergence rates relative to na\"{\i}ve meta-learners (e.g., T-, S- and…

Methodology · Statistics 2023-11-17 Stijn Vansteelandt , Paweł Morzywołek

Deep neural networks can empirically perform efficient hierarchical learning, in which the layers learn useful representations of the data. However, how they make use of the intermediate representations are not explained by recent theories…

Machine Learning · Computer Science 2021-03-08 Minshuo Chen , Yu Bai , Jason D. Lee , Tuo Zhao , Huan Wang , Caiming Xiong , Richard Socher

Variational representations of divergences and distances between high-dimensional probability distributions offer significant theoretical insights and practical advantages in numerous research areas. Recently, they have gained popularity in…

Machine Learning · Computer Science 2022-03-25 Jeremiah Birrell , Markos A. Katsoulakis , Yannis Pantazis

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

Estimation of heterogeneous long-term treatment effects (HLTEs) is widely used for personalized decision-making in marketing, economics, and medicine, where short-term randomized experiments are often combined with long-term observational…

Machine Learning · Computer Science 2026-04-02 Haorui Ma , Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

Modern deep learning methods provide effective means to learn good representations. However, is a good representation itself sufficient for sample efficient reinforcement learning? This question has largely been studied only with respect to…

Machine Learning · Computer Science 2020-03-02 Simon S. Du , Sham M. Kakade , Ruosong Wang , Lin F. Yang

Machine learning can significantly improve performance for decision-making under uncertainty across a wide range of domains. However, ensuring robustness guarantees requires well-calibrated uncertainty estimates, which can be difficult to…

Machine Learning · Computer Science 2026-02-03 Christopher Yeh , Nicolas Christianson , Alan Wu , Adam Wierman , Yisong Yue

Temporal-difference and Q-learning play a key role in deep reinforcement learning, where they are empowered by expressive nonlinear function approximators such as neural networks. At the core of their empirical successes is the learned…

Machine Learning · Computer Science 2024-04-02 Yufeng Zhang , Qi Cai , Zhuoran Yang , Yongxin Chen , Zhaoran Wang

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

Formulating real-world optimization problems often begins with making predictions from historical data (e.g., an optimizer that aims to recommend fast routes relies upon travel-time predictions). Typically, learning the prediction model…

Machine Learning · Computer Science 2021-12-20 Chris Cameron , Jason Hartford , Taylor Lundy , Kevin Leyton-Brown

It has been a long-standing goal in machine learning, as well as in AI more generally, to develop life-long learning systems that learn many different tasks over time, and reuse insights from tasks learned, "learning to learn" as they do…

Machine Learning · Computer Science 2014-12-08 Maria-Florina Balcan , Avrim Blum , Santosh Vempala

We introduce efficient plug-in (EP) learning, a novel framework for the estimation of heterogeneous causal contrasts, such as the conditional average treatment effect and conditional relative risk. The EP-learning framework enjoys the same…

Machine Learning · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke

Optimization with orthogonality constraints frequently arises in various fields such as machine learning. Riemannian optimization offers a powerful framework for solving these problems by equipping the constraint set with a Riemannian…

Optimization and Control · Mathematics 2025-05-20 Andi Han , Pierre-Louis Poirion , Akiko Takeda

Learning latent representations has aided operational decision-making in several disciplines. Its advantages include uncovering hidden interactions in data and automating procedures which were performed manually in the past. Representation…

Machine Learning · Computer Science 2022-05-19 Christos Pylianidis , Ioannis N. Athanasiadis

Unobserved confounding prevents standard covariate adjustment from identifying causal response functions in observational studies. Proxy causal learning addresses this problem through bridge equations involving treatment- and…

Machine Learning · Computer Science 2026-05-12 Bariscan Bozkurt , Alexandre Galashov , Dimitri Meunier , Zikai Shen , Arthur Gretton , Houssam Zenati

A continual learning agent should be able to build on top of existing knowledge to learn on new data quickly while minimizing forgetting. Current intelligent systems based on neural network function approximators arguably do the…

Machine Learning · Computer Science 2019-11-01 Khurram Javed , Martha White

In high-dimensional prediction settings, it remains challenging to reliably estimate the test performance. To address this challenge, a novel performance estimation framework is presented. This framework, called Learn2Evaluate, is based on…

Methodology · Statistics 2022-06-09 Jeroen M. Goedhart , Thomas Klausch , Mark A. van de Wiel

We propose a new representation learning solution for the classification of cognitive load based on Electroencephalogram (EEG). Our method integrates both time and frequency domains by first passing the raw EEG signals through the…

Human-Computer Interaction · Computer Science 2025-11-18 Prithila Angkan , Amin Jalali , Paul Hungler , Ali Etemad