English
Related papers

Related papers: Multi-Task Learning for High-Dimensional Regressio…

200 papers

Imitation learning from demonstrations usually suffers from the confounding effects of unmeasured variables (i.e., unmeasured confounders) on the states and actions. If ignoring them, a biased estimation of the policy would be entailed. To…

Machine Learning · Computer Science 2025-07-24 Yan Zeng , Shenglan Nie , Feng Xie , Libo Huang , Peng Wu , Zhi Geng

Consider the problem of estimating the local average treatment effect with an instrument variable, where the instrument unconfoundedness holds after adjusting for a set of measured covariates. Several unknown functions of the covariates…

Methodology · Statistics 2020-09-22 Baoluo Sun , Zhiqiang Tan

Instrumental variables (IVs) provide a powerful strategy for identifying causal effects in the presence of unobservable confounders. Within the nonparametric setting (NPIV), recent methods have been based on nonlinear generalizations of…

Machine Learning · Statistics 2024-12-24 Yuri Fonseca , Caio Peixoto , Yuri Saporito

Instrumental variable analysis is a powerful tool for estimating causal effects when randomization or full control of confounders is not possible. The application of standard methods such as 2SLS, GMM, and more recent variants are…

Machine Learning · Statistics 2020-06-08 Andrew Bennett , Nathan Kallus , Tobias Schnabel

We propose a method to learn a common bias vector for a growing sequence of low-variance tasks. Unlike state-of-the-art approaches, our method does not require tuning any hyper-parameter. Our approach is presented in the non-statistical…

Machine Learning · Computer Science 2020-07-14 Giulia Denevi , Dimitris Stamos , Massimiliano Pontil

Causal inference is the process of using assumptions, study designs, and estimation strategies to draw conclusions about the causal relationships between variables based on data. This allows researchers to better understand the underlying…

Machine Learning · Computer Science 2022-12-13 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Fei Wu

Multi-task learning aims to boost the generalization performance of multiple related tasks simultaneously by leveraging information contained in those tasks. In this paper, we propose a multi-task learning framework, where we utilize prior…

Machine Learning · Computer Science 2023-01-05 Mengyuan Zhang , Kai Liu

In various statistical settings, the goal is to estimate a function which is restricted by the statistical model only through a conditional moment restriction. Prominent examples include the nonparametric instrumental variable framework for…

Methodology · Statistics 2025-05-28 AmirEmad Ghassami , James M. Robins , Andrea Rotnitzky

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

Multitask learning is a widely recognized technique in the field of computer vision and deep learning domain. However, it is still a research question in remote sensing, particularly for hyperspectral imaging. Moreover, most of the research…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Koushikey Chhapariya , Alexandre Benoit , Krishna Mohan Buddhiraju , Anil Kumar

We study the problem of estimating multiple linear regression equations for the purpose of both prediction and variable selection. Following recent work on multi-task learning Argyriou et al. [2008], we assume that the regression vectors…

Machine Learning · Statistics 2012-08-21 Karim Lounici , Massimiliano Pontil , Alexandre B. Tsybakov , Sara van de Geer

Multiple imputation has become one of the standard methods in drawing inferences in many incomplete data applications. Applications of multiple imputation in relatively more complex settings, such as high-dimensional clustered data, require…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

Multi-task learning (MTL) is useful for domains in which data originates from multiple sources that are individually under-sampled. MTL methods are able to learn classification models that have higher performance as compared to learning a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Bilal Ahmed , Thomas Thesen , Karen E. Blackmon , Ruben Kuzniecky , Orrin Devinsky , Jennifer G. Dy , Carla E. Brodley

Instrumental variables (IVs) are often continuous, arising in diverse fields such as economics, epidemiology, and the social sciences. Existing approaches for continuous IVs typically impose strong parametric models or assume homogeneous…

Methodology · Statistics 2025-10-17 Mei Dong , Lin Liu , Dingke Tang , Geoffrey Liu , Wei Xu , Linbo Wang

In lifelong learning, a learner faces a sequence of tasks with shared structure and aims to identify and leverage it to accelerate learning. We study the setting where such structure is captured by a common representation of data. Unlike…

Machine Learning · Computer Science 2025-11-04 Zhi Wang , Chicheng Zhang , Ramya Korlakai Vinayak

This article conducts a large dimensional study of a simple yet quite versatile classification model, encompassing at once multi-task and semi-supervised learning, and taking into account uncertain labeling. Using tools from random matrix…

Machine Learning · Statistics 2024-02-22 Victor Leger , Romain Couillet

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

Multi-task learning for dense prediction is limited by the need for extensive annotation for every task, though recent works have explored training with partial task labels. Leveraging the generalization power of diffusion models, we extend…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Anh-Quan Cao , Ivan Lopes , Raoul de Charette

Uncertainty in the estimation of the causal effect in observational studies is often due to unmeasured confounding, i.e., the presence of unobserved covariates linking treatments and outcomes. Instrumental Variables (IV) are commonly used…

Methodology · Statistics 2019-07-30 M. Usaid Awan , Yameng Liu , Marco Morucci , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

In many situations, researchers are interested in identifying dynamic effects of an irreversible treatment with a time-invariant binary instrumental variable (IV). For example, in evaluations of dynamic effects of training programs with a…

Econometrics · Economics 2025-01-28 Bruno Ferman , Otávio Tecchio