English
Related papers

Related papers: Dual Instrumental Variable Regression

200 papers

Traditional instrumental variable (IV) methods often struggle with weak or invalid instruments and rely heavily on external data. We introduce a Synthetic Instrumental Variable (SIV) approach that constructs valid instruments using only…

Methodology · Statistics 2025-12-22 Ratbek Dzhumashev , Ainura Tursunalieva

Estimating causal effects from high-dimensional, structured exposures is a fundamental challenge in modern applications ranging from neuroscience and finance to environmental science. While the literature has addressed high-dimensional…

Methodology · Statistics 2026-04-29 Samhita Pal , Dhrubajyoti Ghosh

We are in the middle of a remarkable rise in the use and capability of artificial intelligence. Much of this growth has been fueled by the success of deep learning architectures: models that map from observables to outputs via multiple…

Applications · Statistics 2017-01-02 Jason Hartford , Greg Lewis , Kevin Leyton-Brown , Matt Taddy

We propose a computationally efficient estimator, formulated as a convex program, for a broad class of non-linear regression problems that involve difference of convex (DC) non-linearities. The proposed method can be viewed as a significant…

Machine Learning · Statistics 2019-04-01 Sohail Bahmani

We consider a nonparametric regression model with continuous endogenous independent variables when only discrete instruments are available that are independent of the error term. Although this framework is very relevant for applied…

Econometrics · Economics 2024-10-18 Samuele Centorrino , Frédérique Fève , Jean-Pierre Florens

We consider a generic empirical composition optimization problem, where there are empirical averages present both outside and inside nonlinear loss functions. Such a problem is of interest in various machine learning applications, and…

Optimization and Control · Mathematics 2019-11-04 Adithya M. Devraj , Jianshu Chen

Instrumental variables (IV) regression is a popular method for the estimation of the endogenous treatment effects. Conventional IV methods require all the instruments are relevant and valid. However, this is impractical especially in…

Econometrics · Economics 2020-06-29 Qingliang Fan , Yaqian Wu

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

We study the problem of variable selection in convex nonparametric regression. Under the assumption that the true regression function is convex and sparse, we develop a screening procedure to select a subset of variables that contains the…

Statistics Theory · Mathematics 2014-11-19 Min Xu , Minhua Chen , John Lafferty

We develop a novel primal-dual algorithm to solve a class of nonsmooth and nonlinear compositional convex minimization problems, which covers many existing and brand-new models as special cases. Our approach relies on a combination of a new…

Optimization and Control · Mathematics 2021-04-20 Yuzixuan Zhu , Deyi Liu , Quoc Tran-Dinh

This paper studies the confounding effects from the unmeasured confounders and the imbalance of observed confounders in IV regression and aims at unbiased causal effect estimation. Recently, nonlinear IV estimators were proposed to allow…

Artificial Intelligence · Computer Science 2022-11-21 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Bo Li , Fei Wu

We proposed an iterate scheme for solving convex-concave saddle-point problems associated with general convex-concave functions. We demonstrated that when our iterate scheme is applied to a special class of convex-concave functions, which…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

Machine Learning · Computer Science 2016-11-04 P Balamurugan , Francis Bach

The problem of endogeneity in statistics and econometrics is often handled by introducing instrumental variables (IV) which fulfill the mean independence assumption, i.e. the unobservable is mean independent of the instruments. When full…

Computation · Statistics 2021-08-13 Fabian Dunker

The method of instrumental variables provides a fundamental and practical tool for causal inference in many empirical studies where unmeasured confounding between the treatments and the outcome is present. Modern data such as the genetical…

Methodology · Statistics 2022-10-28 Ziang Niu , Yuwen Gu , Wei Li

In offline reinforcement learning (RL) an optimal policy is learned solely from a priori collected observational data. However, in observational data, actions are often confounded by unobserved variables. Instrumental variables (IVs), in…

Machine Learning · Statistics 2024-10-16 Luofeng Liao , Zuyue Fu , Zhuoran Yang , Yixin Wang , Mladen Kolar , Zhaoran Wang

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen

We propose a flexible yet interpretable model for high-dimensional data with time-varying second order statistics, motivated and applied to functional neuroimaging data. Motivated by the neuroscience literature, we factorize the covariances…

Machine Learning · Statistics 2021-07-20 Katherine Tsai , Mladen Kolar , Oluwasanmi Koyejo

We consider empirical risk minimization of linear predictors with convex loss functions. Such problems can be reformulated as convex-concave saddle point problems, and thus are well suitable for primal-dual first-order algorithms. However,…

Optimization and Control · Mathematics 2017-03-09 Jialei Wang , Lin Xiao

Primal-dual algorithm (PDA) is a classic and popular scheme for convex-concave saddle point problems. It is universally acknowledged that the proximal terms in the subproblems about the primal and dual variables are crucial to the…

Optimization and Control · Mathematics 2025-04-24 Shuning Liu , Zexian Liu