English
Related papers

Related papers: Oracle Inequality for Instrumental Variable Regres…

200 papers

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

Outsourcing tasks to previously unknown parties is becoming more common. One specific such problem involves matching a set of workers to a set of tasks. Even if the latter have precise requirements, the quality of individual workers is…

Machine Learning · Computer Science 2017-08-01 Philip Ekman , Sebastian Bellevik , Christos Dimitrakakis , Aristide Tossou

Ou et al. (2022) introduce the problem of learning set functions from data generated by a so-called optimal subset oracle. Their approach approximates the underlying utility function with an energy-based model, whose parameters are…

Machine Learning · Computer Science 2024-12-18 Gözde Özcan , Chengzhi Shi , Stratis Ioannidis

Ordinal regression is commonly formulated as a multi-class problem with ordinal constraints. The challenge of designing accurate classifiers for ordinal regression generally increases with the number of classes involved, due to the large…

Machine Learning · Computer Science 2015-03-18 Chun-Wei Seah , Ivor W. Tsang , Yew-Soon Ong

We offer straightforward theoretical results that justify incorporating machine learning in the standard linear instrumental variable setting. The key idea is to use machine learning, combined with sample-splitting, to predict the treatment…

Econometrics · Economics 2021-06-22 Jiafeng Chen , Daniel L. Chen , Greg Lewis

Inequalities play an important role in pure and applied mathematics. In particular, Opial inequality plays a main role in the study of the existence and uniqueness of initial and boundary value problems for differential equations. It has…

Classical Analysis and ODEs · Mathematics 2022-04-22 Ana Portilla , José M. Rodríguez , José M. Sigarreta

This paper considers inference in a linear instrumental variable regression model with many potentially weak instruments, in the presence of heterogeneous treatment effects. I first show that existing test procedures, including those that…

Econometrics · Economics 2025-04-24 Luther Yap

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Linear regression studies the problem of estimating a model parameter $\beta^* \in \mathbb{R}^p$, from $n$ observations $\{(y_i,\mathbf{x}_i)\}_{i=1}^n$ from linear model $y_i = \langle \mathbf{x}_i,\beta^* \rangle + \epsilon_i$. We…

Machine Learning · Statistics 2015-05-14 Xinyang Yi , Zhaoran Wang , Constantine Caramanis , Han Liu

We consider the fractional posterior distribution that is obtained by updating a prior distribution via Bayes theorem with a fractional likelihood function, a usual likelihood function raised to a fractional power. First, we analyze the…

Statistics Theory · Mathematics 2016-11-08 Anirban Bhattacharya , Debdeep Pati , Yun Yang

Selection of important covariates and to drop the unimportant ones from a high-dimensional regression model is a long standing problem and hence have received lots of attention in the last two decades. After selecting the correct model, it…

Statistics Theory · Mathematics 2019-09-17 Debraj Das , Arindam Chatterjee , S. N. Lahiri

The classical concept of inequality curves and measures is extended to conditional inequality curves and measures and a curve of conditional inequality measures is introduced. This extension provides a more nuanced analysis of inequality in…

Statistics Theory · Mathematics 2025-04-23 Alicja Jokiel-Rokita , Sylwester Piątek , Rafał Topolnicki

Instrumental variable (IV) regression is a strategy for learning causal relationships in observational data. If measurements of input X and output Y are confounded, the causal relationship can nonetheless be identified if an instrumental…

Machine Learning · Computer Science 2020-07-17 Rahul Singh , Maneesh Sahani , Arthur Gretton

We aim at finding the value of an explanatory variable, through its expression in a large data-vector, without knowing the link function between the explanatory variable and the data-space. Sliced Inverse Regression (SIR) method allows for…

Instrumentation and Methods for Astrophysics · Physics 2017-07-03 V. Watson , JF. Trouilhet , F. Paletou , M. Gebran

A number of regularization methods for discrete inverse problems consist in considering weighted versions of the usual least square solution. However, these so-called filter methods are generally restricted to monotonic transformations,…

Statistics Theory · Mathematics 2011-05-05 Paul Rochet

We develop a framework for quantifying omitted variable bias (OVB) in nonlinear instrumental variable (IV) estimators, including the local average treatment effect (LATE), the LATE for the treated (LATT), and the partially linear IV model…

Econometrics · Economics 2026-04-07 Yu-Min Yen

It is well understood that classification algorithms, for example, for deciding on loan applications, cannot be evaluated for fairness without taking context into account. We examine what can be learned from a fairness oracle equipped with…

Machine Learning · Computer Science 2020-04-07 Cynthia Dwork , Christina Ilvento , Guy N. Rothblum , Pragya Sur

Machine learning has demonstrated remarkable performance over finite datasets, yet whether the scores over the fixed benchmarks can sufficiently indicate the model's performance in the real world is still in discussion. In reality, an ideal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Peiyan Zhang , Haoyang Liu , Chaozhuo Li , Xing Xie , Sunghun Kim , Haohan Wang

Ordinal regression refers to classifying object instances into ordinal categories. Ordinal regression is crucial for applications in various areas like facial age estimation, image aesthetics assessment, and even cancer staging, due to its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jinhong Wang , Jintai Chen , Jian Liu , Dongqi Tang , Danny Z. Chen , Jian Wu

We propose a procedure which combines hierarchical clustering with a test of overidentifying restrictions for selecting valid instrumental variables (IV) from a large set of IVs. Some of these IVs may be invalid in that they fail the…

Methodology · Statistics 2024-07-19 Nicolas Apfel , Xiaoran Liang