English
Related papers

Related papers: Resistant Inference in Instrumental Variable Model…

200 papers

We consider outlier-robust and sparse estimation of linear regression coefficients, when the covariates and the noises are contaminated by adversarial outliers and noises are sampled from a heavy-tailed distribution. Our results present…

Statistics Theory · Mathematics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

We investigate two important properties of M-estimator, namely, robustness and tractability, in linear regression setting, when the observations are contaminated by some arbitrary outliers. Specifically, robustness means the statistical…

Statistics Theory · Mathematics 2019-06-07 Ruizhi Zhang , Yajun Mei , Jianjun Shi , Huan Xu

Learning representations purely from observations concerns the problem of learning a low-dimensional, compact representation which is beneficial to prediction models. Under the hypothesis that the intrinsic latent factors follow some casual…

Machine Learning · Computer Science 2023-10-24 Mengyue Yang , Xinyu Cai , Furui Liu , Weinan Zhang , Jun Wang

Instrumental variable methods have been widely used to identify causal effects in the presence of unmeasured confounding. A key identification condition known as the exclusion restriction states that the instrument cannot have a direct…

Methodology · Statistics 2022-08-05 Baoluo Sun , Yifan Cui , Eric Tchetgen Tchetgen

Instrumental variables estimation has gained considerable traction in recent decades as a tool for causal inference, particularly amongst empirical researchers. This paper makes three contributions. First, we provide a detailed theoretical…

Econometrics · Economics 2021-04-27 Aiwei Huang , Madhurima Chandra , Laura Malkhasyan

Irregular functional data in which densely sampled curves are observed over different ranges pose a challenge for modeling and inference, and sensitivity to outlier curves is a concern in applications. Motivated by applications in…

Methodology · Statistics 2021-05-14 Yeonjoo Park , Xiaohui Chen , Douglas G. Simpson

Learning a causal effect from observational data is not straightforward, as this is not possible without further assumptions. If hidden common causes between treatment $X$ and outcome $Y$ cannot be blocked by other measurements, one…

Machine Learning · Statistics 2015-11-10 Ricardo Silva , Shohei Shimizu

Weighting estimators based on propensity scores are widely used for causal estimation in a variety of contexts, such as observational studies, marginal structural models and interference. They enjoy appealing theoretical properties such as…

Methodology · Statistics 2021-10-06 Linbo Wang , Yuexia Zhang , Thomas S. Richardson , Xiao-Hua Zhou

Nonparametric regression models offer a way to understand and quantify relationships between variables without having to identify an appropriate family of possible regression functions. Although many estimation methods for these models have…

Methodology · Statistics 2023-04-07 Matias Salibian-Barrera

Instrumental variables allow for quantification of cause and effect relationships even in the absence of interventions. To achieve this, a number of causal assumptions must be met, the most important of which is the independence assumption,…

Machine Learning · Statistics 2021-11-05 Nikolai Miklin , Mariami Gachechiladze , George Moreno , Rafael Chaves

Adversarial examples are a type of attack on machine learning (ML) systems which cause misclassification of inputs. Achieving robustness against adversarial examples is crucial to apply ML in the real world. While most prior work on…

Cryptography and Security · Computer Science 2020-07-16 Nico Döttling , Kathrin Grosse , Michael Backes , Ian Molloy

Classical discriminant analysis (DA) is based on the mean and empirical covariance matrix of each class, both of which are sensitive to outliers in the data. In the past the focus was on casewise outliers, that is, datapoints that lie far…

Methodology · Statistics 2026-05-29 Fabio Centofanti , Can Hakan Dagidir , Mia Hubert , Peter J. Rousseeuw

Several recent works have developed methods for training classifiers that are certifiably robust against norm-bounded adversarial perturbations. These methods assume that all the adversarial transformations are equally important, which is…

Machine Learning · Computer Science 2019-03-06 Xiao Zhang , David Evans

The performance of machine learning models can be impacted by changes in data over time. A promising approach to address this challenge is invariant learning, with a particular focus on a method known as invariant risk minimization (IRM).…

Machine Learning · Computer Science 2024-04-09 Wenlu Tang , Zicheng Liu

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Functional data analysis is a fast evolving branch of statistics. Estimation procedures for the popular functional linear model either suffer from lack of robustness or are computationally burdensome. To address these shortcomings, a…

Methodology · Statistics 2021-08-27 Ioannis Kalogridis , Stefan Van Aelst

We study the problem of robustly estimating the posterior distribution for the setting where observed data can be contaminated with potentially adversarial outliers. We propose Rob-ULA, a robust variant of the Unadjusted Langevin Algorithm…

Machine Learning · Statistics 2019-07-30 Kush Bhatia , Yi-An Ma , Anca D. Dragan , Peter L. Bartlett , Michael I. Jordan

We present a comprehensive R software ivmodel for analyzing instrumental variables with one endogenous variable. The package implements a general class of estimators called k- class estimators and two confidence intervals that are fully…

Applications · Statistics 2020-07-09 Hyunseung Kang , Yang Jiang , Qingyuan Zhao , Dylan S. Small

This paper considers an endogenous binary response model with many weak instruments. We employ a control function approach and a regularization scheme to obtain better estimation results for the endogenous binary response model in the…

Econometrics · Economics 2024-07-02 Dakyung Seong

Among semiparametric regression models, partially linear additive models provide a useful tool to include additive nonparametric components as well as a parametric component, when explaining the relationship between the response and a set…

Methodology · Statistics 2024-02-01 Graciela Boente , Alejandra Martínez