English
Related papers

Related papers: Divergence and Model Adequacy, A Semiparametric Ca…

200 papers

The paper introduces a new estimation method for the standard linear regression model. The procedure is not driven by the optimisation of any objective function rather, it is a simple weighted average of slopes from observation pairs. The…

Econometrics · Economics 2024-02-27 Felix Chan , Laszlo Matyas

Model checking is essential to evaluate the adequacy of statistical models and the validity of inferences drawn from them. Particularly, hierarchical models such as latent Gaussian models (LGMs) pose unique challenges as it is difficult to…

Methodology · Statistics 2023-07-25 Rafael Cabral , David Bolin , Håvard Rue

Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are…

Applications · Statistics 2017-07-04 Alexandra Chouldechova , Max G'Sell

For generic systems exhibiting power law behaviors, and hence multiscale dependencies, we propose a new, and yet simple, tool to analyze multifractality and intermittency, after noticing that these concepts are directly related to the…

Statistical Mechanics · Physics 2018-01-24 Carlos Granero-Belinchon , Stephane G. Roux , Nicolas B. Garnier

Disagreement between two classifiers regarding the class membership of an observation in pattern recognition can be indicative of an anomaly and its nuance. As in general classifiers base their decision on class aposteriori probabilities,…

Machine Learning · Computer Science 2016-07-05 Josef Kittler , Cemre Zor

Using a dynamical model to make predictions about a system has many sources of error. These can include errors in how the model was initialised but also errors in the dynamics of the model itself. For many applications in data assimilation,…

Numerical Analysis · Mathematics 2025-07-07 P. A. Browne

A priori error bounds have been derived for different balancing-related model reduction methods. The most classical result is a bound for balanced truncation and singular perturbation approximation that is applicable for asymptotically…

Numerical Analysis · Mathematics 2022-01-19 Björn Liljegren-Sailer

The classic integrated conditional moment test is a promising method for testing regression model misspecification. However, it severely suffers from the curse of dimensionality. To extend it to handle the testing problem for parametric…

Statistics Theory · Mathematics 2020-05-26 Falong Tan , Lixing Zhu

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

Artificial Intelligence · Computer Science 2021-08-17 Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan , Hanna Wallach

We introduce a methodology for robust Bayesian estimation with robust divergence (e.g., density power divergence or {\gamma}-divergence), indexed by a single tuning parameter. It is well known that the posterior density induced by robust…

Methodology · Statistics 2022-07-04 Shouto Yonekura , Shonosuke Sugasawa

To learn about real world phenomena, scientists have traditionally used models with clearly interpretable elements. However, modern machine learning (ML) models, while powerful predictors, lack this direct elementwise interpretability (e.g.…

Machine Learning · Statistics 2024-07-16 Timo Freiesleben , Gunnar König , Christoph Molnar , Alvaro Tejero-Cantero

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

The linear regression model is widely used in empirical work in Economics, Statistics, and many other disciplines. Researchers often include many covariates in their linear model specification in an attempt to control for confounders. We…

Statistics Theory · Mathematics 2017-12-12 Matias D. Cattaneo , Michael Jansson , Whitney K. Newey

In this paper we review important aspects of semiparametric theory and empirical processes that arise in causal inference problems. We begin with a brief introduction to the general problem of causal inference, and go on to discuss…

Statistics Theory · Mathematics 2016-07-25 Edward H. Kennedy

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

We consider the problem of efficient statistical inference for comparing two regression curves estimated from two samples of dependent measurements. Based on a representation of the best pair of linear unbiased estimators in continuous time…

Methodology · Statistics 2016-01-29 Holger Dette , Kirsten Schorning , Maria Konstantinou

A standard goal of model evaluation and selection is to find a model that approximates the truth well while at the same time is as parsimonious as possible. In this paper we emphasize the point of view that the models under consideration…

Methodology · Statistics 2010-10-05 Bruce Lindsay , Jiawei Liu

We examine the conditions under which descriptive inference can be based directly on the observed distribution in a non-probability sample, under both the super-population and quasi-randomisation modelling approaches. Review of existing…

Statistics Theory · Mathematics 2018-10-02 Li-Chun Zhang