English
Related papers

Related papers: Sensitivity of principal Hessian direction analysi…

200 papers

It is widely held that one cause of downstream bias in classifiers is bias present in the training data. Rectifying such biases may involve context-dependent interventions such as training separate models on subgroups, removing features…

Machine Learning · Computer Science 2024-06-04 Peter W. Chang , Leor Fishman , Seth Neel

We consider the problem of identifying whether findings replicate from one study of high dimension to another, when the primary study guides the selection of hypotheses to be examined in the follow-up study as well as when there is no…

Methodology · Statistics 2014-01-28 Marina Bogomolov , Ruth Heller

In applications involving ordinal predictors, common approaches to reduce dimensionality are either extensions of unsupervised techniques such as principal component analysis, or variable selection procedures that rely on modeling the…

Statistics Theory · Mathematics 2017-10-13 Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

Influence functions estimate the effect of removing a training point on a model without the need to retrain. They are based on a first-order Taylor approximation that is guaranteed to be accurate for sufficiently small changes to the model,…

Machine Learning · Computer Science 2019-11-22 Pang Wei Koh , Kai-Siang Ang , Hubert H. K. Teo , Percy Liang

Pattern recognition constitutes a particularly important task underlying a great deal of scientific and technologica activities. At the same time, pattern recognition involves several challenges, including the choice of features to…

Machine Learning · Computer Science 2024-09-04 Alexandre Benatti , Luciano da F. Costa

We study the relationship between randomized low influence functions and differentially private mechanisms. Our main aim is to formally determine whether differentially private mechanisms are low influence and whether low influence…

Information Theory · Computer Science 2021-02-09 Rafael G. L. D'Oliveira , Salman Salamatian , Muriel Médard , Parastoo Sadeghi

A general approach to a broad class of asymptotic problems related to long-time influence of small perturbations, of both deterministic and stochastic type, is presented in the paper. The main characteristic of this influence is a limiting…

Probability · Mathematics 2020-10-06 Mark Freidlin

This paper introduces a direct differentiation-based framework that unifies the derivation of influence functions across parametric, nonparametric, and semiparametric models. We show that the Riesz representer of the functional derivative…

Econometrics · Economics 2026-05-04 Xiye Yang , Ruonan Xu

Scientists have been interested in estimating causal peer effects to understand how people's behaviors are affected by their network peers. However, it is well known that identification and estimation of causal peer effects are challenging…

Methodology · Statistics 2021-09-07 Naoki Egami , Eric J. Tchetgen Tchetgen

A trend in all scientific disciplines, based on advances in technology, is the increasing availability of high dimensional data in which are buried important information. A current urgent challenge to statisticians is to develop effective…

Applications · Statistics 2010-09-30 Herman Chernoff , Shaw-Hwa Lo , Tian Zheng

High fidelity models used in many science and engineering applications couple multiple physical states and parameters. Inverse problems arise when a model parameter cannot be determined directly, but rather is estimated using (typically…

Optimization and Control · Mathematics 2020-12-30 Isaac Sunseri , Joseph Hart , Bart van Bloemen Waanders , Alen Alexanderian

Machine learning models can automatically learn complex relationships, such as non-linear and interaction effects. Interpretable machine learning methods such as partial dependence plots visualize marginal feature effects but may lead to…

Machine Learning · Statistics 2022-02-16 Julia Herbinger , Bernd Bischl , Giuseppe Casalicchio

Inverse problems constrained by partial differential equations (PDEs) play a critical role in model development and calibration. In many applications, there are multiple uncertain parameters in a model that must be estimated. However, high…

Numerical Analysis · Mathematics 2022-10-27 Joseph Hart , Bart van Bloemen Waanders

While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a…

Methodology · Statistics 2025-01-10 Ryan Christ , Ira Hall , David Steinsaltz

Normalizing flows are prominent deep generative models that provide tractable probability distributions and efficient density estimation. However, they are well known to fail while detecting Out-of-Distribution (OOD) inputs as they directly…

Machine Learning · Computer Science 2021-11-17 Nishant Kumar , Pia Hanfeld , Michael Hecht , Michael Bussmann , Stefan Gumhold , Nico Hoffmann

While there is considerable work on change point analysis in univariate time series, more and more data being collected comes from high dimensional multivariate settings. This paper introduces the asymptotic concept of high dimensional…

Statistics Theory · Mathematics 2016-06-28 John A. D. Aston , Claudia Kirch

Empirical complex systems can be characterized not only by pairwise interactions, but also by higher-order (group) interactions influencing collective phenomena, from metabolic reactions to epidemics. Nevertheless, higher-order networks'…

Physics and Society · Physics 2026-01-01 Maxime Lucas , Luca Gallo , Arsham Ghavasieh , Federico Battiston , Manlio De Domenico

The identification of influential spreaders in complex networks is a popular topic in studies of network characteristics. Many centrality measures have been proposed to address this problem, but most have limitations. In this paper, a…

Social and Information Networks · Computer Science 2019-10-08 Tao Wen , Yong Deng

In sentiment classification, the enormous amount of textual data, its immense dimensionality, and inherent noise make it extremely difficult for machine learning classifiers to extract high-level and complex abstractions. In order to make…

Information Retrieval · Computer Science 2020-06-09 Aftab Anjum , Mazharul Islam , Lin Wang

Existing perceptual similarity metrics assume an image and its reference are well aligned. As a result, these metrics are often sensitive to a small alignment error that is imperceptible to the human eyes. This paper studies the effect of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Abhijay Ghildyal , Feng Liu