English
Related papers

Related papers: A Randomized Permutation Whole-Model Test Heuristi…

200 papers

Metric learning seeks a transformation of the feature space that enhances prediction quality for the given task at hand. In this work we provide PAC-style sample complexity rates for supervised metric learning. We give matching lower- and…

Machine Learning · Computer Science 2015-05-12 Nakul Verma , Kristin Branson

Hypothesis testing of random forest (RF) variable importance measures (VIMP) remains the subject of ongoing research. Among recent developments, heuristic approaches to parametric testing have been proposed whose distributional assumptions…

Methodology · Statistics 2023-07-20 Alexander Hapfelmeier , Roman Hornung , Bernhard Haller

Anatomical shape analysis plays a pivotal role in clinical research and hypothesis testing, where the relationship between form and function is paramount. Correspondence-based statistical shape modeling (SSM) facilitates population-level…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jadie Adams , Krithika Iyer , Shireen Elhabian

This paper proposes the continuous semantic topic embedding model (CSTEM) which finds latent topic variables in documents using continuous semantic distance function between the topics and the words by means of the variational…

Machine Learning · Statistics 2017-11-27 Namkyu Jung , Hyeong In Choi

We propose a kernel-based partial permutation test for checking the equality of functional relationship between response and covariates among different groups. The main idea, which is intuitive and easy to implement, is to keep the…

Methodology · Statistics 2021-11-01 Xinran Li , Bo Jiang , Jun S. Liu

We propose the density ratio permutation test, a hypothesis test that assesses whether the ratio between two densities is proportional to a known function based on independent samples from each distribution. The test uses an efficient…

Methodology · Statistics 2026-01-14 Alberto Bordino , Thomas B. Berrett

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution…

Machine Learning · Computer Science 2022-10-12 Marvin Zhang , Sergey Levine , Chelsea Finn

The recently proposed statistical finite element (statFEM) approach synthesises measurement data with finite element models and allows for making predictions about the unknown true system response. We provide a probabilistic error analysis…

Statistics Theory · Mathematics 2025-06-17 Toni Karvonen , Fehmi Cirak , Mark Girolami

We compare different permutation tests and some parametric counterparts that are applicable to unbalanced designs in two by two designs. First the different approaches are shortly summarized. Then we investigate the behavior of the tests in…

Methodology · Statistics 2013-10-01 Sonja Hahn , Frank Konietschke , Luigi Salmaso

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

We consider the problem of constructing confidence intervals for the locations of change points in a high-dimensional mean shift model. To that end, we develop a locally refitted least squares estimator and obtain component-wise and…

Methodology · Statistics 2021-07-21 Abhishek Kaul , George Michailidis

Heteroskedasticity poses several methodological challenges in designing valid and powerful procedures for simultaneous testing of composite null hypotheses. In particular, the conventional practice of standardizing or re-scaling…

Methodology · Statistics 2025-09-04 Bowen Gang , Trambak Banerjee

The original formulation of BEAMS - Bayesian Estimation Applied to Multiple Species - showed how to use a dataset contaminated by points of multiple underlying types to perform unbiased parameter estimation. An example is cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-03-02 James Newling , Bruce. A. Bassett , Renée Hlozek , Martin Kunz , Mathew Smith , Melvin Varughese

In this paper, we study the model selection and structure specification for the generalised semi-varying coefficient models (GSVCMs), where the number of potential covariates is allowed to be larger than the sample size. We first propose a…

Statistics Theory · Mathematics 2015-10-30 Degui Li , Yuan Ke , Wenyang Zhang

Throughout the last decade, random forests have established themselves as among the most accurate and popular supervised learning methods. While their black-box nature has made their mathematical analysis difficult, recent work has…

Methodology · Statistics 2019-12-10 Tim Coleman , Wei Peng , Lucas Mentch

Relevance Vector Machine (RVM) is a supervised learning algorithm extended from Support Vector Machine (SVM) based on the Bayesian sparsity model. Compared with the regression problem, RVM classification is difficult to be conducted because…

Machine Learning · Statistics 2022-10-28 Wenyang Wang , Dongchu Sun , Zhuoqiong He

We introduce a new framework for constructing tests of general semiparametric hypotheses which have nontrivial power on the $n^{-1/2}$ scale in every direction, and can be tailored to put substantial power on alternatives of importance. The…

Statistics Theory · Mathematics 2007-06-13 Peter J. Bickel , Ya'acov Ritov , Thomas M. Stoker

We reconsider randomized algorithms for the low-rank approximation of symmetric positive semi-definite (SPSD) matrices such as Laplacian and kernel matrices that arise in data analysis and machine learning applications. Our main results…

Machine Learning · Computer Science 2013-06-05 Alex Gittens , Michael W. Mahoney

In this paper, we present the design of error-resilient machine learning architectures by employing a distributed machine learning framework referred to as classifier ensemble (CE). CE combines several simple classifiers to obtain a strong…

Machine Learning · Computer Science 2016-07-27 Sai Zhang , Naresh Shanbhag

Localized support vector machines solve SVMs on many spatially defined small chunks and one of their main characteristics besides the computational benefit compared to global SVMs is the freedom of choosing arbitrary kernel and…

Statistics Theory · Mathematics 2019-09-27 Ingrid Blaschzyk , Ingo Steinwart