English
Related papers

Related papers: Feature Extraction for Universal Hypothesis Testin…

200 papers

Maximum margin binary classification is one of the most fundamental algorithms in machine learning, yet the role of featurization maps and the high-dimensional asymptotics of the misclassification error for non-Gaussian features are still…

Statistics Theory · Mathematics 2023-10-03 Andrea Montanari , Feng Ruan , Basil Saeed , Youngtak Sohn

With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Qi Qian , Juhua Hu , Hao Li

We present a novel algorithm for generating robust and consistent hypotheses for multiple-structure model fitting. Most of the existing methods utilize random sampling which produce varying results especially when outlier ratio is high. For…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Kwang Hee Lee , Chanki Yu , Sang Wook Lee

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

Effective feature selection is essential for high-dimensional data analysis and machine learning. Unsupervised feature selection (UFS) aims to simultaneously cluster data and identify the most discriminative features. Most existing UFS…

Machine Learning · Statistics 2026-03-23 Feng Yu , MD Saifur Rahman Mazumder , Ying Su , Oscar Contreras Velasco

Equivalence testing, a fundamental problem in the field of distribution testing, seeks to infer if two unknown distributions on $[n]$ are the same or far apart in the total variation distance. Conditional sampling has emerged as a powerful…

Data Structures and Algorithms · Computer Science 2024-03-08 Diptarka Chakraborty , Sourav Chakraborty , Gunjan Kumar , Kuldeep S. Meel

We introduce a method for deterministic decoupling of global features and show its applicability to improve data analysis performance, as well as to open new venues for feature transfer. We propose a new formalism that is based on defining…

Machine Learning · Computer Science 2022-07-06 Eduardo Martinez-Enriquez , Maria del Mar Gonzalez , Javier Portilla

We consider nonparametric or universal sequential hypothesis testing problem when the distribution under the null hypothesis is fully known but the alternate hypothesis corresponds to some other unknown distribution. These algorithms are…

Information Theory · Computer Science 2013-08-30 Jithin K. Sreedharan , Vinod Sharma

A general Bayesian framework for model selection on random network models regarding their features is considered. The goal is to develop a principle Bayesian model selection approach to compare different fittable, not necessarily nested,…

Methodology · Statistics 2020-04-30 Papamichalis Marios

The extraction of nonstationary signals from blind and semi-blind multivariate observations is a recurrent problem. Numerous algorithms have been developed for this problem, which are based on the exact or approximate joint diagonalization…

Signal Processing · Electrical Eng. & Systems 2021-08-27 Reza Sameni , Christian Jutten

Many high-dimensional hypothesis tests aim to globally examine marginal or low-dimensional features of a high-dimensional joint distribution, such as testing of mean vectors, covariance matrices and regression coefficients. This paper…

Statistics Theory · Mathematics 2020-02-04 Yinqiu He , Gongjun Xu , Chong Wu , Wei Pan

A central question in random matrix theory is universality. When an emergent phenomena is observed from a large collection of chosen random variables it is natural to ask if this behavior is specific to the chosen random variable or if the…

Probability · Mathematics 2021-01-13 Jake Koenig , Hoi Nguyen

In the algorithm selection research, the discussion surrounding algorithm features has been significantly overshadowed by the emphasis on problem features. Although a few empirical studies have yielded evidence regarding the effectiveness…

Machine Learning · Computer Science 2024-06-04 Xingyu Wu , Yan Zhong , Jibin Wu , Yuxiao Huang , Sheng-hao Wu , Kay Chen Tan

Given a set of data, biclustering aims at finding simultaneous partitions in biclusters of its samples and of the features which are used for representing the samples. Consistent biclusterings allow to obtain correct classifications of the…

Machine Learning · Computer Science 2010-03-18 Antonio Mucherino , Sonia Cafieri

Two semimetrics on probability distributions are proposed, given as the sum of differences of expectations of analytic functions evaluated at spatial or frequency locations (i.e, features). The features are chosen so as to maximize the…

Machine Learning · Statistics 2016-10-31 Wittawat Jitkrittum , Zoltan Szabo , Kacper Chwialkowski , Arthur Gretton

Feature importance (FI) estimates are a popular form of explanation, and they are commonly created and evaluated by computing the change in model confidence caused by removing certain input features at test time. For example, in the…

Machine Learning · Computer Science 2021-10-29 Peter Hase , Harry Xie , Mohit Bansal

Multiple hypothesis testing (MHT) frequently arises in scientific inquiries, and concurrent testing of multiple hypotheses inflates the risk of Type-I errors or false positives, rendering MHT corrections essential. This paper addresses MHT…

In this work, we revisit the problem of uniformity testing of discrete probability distributions. A fundamental problem in distribution testing, testing uniformity over a known domain has been addressed over a significant line of works, and…

Data Structures and Algorithms · Computer Science 2017-08-17 Tuğkan Batu , Clément L. Canonne

Ranking algorithms are deployed widely to order a set of items in applications such as search engines, news feeds, and recommendation systems. Recent studies, however, have shown that, left unchecked, the output of ranking algorithms can…

Data Structures and Algorithms · Computer Science 2018-07-31 L. Elisa Celis , Damian Straszak , Nisheeth K. Vishnoi

Feature selection methods are widely used in order to solve the 'curse of dimensionality' problem. Many proposed feature selection frameworks, treat all data points equally; neglecting their different representation power and importance. In…

Machine Learning · Computer Science 2018-10-04 Ammar Gilani , Maryam Amirmazlaghani