English
Related papers

Related papers: Distance Assessment and Hypothesis Testing of High…

200 papers

We survey permutation-based methods for approximate k-nearest neighbor search. In these methods, every data point is represented by a ranked list of pivots sorted by the distance to this point. Such ranked lists are called permutations. The…

Machine Learning · Computer Science 2016-11-01 Bilegsaikhan Naidan , Leonid Boytsov , Eric Nyberg

The distance standard deviation, which arises in distance correlation analysis of multivariate data, is studied as a measure of spread. The asymptotic distribution of the empirical distance standard deviation is derived under the assumption…

Statistics Theory · Mathematics 2019-12-12 Dominic Edelmann , Donald Richards , Daniel Vogel

Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that…

Machine Learning · Statistics 2017-11-07 Ho Chung Leon Law , Christopher Yau , Dino Sejdinovic

Multi-modal data-sets are ubiquitous in modern applications, and multi-modal Variational Autoencoders are a popular family of models that aim to learn a joint representation of the different modalities. However, existing approaches suffer…

Machine Learning · Computer Science 2023-12-19 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Statisticians increasingly face the problem to reconsider the adaptability of classical inference techniques. In particular, divers types of high-dimensional data structures are observed in various research areas; disclosing the boundaries…

Statistics Theory · Mathematics 2017-06-09 Paavo Sattler , Markus Pauly

High-dimensional multivariate time series are challenging due to the dependent and high-dimensional nature of the data, but in many applications there is additional structure that can be exploited to reduce computing time along with…

Methodology · Statistics 2020-03-13 Michael Schweinberger , Sergii Babkin , Katherine Ensor

In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical…

Machine Learning · Computer Science 2023-01-12 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD), an extension of the Optimal Transport distance. The approach addresses the challenges of detecting distributional…

Methodology · Statistics 2025-06-23 Zhengqi Lin , Yan Chen

In distributed and federated learning, heterogeneity across data sources remains a major obstacle to effective model aggregation and convergence. We focus on feature heterogeneity and introduce energy distance as a sensitive measure for…

Machine Learning · Statistics 2025-01-28 Mengchen Fan , Baocheng Geng , Roman Shterenberg , Joseph A. Casey , Zhong Chen , Keren Li

In this article, we highlight what appears to be major issue of Variational Autoencoders, evinced from an extensive experimentation with different network architectures and datasets: the variance of generated data is significantly lower…

Machine Learning · Computer Science 2020-05-26 Andrea Asperti

This paper studies the high-dimensional mixed linear regression (MLR) where the output variable comes from one of the two linear regression models with an unknown mixing proportion and an unknown covariance structure of the random…

Methodology · Statistics 2020-11-10 Linjun Zhang , Rong Ma , T. Tony Cai , Hongzhe Li

While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a…

Methodology · Statistics 2025-01-10 Ryan Christ , Ira Hall , David Steinsaltz

The use of Variational Autoencoders in different Machine Learning tasks has drastically increased in the last years. They have been developed as denoising, clustering and generative tools, highlighting a large potential in a wide range of…

Machine Learning · Computer Science 2019-07-12 Helena Andrés-Terré , Pietro Lió

Change detection plays a fundamental role in Earth observation for analyzing temporal iterations over time. However, recent studies have largely neglected the utilization of multimodal data that presents significant practical and technical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Biyuan Liu , Huaixin Chen , Kun Li , Michael Ying Yang

Many applications, such as text modelling, high-throughput sequencing, and recommender systems, require analysing sparse, high-dimensional, and overdispersed discrete (count-valued or binary) data. Although probabilistic matrix…

Machine Learning · Computer Science 2019-05-27 He Zhao , Piyush Rai , Lan Du , Wray Buntine , Mingyuan Zhou

Change-point detection has been a classical problem in statistics and econometrics. This work focuses on the problem of detecting abrupt distributional changes in the data-generating distribution of a sequence of high-dimensional…

Methodology · Statistics 2021-05-20 Shubhadeep Chakraborty , Xianyang Zhang

Modelling multivariate spatio-temporal data with complex dependency structures is a challenging task but can be simplified by assuming that the original variables are generated from independent latent components. If these components are…

Methodology · Statistics 2024-11-04 Mika Sipilä , Claudia Cappello , Sandra De Iaco , Klaus Nordhausen , Sara Taskinen

We introduce the cross-match test - an exact, distribution free, high-dimensional hypothesis test as an intrinsic evaluation metric for word embeddings. We show that cross-match is an effective means of measuring distributional similarity…

Computation and Language · Computer Science 2017-09-05 Nishant Gurnani

Datasets with missing values are very common on industry applications, and they can have a negative impact on machine learning models. Recent studies introduced solutions to the problem of imputing missing values based on deep generative…

Machine Learning · Computer Science 2019-02-28 Ramiro D. Camino , Christian A. Hammerschmidt , Radu State

Distance correlation has become an increasingly popular tool for detecting the nonlinear dependence between a pair of potentially high-dimensional random vectors. Most existing works have explored its asymptotic distributions under the null…

Statistics Theory · Mathematics 2021-10-06 Lan Gao , Yingying Fan , Jinchi Lv , Qi-Man Shao