English
Related papers

Related papers: Heuristic Framework for Multi-Scale Testing of the…

200 papers

Amid mounting concern about the reliability and credibility of machine learning research, we present a principled framework for making robust and generalizable claims: the multiverse analysis. Our framework builds upon the multiverse…

Machine Learning · Computer Science 2022-10-13 Samuel J. Bell , Onno P. Kampman , Jesse Dodge , Neil D. Lawrence

As Large Language Models (LLMs) increasingly appear in social science research (e.g., economics and marketing), it becomes crucial to assess how well these models replicate human behavior. In this work, using hypothesis testing, we present…

Computers and Society · Computer Science 2025-06-19 Harbin Hong , Sebastian Caldas , Liu Leqi

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

Multi-collinearity is a wide-spread phenomenon in modern statistical applications and when ignored, can negatively impact model selection and statistical inference. Classic tools and measures that were developed for "$n>p$" data are not…

Methodology · Statistics 2022-03-22 Wei Q. Deng , Radu V. Craiu , Lei Sun

Many algorithms in machine learning and computational geometry require, as input, the intrinsic dimension of the manifold that supports the probability distribution of the data. This parameter is rarely known and therefore has to be…

Statistics Theory · Mathematics 2020-01-01 Jisu Kim , Alessandro Rinaldo , Larry Wasserman

Clustering on the data with multiple aspects, such as multi-view or multi-type relational data, has become popular in recent years due to their wide applicability. The approach using manifold learning with the Non-negative Matrix…

Machine Learning · Computer Science 2020-09-08 Khanh Luong , Richi Nayak

High-dimensional datasets are well-approximated by low-dimensional structures. Over the past decade, this empirical observation motivated the investigation of detection, measurement, and modeling techniques to exploit these low-dimensional…

Statistics Theory · Mathematics 2015-12-15 Mauro Maggioni , Stanislav Minsker , Nate Strawn

We consider a data-driven robust hypothesis test where the optimal test will minimize the worst-case performance regarding distributions that are close to the empirical distributions with respect to the Wasserstein distance. This leads to a…

Statistics Theory · Mathematics 2021-06-01 Liyan Xie , Rui Gao , Yao Xie

Classification is a core topic in functional data analysis. A large number of functional classifiers have been proposed in the literature, most of which are based on functional principal component analysis or functional regression. In…

Methodology · Statistics 2025-10-14 Ruoxu Tan , Yiming Zang

Data-driven algorithm design automates hyperparameter tuning, but its statistical foundations remain limited because model performance can depend on hyperparameters in implicit and highly non-smooth ways. Existing guarantees focus on the…

Machine Learning · Statistics 2026-05-13 Tung Quoc Le , Anh Tuan Nguyen , Viet Anh Nguyen

The manifold hypothesis is a core mechanism behind the success of deep learning, so understanding the intrinsic manifold structure of image data is central to studying how neural networks learn from the data. Intrinsic dataset manifolds and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Nicholas Konz , Hanxue Gu , Haoyu Dong , Maciej A. Mazurowski

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

This article develops a framework for testing general hypothesis in high-dimensional models where the number of variables may far exceed the number of observations. Existing literature has considered less than a handful of hypotheses, such…

Methodology · Statistics 2017-08-16 Yinchu Zhu , Jelena Bradic

In Functional Data Analysis, data are commonly assumed to be smooth functions on a fixed interval of the real line. In this work, we introduce a comprehensive framework for the analysis of functional data, whose domain is a two-dimensional…

Methodology · Statistics 2019-08-02 Eardi Lila , John A. D. Aston

This article presents an empirical validation of the functional multidimensional scaling model, a novel approach that improves the smoothness of time-varying dissimilarities in a low-dimensional space, embedding a modified Adam stochastic…

Applications · Statistics 2025-05-21 Liting Li

Many scientific areas are faced with the challenge of extracting information from large, complex, and highly structured data sets. A great deal of modern statistical work focuses on developing tools for handling such data. This paper…

Methodology · Statistics 2017-10-05 Hyun Bin Kang , Matthew Reimherr , Mark Shriver , Peter Claes

We initiate a systematic study of intrinsic dimensional versions of classical functional inequalities which capture refined properties of the underlying objects. We focus on model spaces: Euclidean space, Hamming cube, and manifolds of…

Probability · Mathematics 2023-04-28 Alexandros Eskenazis , Yair Shenfeld

High-dimensional data are ubiquitous in contemporary science and finding methods to compress them is one of the primary goals of machine learning. Given a dataset lying in a high-dimensional space (in principle hundreds to several thousands…

Machine Learning · Computer Science 2020-03-24 Vittorio Erba , Marco Gherardi , Pietro Rotondo

Learning based hashing methods have attracted considerable attention due to their ability to greatly increase the scale at which existing algorithms may operate. Most of these methods are designed to generate binary codes preserving the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Fumin Shen , Chunhua Shen , Qinfeng Shi , Anton van den Hengel , Zhenmin Tang , Heng Tao Shen