English
Related papers

Related papers: Relative intrinsic dimensionality is intrinsic to …

200 papers

This work initiates the systematic study of explicit distributions that are indistinguishable from a single exponential-size combinatorial object. In this we extend the work of Goldreich, Goldwasser and Nussboim (SICOMP 2010) that focused…

Computational Complexity · Computer Science 2023-02-27 Lunjia Hu , Inbal Livni-Navon , Omer Reingold

Machine learning (ML) has emerged as a powerful tool for tackling complex regression and classification tasks, yet its success often hinges on the quality of training data. This study introduces an ML paradigm inspired by domain knowledge…

Machine Learning · Computer Science 2025-01-10 Mohsen Rashki

Deep neural networks often generalize well despite heavy over-parameterization, challenging classical parameter-based analyses. We study generalization from a representation-centric perspective and analyze how the geometry of learned…

Machine Learning · Computer Science 2026-02-02 Junjie Yu , Zhuoli Ouyang , Haotian Deng , Chen Wei , Wenxiao Ma , Jianyu Zhang , Zihan Deng , Quanying Liu

In this study, we prove that an intrinsic low dimensionality of covariates is the main factor that determines the performance of deep neural networks (DNNs). DNNs generally provide outstanding empirical performance. Hence, numerous studies…

Machine Learning · Statistics 2020-09-18 Ryumei Nakada , Masaaki Imaizumi

Following the recent success of word embeddings, it has been argued that there is no such thing as an ideal representation for words, as different models tend to capture divergent and often mutually incompatible aspects like…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Iñigo Lopez-Gazpio , Eneko Agirre

Distances are pervasive in machine learning. They serve as similarity measures, loss functions, and learning targets; it is said that a good distance measure solves a task. When defining distances, the triangle inequality has proven to be a…

Machine Learning · Computer Science 2020-07-08 Silviu Pitis , Harris Chan , Kiarash Jamali , Jimmy Ba

Information about intrinsic dimension is crucial to perform dimensionality reduction, compress information, design efficient algorithms, and do statistical adaptation. In this paper we propose an estimator for the intrinsic dimension of a…

Machine Learning · Statistics 2017-11-09 Paulo Serra , Michel Mandjes

We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of…

Statistics Theory · Mathematics 2009-09-02 Yao-ban Chan , Peter Hall

Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has…

Machine Learning · Computer Science 2019-10-16 Juntang Zhuang , Nicha C. Dvornek , Xiaoxiao Li , Junlin Yang , James S. Duncan

Organisms and algorithms learn probability distributions from previous observations, either over evolutionary time or on the fly. In the absence of regularities, estimating the underlying distribution from data would require observing each…

Statistical Mechanics · Physics 2024-12-10 William Bialek , Stephanie E. Palmer , David J. Schwab

When performing classification tasks, raw high dimensional features often contain redundant information, and lead to increased computational complexity and overfitting. In this paper, we assume the data samples lie on a single underlying…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Bowen Jiang , Maohao Shen

We present novel, computationally efficient, and differentially private algorithms for two fundamental high-dimensional learning problems: learning a multivariate Gaussian and learning a product distribution over the Boolean hypercube in…

Data Structures and Algorithms · Computer Science 2019-05-31 Gautam Kamath , Jerry Li , Vikrant Singhal , Jonathan Ullman

Hyperdimensional computing (HDC) is an increasingly popular computing paradigm with immense potential for future intelligent applications. Although the main ideas already took form in the 1990s, HDC recently gained significant attention,…

Machine Learning · Computer Science 2023-11-15 Pieter Dewulf , Bernard De Baets , Michiel Stock

Causality has the potential to truly transform the way we solve a large number of real-world problems. Yet, so far, its potential largely remains to be unlocked as causality often requires crucial assumptions which cannot be tested in…

Machine Learning · Computer Science 2024-02-15 Jeroen Berrevoets , Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

According to the probability ranking principle, the document set with the highest values of probability of relevance optimizes information retrieval effectiveness given the probabilities are estimated as accurately as possible. The key…

Information Retrieval · Computer Science 2011-08-30 Massimo Melucci

Accurate probabilistic predictions can be characterized by two properties -- calibration and sharpness. However, standard maximum likelihood training yields models that are poorly calibrated and thus inaccurate -- a 90% confidence interval…

Machine Learning · Computer Science 2025-05-14 Volodymyr Kuleshov , Shachi Deshpande

The amount of information in the form of features and variables avail- able to machine learning algorithms is ever increasing. This can lead to classifiers that are prone to overfitting in high dimensions, high di- mensional models do not…

Machine Learning · Computer Science 2014-02-12 Aaron Karper

The Probability Ranking Principle states that the document set with the highest values of probability of relevance optimizes information retrieval effectiveness given the probabilities are estimated as accurately as possible. The key point…

Information Retrieval · Computer Science 2011-08-31 Massimo Melucci

Deep learning has achieved impressive prediction accuracies in a variety of scientific and industrial domains. However, the nested non-linear feature of deep learning makes the learning highly non-transparent, i.e., it is still unknown how…

Machine Learning · Computer Science 2020-10-26 Chan Li , Haiping Huang

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in…

Machine Learning · Statistics 2018-11-16 Kristen Severson , Soumya Ghosh , Kenney Ng