English
Related papers

Related papers: LIDL: Local Intrinsic Dimension Estimation Using A…

200 papers

To gain insight into the mechanisms behind machine learning methods, it is crucial to establish connections among the features describing data points. However, these correlations often exhibit a high-dimensional and strongly nonlinear…

Machine Learning · Computer Science 2025-03-04 Lorenzo Basile , Santiago Acevedo , Luca Bortolussi , Fabio Anselmi , Alex Rodriguez

Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation,…

Machine Learning · Statistics 2023-05-26 Aditya Ravuri , Francisco Vargas , Vidhi Lalchand , Neil D. Lawrence

It is widely believed that natural image data exhibits low-dimensional structure despite the high dimensionality of conventional pixel representations. This idea underlies a common intuition for the remarkable success of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Phillip Pope , Chen Zhu , Ahmed Abdelkader , Micah Goldblum , Tom Goldstein

The abundance of models of complex networks and the current insufficient validation standards make it difficult to judge which models are strongly supported by data and which are not. We focus here on likelihood maximization methods for…

Physics and Society · Physics 2014-03-26 Matus Medo

Likelihood-based inferences have been remarkably successful in wide-spanning application areas. However, even after due diligence in selecting a good model for the data at hand, there is inevitably some amount of model misspecification:…

Methodology · Statistics 2024-09-12 Miheer Dewaskar , Christopher Tosh , Jeremias Knoblauch , David B. Dunson

Diffusion models recently have been successfully applied for the visual synthesis of strikingly realistic appearing images. This raises strong concerns about their potential for malicious purposes. In this paper, we propose using the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Peter Lorenz , Ricard Durall , Janis Keuper

Accurate indoor positioning for wireless communication systems represents an important step towards enhanced reliability and security, which are crucial aspects for realizing Industry 4.0. In this context, this paper presents an…

Signal Processing · Electrical Eng. & Systems 2023-06-07 Ivo Bizon , Zhongju Li , Ahmad Nimr , Marwa Chafii , Gerhard P. Fettweis

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

Nearest neighbor classifier is arguably the most simple and popular nonparametric classifier available in the literature. However, due to the concentration of pairwise distances and the violation of the neighborhood structure, this…

Machine Learning · Statistics 2024-10-25 Annesha Ghosh , Deep Ghoshal , Bilol Banerjee , Anil K. Ghosh

In this paper, we develop a local rank correlation measure which quantifies the performance of dimension reduction methods. The local rank correlation is easily interpretable, and robust against the extreme skewness of nearest neighbor…

Methodology · Statistics 2017-11-17 Jiaxi Liang , Shojaeddin Chenouri , Christopher G. Small

Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution…

Machine Learning · Statistics 2011-06-24 Makoto Yamada , Taiji Suzuki , Takafumi Kanamori , Hirotaka Hachiya , Masashi Sugiyama

Place recognition is a challenging problem in mobile robotics, especially in unstructured environments or under viewpoint and illumination changes. Most LiDAR-based methods rely on geometrical features to overcome such challenges, as…

Robotics · Computer Science 2018-12-03 Jiadong Guo , Paulo V. K. Borges , Chanoh Park , Abel Gawel

Online statistical inference facilitates real-time analysis of sequentially collected data, making it different from traditional methods that rely on static datasets. This paper introduces a novel approach to online inference in…

Machine Learning · Statistics 2025-02-27 Ruijian Han , Lan Luo , Yuanhang Luo , Yuanyuan Lin , Jian Huang

Large language models (LLMs) demonstrate remarkable emergent abilities to perform in-context learning across various tasks, including time series forecasting. This work investigates LLMs' ability to estimate probability density functions…

Machine Learning · Computer Science 2025-03-05 Toni J. B. Liu , Nicolas Boullé , Raphaël Sarfati , Christopher J. Earls

Minimizing a convex risk function is the main step in many basic learning algorithms. We study protocols for convex optimization which provably leak very little about the individual data points that constitute the loss function.…

Machine Learning · Computer Science 2020-08-11 Di Wang , Adam Smith , Jinhui Xu

Method of parameterizing and smoothing the unknown underling distributions using Bernstein polynomials is proposed, verified and investigated. Any distribution with bounded and smooth enough density can be approximated by the proposed…

Methodology · Statistics 2015-06-23 Zhong Guan

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

The Local Learning Coefficient (LLC) is introduced as a novel complexity measure for deep neural networks (DNNs). Recognizing the limitations of traditional complexity measures, the LLC leverages Singular Learning Theory (SLT), which has…

Machine Learning · Statistics 2024-10-02 Edmund Lau , Zach Furman , George Wang , Daniel Murfet , Susan Wei

Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly…

Machine Learning · Computer Science 2017-02-21 Jarek Duda

We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension $D$ of the conditioning variable is larger than the sample size $n$, estimation and inference is…

Machine Learning · Computer Science 2019-06-19 Khashayar Khosravi , Greg Lewis , Vasilis Syrgkanis