English
Related papers

Related papers: Characterizing unstructured data with the nearest …

200 papers

Order is one of the main instruments to measure the relationship between objects in (empirical) data. However, compared to methods that use numerical properties of objects, the amount of ordinal methods developed is rather small. One reason…

Artificial Intelligence · Computer Science 2023-12-29 Gerd Stumme , Dominik Dürrschnabel , Tom Hanika

In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods…

Machine Learning · Computer Science 2014-01-17 Harris Papadopoulos , Vladimir Vovk , Alex Gammerman

Koopman decomposition is a non-linear generalization of eigen-decomposition, and is being increasingly utilized in the analysis of spatio-temporal dynamics. Well-known techniques such as the dynamic mode decomposition (DMD) and its linear…

Dynamical Systems · Mathematics 2021-05-12 Shaowu Pan , Nicholas Arnold-Medabalimi , Karthik Duraisamy

The conditional mutual information quantifies the conditional dependence of two random variables. It has numerous applications; it forms, for example, part of the definition of transfer entropy, a common measure of the causal relationship…

Information Theory · Computer Science 2024-04-15 Jake Witter , Conor Houghton

This paper introduces the innovative Power Muirhead Mean K-Nearest Neighbors (PMM-KNN) algorithm, a novel data classification approach that combines the K-Nearest Neighbors method with the adaptive Power Muirhead Mean operator. The proposed…

Machine Learning · Computer Science 2024-05-28 Kourosh Shahnazari , Seyed Moein Ayyoubzadeh

We develop a class of nearest-neighbor mixture models that provide direct, computationally efficient, probabilistic modeling for non-Gaussian geospatial data. The class is defined over a directed acyclic graph, which implies conditional…

Methodology · Statistics 2022-06-28 Xiaotian Zheng , Athanasios Kottas , Bruno Sansó

We propose a novel method of introducing structure into existing machine learning techniques by developing structure-based similarity and distance measures. To learn structural information, low-dimensional structure of the data is captured…

Machine Learning · Statistics 2011-10-27 Joseph Wang , Venkatesh Saligrama , David A. Castañón

This work aims to address an open problem in data valuation literature concerning the efficient computation of Data Shapley for weighted $K$ nearest neighbor algorithm (WKNN-Shapley). By considering the accuracy of hard-label KNN with…

Data Structures and Algorithms · Computer Science 2024-01-23 Jiachen T. Wang , Prateek Mittal , Ruoxi Jia

Here, we propose a new tool to estimate the complexity of a time series: the entropy of difference (ED). The method is based solely on the sign of the difference between neighboring values in a time series. This makes it possible to…

Data Analysis, Statistics and Probability · Physics 2014-11-05 Pasquale Nardone

We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…

Statistics Theory · Mathematics 2025-07-24 Angelika Silbernagel , Christian Weiß

We propose to approximate the conditional expectation of a spatial random variable given its nearest-neighbour observations by an additive function. The setting is meaningful in practice and requires no unilateral ordering. It is capable of…

Statistics Theory · Mathematics 2016-03-28 Zudi Lu , Arvid Lundervold , Dag Tjøstheim , Qiwei Yao

Many important problems require modelling large-scale spatio-temporal datasets, with one prevalent example being weather forecasting. Recently, transformer-based approaches have shown great promise in a range of weather forecasting…

Machine Learning · Statistics 2024-10-11 Matthew Ashman , Cristiana Diaconu , Eric Langezaal , Adrian Weller , Richard E. Turner

An approach to amputation, the process of introducing missing values to a complete dataset, is presented. It allows to construct missingness indicators in a flexible and principled way via copulas and Bernoulli margins and to incorporate…

Applications · Statistics 2025-07-28 Marius Hofert , James Jackson , Niels Hagenbuch

Various kinds of k-nearest neighbor (KNN) based classification methods are the bases of many well-established and high-performance pattern-recognition techniques, but both of them are vulnerable to their parameter choice. Essentially, the…

Artificial Intelligence · Computer Science 2016-12-08 Ji Feng , Qingsheng Zhu , Jinlong Huang , Lijun Yang

In ordinal symbolic dynamics, transcripts describe the algebraic relationship between ordinal patterns. Using the concept of transcript, we exploit the mathematical structure of the group of permutations to derive properties and relations…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Roberto Monetti , Wolfram Bunk , Thomas Aschenbrenner , Stephan Springer , Jose Maria Amigo

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

Many applications in machine learning or signal processing involve nonsmooth optimization problems. This nonsmoothness brings a low-dimensional structure to the optimal solutions. In this paper, we propose a randomized proximal gradient…

Optimization and Control · Mathematics 2020-04-29 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

Complexity measures are essential to understand complex systems and there are numerous definitions to analyze one-dimensional data. However, extensions of these approaches to two or higher-dimensional data, such as images, are much less…

Data Analysis, Statistics and Probability · Physics 2012-12-27 H. V. Ribeiro , L. Zunino , E. K. Lenzi , P. A. Santoro , R. S. Mendes

Subject-specific cardiovascular models rely on parameter estimation using measurements such as 4D Flow MRI data. However, acquiring high-resolution, high-fidelity functional flow data is costly and taxing for the patient. As a result, there…

Medical Physics · Physics 2025-12-09 Miriam Löcke , Ahmed Attia , Dariusz Ucínski , Cristóbal Bertoglio

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling