English
Related papers

Related papers: Neighborhood and Graph Constructions using Non-Neg…

200 papers

In many scientific disciplines structures in high-dimensional data have to be found, e.g., in stellar spectra, in genome data, or in face recognition tasks. In this work we present a novel approach to non-linear dimensionality reduction. It…

Machine Learning · Statistics 2011-09-27 Oliver Kramer

The popularity of Artificial intelligence and machine learning have prompted researchers to use it in the recent researches. The proposed method uses K-Nearest Neighbor (KNN) algorithm for segmentation of medical images, extracting of image…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Ayesha Heena , Nagashettappa Biradar , Najmuddin M. Maroof , Surbhi Bhatia , Rashmi Agarwal , Kanta Prasad

Nearest neighbor search has found numerous applications in machine learning, data mining and massive data processing systems. The past few years have witnessed the popularity of the graph-based nearest neighbor search paradigm because of…

Machine Learning · Computer Science 2020-12-22 Hongya Wang , Zhizheng Wang , Wei Wang , Yingyuan Xiao , Zeng Zhao , Kaixiang Yang

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

k-nearest neighbor graph is a fundamental data structure in many disciplines such as information retrieval, data-mining, pattern recognition, and machine learning, etc. In the literature, considerable research has been focusing on how to…

Information Retrieval · Computer Science 2021-07-30 Wan-Lei Zhao , Hui Wang , Peng-Cheng Lin , Chong-Wah Ngo

As graphs scale to billions of nodes and edges, graph Machine Learning workloads are constrained by the cost of multi-hop traversals over exponentially growing neighborhoods. While various system-level and algorithmic optimizations have…

Machine Learning · Computer Science 2026-03-10 Yuhang Song , Naima Abrar Shami , Romaric Duvignau , Vasiliki Kalavri

The $k$-nearest neighbor algorithm ($k$-NN) is a widely used non-parametric method for classification and regression. We study the mean squared error of the $k$-NN estimator when $k$ is chosen by leave-one-out cross-validation (LOOCV).…

Statistics Theory · Mathematics 2020-02-18 Mona Azadkia

The $k$-nearest neighbor graph (KNNG) on high-dimensional data is a data structure widely used in many applications such as similarity search, dimension reduction and clustering. Due to its increasing popularity, several methods under the…

Data Structures and Algorithms · Computer Science 2021-12-07 Liu Yingfan , Cheng Hong , Cui Jiangtao

Neighborhood selection is a widely used method used for estimating the support set of sparse precision matrices, which helps determine the conditional dependence structure in undirected graphical models. However, reporting only point…

Methodology · Statistics 2023-12-29 Yiling Huang , Snigdha Panigrahi , Walter Dempsey

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

We delve into the issue of node classification within graphs, specifically reevaluating the concept of neighborhood aggregation, which is a fundamental component in graph neural networks (GNNs). Our analysis reveals conceptual flaws within…

Machine Learning · Computer Science 2024-07-23 Mounir Ghogho

Graph Neural Networks (GNNs) have been widely used for the representation learning of various structured graph data. While promising, most existing GNNs oversimplified the complexity and diversity of the edges in the graph, and thus…

Machine Learning · Computer Science 2021-10-07 Hao Peng , Ruitong Zhang , Yingtong Dou , Renyu Yang , Jingyi Zhang , Philip S. Yu

Graph Neural Networks (GNNs) have been widely applied to various fields for learning over graph-structured data. They have shown significant improvements over traditional heuristic methods in various tasks such as node classification and…

Machine Learning · Computer Science 2022-06-10 Seongjun Yun , Seoyoon Kim , Junhyun Lee , Jaewoo Kang , Hyunwoo J. Kim

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

We consider the problem of recovering clustered sparse signals with no prior knowledge of the sparsity pattern. Beyond simple sparsity, signals of interest often exhibits an underlying sparsity pattern which, if leveraged, can improve the…

Information Theory · Computer Science 2016-01-05 Xiangming Meng , Sheng Wu , Linling Kuang , Defeng , Huang , Jianhua Lu

Demands for minimum parameter setup in machine learning models are desirable to avoid time-consuming optimization processes. The $k$-Nearest Neighbors is one of the most effective and straightforward models employed in numerous problems.…

Machine Learning · Computer Science 2022-10-03 Danilo Samuel Jodas , Leandro Aparecido Passos , Ahsan Adeel , João Paulo Papa

Graph embedding techniques have led to significant progress in recent years. However, present techniques are not effective enough to capture the patterns of networks. This paper propose neighbor2vec, a neighbor-based sampling strategy used…

Social and Information Networks · Computer Science 2022-01-11 Zhiming Lin

Near neighbor search (NNS) is a powerful abstraction for data access; however, data indexing is troublesome even for approximate indexes. For intrinsically high-dimensional data, high-quality fast searches demand either indexes with…

Data Structures and Algorithms · Computer Science 2021-06-30 Eric S. Tellez , Guillermo Ruiz , Edgar Chavez , Mario Graff

Similarity graphs are an active research direction for the nearest neighbor search (NNS) problem. New algorithms for similarity graph construction are continuously being proposed and analyzed by both theoreticians and practitioners.…

Machine Learning · Computer Science 2020-02-14 Dmitry Baranchuk , Artem Babenko