English
Related papers

Related papers: Stochastic temporal data upscaling using the gener…

200 papers

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

Forecasting models that are trained across sets of many time series, known as Global Forecasting Models (GFM), have shown recently promising results in forecasting competitions and real-world applications, outperforming many…

Machine Learning · Computer Science 2020-08-07 Kasun Bandara , Hansika Hewamalage , Yuan-Hao Liu , Yanfei Kang , Christoph Bergmeir

The K-Nearest Neighbors (KNN) algorithm is widely used for classification and regression; however, it suffers from limitations, including the equal treatment of all samples. We propose Information-Modified KNN (IM-KNN), a novel approach…

Machine Learning · Computer Science 2025-07-11 Mohammad Ali Vahedifar , Azim Akhtarshenas , Mohammad Mohammadi Rafatpanah , Maryam Sabbaghian

Very few K-nearest-neighbor (KNN) ensembles exist, despite the efficacy of this approach in regression, classification, and outlier detection. Those that do exist focus on bagging features, rather than varying k or bagging observations; it…

Machine Learning · Statistics 2017-08-08 Colleen M. Farrelly

In the $k$-nearest neighborhood model ($k$-NN), we are given a set of points $P$, and we shall answer queries $q$ by returning the $k$ nearest neighbors of $q$ in $P$ according to some metric. This concept is crucial in many areas of data…

Machine Learning · Computer Science 2018-12-03 Hendrik Fichtenberger , Dennis Rohde

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

The $k$-nearest neighbor algorithm ($k$-NN) is a widely used non-parametric method for classification and regression. We study the mean squared error of the $k$-NN estimator when $k$ is chosen by leave-one-out cross-validation (LOOCV).…

Statistics Theory · Mathematics 2020-02-18 Mona Azadkia

Linear regression analysis focuses on predicting a numeric regressand value based on certain regressor values. In this context, k-Nearest Neighbors (k-NN) is a common non-parametric regression algorithm, which achieves efficient performance…

This work aims to address an open problem in data valuation literature concerning the efficient computation of Data Shapley for weighted $K$ nearest neighbor algorithm (WKNN-Shapley). By considering the accuracy of hard-label KNN with…

Data Structures and Algorithms · Computer Science 2024-01-23 Jiachen T. Wang , Prateek Mittal , Ruoxi Jia

The $k$-nearest neighbor ($k$-NN) algorithm is one of the most popular methods for nonparametric classification. However, a relevant limitation concerns the definition of the number of neighbors $k$. This parameter exerts a direct impact on…

Machine Learning · Computer Science 2024-09-10 Alexandre Luís Magalhães Levada , Frank Nielsen , Michel Ferreira Cardia Haddad

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

Machine Learning · Computer Science 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

Regional rainfall forecasting is an important issue in hydrology and meteorology. This paper aims to design an integrated tool by applying various machine learning algorithms, especially the state-of-the-art deep learning algorithms…

Machine Learning · Computer Science 2021-03-30 Ning Yu , Timothy Haskins

We introduce a novel training principle for probabilistic models that is an alternative to maximum likelihood. The proposed Generative Stochastic Networks (GSN) framework is based on learning the transition operator of a Markov chain whose…

Machine Learning · Computer Science 2015-03-29 Guillaume Alain , Yoshua Bengio , Li Yao , Jason Yosinski , Eric Thibodeau-Laufer , Saizheng Zhang , Pascal Vincent

As the world shifts towards utilizing natural resources for electricity generation, there is need to enhance forecasting systems to guarantee a stable electricity provision and to incorporate the generated power into the network systems.…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Ismum Ul Hossain , Mohammad Nahidul Islam

Graph Neural Networks (GNNs) have achieved remarkable performance on graph-based tasks. The key idea for GNNs is to obtain informative representation through aggregating information from local neighborhoods. However, it remains an open…

Machine Learning · Computer Science 2022-06-29 Songtao Liu , Rex Ying , Hanze Dong , Lanqing Li , Tingyang Xu , Yu Rong , Peilin Zhao , Junzhou Huang , Dinghao Wu

Long-term forecasting of multivariate urban data poses a significant challenge due to the complex spatiotemporal dependencies inherent in such datasets. This paper presents DST, a novel multivariate time-series forecasting model that…

Machine Learning · Computer Science 2025-08-28 Amirhossein Sohrabbeig , Omid Ardakanian , Petr Musilek

In this paper, we first propose a Bayesian neighborhood selection method to estimate Gaussian Graphical Models (GGMs). We show the graph selection consistency of this method in the sense that the posterior probability of the true model…

Applications · Statistics 2015-07-08 Zhixiang Lin , Tao Wang , Can Yang , Hongyu Zhao

K-Nearest neighbor classifier (k-NNC) is simple to use and has little design time like finding k values in k-nearest neighbor classifier, hence these are suitable to work with dynamically varying data-sets. There exists some fundamental…

Computer Vision and Pattern Recognition · Computer Science 2013-01-29 T. Hitendra Sarma , P. Viswanath , D. Sai Koti Reddy , S. Sri Raghava

Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a…

Computer Vision and Pattern Recognition · Computer Science 2017-02-06 Wan-Lei Zhao , Jie Yang , Cheng-Hao Deng

The $k$-NN graph has played a central role in increasingly popular data-driven techniques for various learning and vision tasks; yet, finding an efficient and effective way to construct $k$-NN graphs remains a challenge, especially for…

Computer Vision and Pattern Recognition · Computer Science 2013-07-31 Jingdong Wang , Jing Wang , Gang Zeng , Zhuowen Tu , Rui Gan , Shipeng Li