English
Related papers

Related papers: Surprisal Driven $k$-NN for Robust and Interpretab…

200 papers

We propose a novel deep learning approach to nonparametric statistical inference for the conditional hazard function of survival time with right-censored data. We use a deep neural network (DNN) to approximate the logarithm of a conditional…

Methodology · Statistics 2024-10-24 Wen Su , Kin-Yat Liu , Guosheng Yin , Jian Huang , Xingqiu Zhao

An Undirected Weighted Network (UWN) is commonly found in big data-related applications. Note that such a network's information connected with its nodes, and edges can be expressed as a Symmetric, High-Dimensional and Incomplete (SHDI)…

Machine Learning · Computer Science 2023-06-07 Yurong Zhong , Zhe Xie , Weiling Li , Xin Luo

Deep neural networks (DNNs) have proven to be highly effective in a variety of tasks, making them the go-to method for problems requiring high-level predictive power. Despite this success, the inner workings of DNNs are often not…

Machine Learning · Statistics 2024-03-04 Anton Thielmann , René-Marcel Kruse , Thomas Kneib , Benjamin Säfken

Importance weighting is widely applicable in machine learning in general and in techniques dealing with data covariate shift problems in particular. A novel, direct approach to determine such importance weighting is presented. It relies on…

Machine Learning · Computer Science 2021-02-05 Marco Loog

The $k$-nearest neighbor classification method ($k$-NNC) is one of the simplest nonparametric classification methods. The mutual $k$-NN classification method (M$k$NNC) is a variant of $k$-NNC based on mutual neighborship. We propose another…

Machine Learning · Computer Science 2016-08-16 Hyun-Chul Kim

Many nonparametric regressors were recently shown to converge at rates that depend only on the intrinsic dimension of data. These regressors thus escape the curse of dimension when high-dimensional data has low intrinsic dimension (e.g. a…

Machine Learning · Statistics 2011-10-20 Samory Kpotufe

The k-nearest neighbors (k-NN) is a basic machine learning (ML) algorithm, and several quantum versions of it, employing different distance metrics, have been presented in the last few years. Although the Euclidean distance is one of the…

Emerging Technologies · Computer Science 2024-04-25 Enrico Zardini , Enrico Blanzieri , Davide Pastorello

The $k$-NN graph has played a central role in increasingly popular data-driven techniques for various learning and vision tasks; yet, finding an efficient and effective way to construct $k$-NN graphs remains a challenge, especially for…

Computer Vision and Pattern Recognition · Computer Science 2013-07-31 Jingdong Wang , Jing Wang , Gang Zeng , Zhuowen Tu , Rui Gan , Shipeng Li

Supervised machine learning involves approximating an unknown functional relationship from a limited dataset of features and corresponding labels. The classical approach to feature-based machine learning typically relies on applying linear…

Machine Learning · Statistics 2025-04-25 Margherita Lampani , Sabrina Guastavino , Michele Piana , Federico Benvenuto

This paper studies nonparametric regression with repeated measurements when the response in the target domain is unobservable or costly to collect. We adopt a transfer learning framework that leverages a source domain with observable…

Methodology · Statistics 2026-05-26 Yingxuan Wang , Xiangyu Xing , Wangli Xu

Probabilistic graphic model is an elegant framework to compactly present complex real-world observations by modeling uncertainty and logical flow (conditionally independent factors). In this paper, we present a probabilistic framework of…

Information Retrieval · Computer Science 2017-01-06 Jun Wang , Qiang Tang

In this research, we introduce the concept of "computational entanglement," a phenomenon observed in overparameterized feedforward linear networks that enables the network to achieve zero loss by fitting random noise, even on previously…

Machine Learning · Computer Science 2024-10-01 YenLung Lai , Xingbo Dong , Zhe Jin

Previous knowledge graph embedding approaches usually map entities to representations and utilize score functions to predict the target entities, yet they typically struggle to reason rare or emerging unseen entities. In this paper, we…

Computation and Language · Computer Science 2023-08-01 Peng Wang , Xin Xie , Xiaohan Wang , Ningyu Zhang

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

This paper introduces enhancements to the K-means and K-nearest neighbors (KNN) algorithms based on the concept of Gini prametric spaces, instead of traditional metric spaces. Unlike standard distance metrics, Gini prametrics incorporate…

Machine Learning · Computer Science 2025-08-27 Cassandra Mussard , Arthur Charpentier , Stéphane Mussard

Adoption of deep neural networks in fields such as economics or finance has been constrained by the lack of interpretability of model outcomes. This paper proposes a generative neural network architecture - the parameter encoder neural…

Machine Learning · Statistics 2021-06-11 Johann Pfitzinger

We propose a novel nonparametric online predictor for discrete labels conditioned on multivariate continuous features. The predictor is based on a feature space discretization induced by a full-fledged k-d tree with randomly picked…

Machine Learning · Computer Science 2020-02-03 Alix Lhéritier , Frédéric Cazals

Deterministic neural networks (NNs) are increasingly being deployed in safety critical domains, where calibrated, robust, and efficient measures of uncertainty are crucial. In this paper, we propose a novel method for training non-Bayesian…

Machine Learning · Computer Science 2020-11-25 Alexander Amini , Wilko Schwarting , Ava Soleimany , Daniela Rus

In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods…

Machine Learning · Computer Science 2014-01-17 Harris Papadopoulos , Vladimir Vovk , Alex Gammerman

In general, Graph Neural Networks(GNN) have been using a message passing method to aggregate and summarize information about neighbors to express their information. Nonetheless, previous studies have shown that the performance of graph…

Machine Learning · Computer Science 2021-12-21 M. Park