English
Related papers

Related papers: Classification with Nearest Disjoint Centroids

200 papers

The one-class classification problem is a well-known research endeavor in pattern recognition. The problem is also known under different names, such as outlier and novelty/anomaly detection. The core of the problem consists in modeling and…

Computer Vision and Pattern Recognition · Computer Science 2015-03-31 Lorenzo Livi , Alireza Sadeghian , Witold Pedrycz

Minimal cost feature selection is devoted to obtain a trade-off between test costs and misclassification costs. This issue has been addressed recently on nominal data. In this paper, we consider numerical data with measurement errors and…

Artificial Intelligence · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

We introduce a novel end-to-end approach for learning to cluster in the absence of labeled examples. Our clustering objective is based on optimizing normalized cuts, a criterion which measures both intra-cluster similarity as well as…

Machine Learning · Computer Science 2019-10-18 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

Traditional clustering methods often perform clustering with low-level indiscriminative representations and ignore relationships between patterns, resulting in slight achievements in the era of deep learning. To handle this problem, we…

Machine Learning · Computer Science 2019-05-07 Jianlong Chang , Yiwen Guo , Lingfeng Wang , Gaofeng Meng , Shiming Xiang , Chunhong Pan

We formally prove the connection between k-means clustering and the predictions of neural networks based on the softmax activation layer. In existing work, this connection has been analyzed empirically, but it has never before been…

Machine Learning · Computer Science 2020-01-08 Sibylle Hess , Wouter Duivesteijn , Decebal Mocanu

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

Information Theory · Computer Science 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

Discriminative features are critical for machine learning applications. Most existing deep learning approaches, however, rely on convolutional neural networks (CNNs) for learning features, whose discriminant power is not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Fusheng Hao , Jun Cheng , Lei Wang , Xinchao Wang , Jianzhong Cao , Xiping Hu , Dapeng Tao

In this paper, we propose an alternative method to the disjoint principal component analysis. The method consists of a principal component analysis with constraints, which allows us to determine disjoint components that are linear…

Neural and Evolutionary Computing · Computer Science 2020-04-23 John Ramírez-Figueroa , Carlos Martín-Barreiro , Ana B. Nieto-Librero , Victor Leiva-Sánchez , Purificación Galindo-Villardón

Neural network classifiers have become the de-facto choice for current "pre-train then fine-tune" paradigms of visual classification. In this paper, we investigate k-Nearest-Neighbor (k-NN) classifiers, a classical model-free learning…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Menglin Jia , Bor-Chun Chen , Zuxuan Wu , Claire Cardie , Serge Belongie , Ser-Nam Lim

This paper concerns the construction of tests for universal hypothesis testing problems, in which the alternate hypothesis is poorly modeled and the observation space is large. The mismatched universal test is a feature-based technique for…

Information Theory · Computer Science 2016-04-18 Dayu Huang , Sean Meyn

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

The k-nearest-neighbour procedure is a well-known deterministic method used in supervised classification. This paper proposes a reassessment of this approach as a statistical technique derived from a proper probabilistic model; in…

Computation · Statistics 2008-02-12 Lionel Cucala , Jean-Michel Marin , Christian Robert , Mike Titterington

Unsupervised person re-identification (ReID) aims to train a feature extractor for identity retrieval without exploiting identity labels. Due to the blind trust in imperfect clustering results, the learning is inevitably misled by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yunqi Miao , Jiankang Deng , Guiguang Ding , Jungong Han

In this paper, we propose a new deep neural network classifier that simultaneously maximizes the inter-class separation and minimizes the intra-class variation by using the polyhedral conic classification function. The proposed method has…

Computer Vision and Pattern Recognition · Computer Science 2021-02-26 Hakan Cevikalp , Bedirhan Uzun , Okan Köpüklü , Gurkan Ozturk

kNN is a very effective Instance based learning method, and it is easy to implement. Due to heterogeneous nature of data, noises from different possible sources are also widespread in nature especially in case of large-scale databases. For…

Machine Learning · Computer Science 2020-05-19 Joydip Dhar , Ashaya Shukla , Mukul Kumar , Prashant Gupta

Several researchers proposed using non-Euclidean metrics on point sets in Euclidean space for clustering noisy data. Almost always, a distance function is desired that recognizes the closeness of the points in the same cluster, even if the…

Computational Geometry · Computer Science 2015-03-02 Michael B. Cohen , Brittany Terese Fasy , Gary L. Miller , Amir Nayyeri , Donald R. Sheehy , Ameya Velingker

Nearest Neighbors Algorithm is a Lazy Learning Algorithm, in which the algorithm tries to approximate the predictions with the help of similar existing vectors in the training dataset. The predictions made by the K-Nearest Neighbors…

Machine Learning · Computer Science 2018-11-14 Chandrasekaran Anirudh Bhardwaj , Megha Mishra , Kalyani Desikan

Fuzzy K-Means clustering is a critical technique in unsupervised data analysis. Unlike traditional hard clustering algorithms such as K-Means, it allows data points to belong to multiple clusters with varying degrees of membership,…

Machine Learning · Computer Science 2024-11-08 Yichen Bao , Han Lu , Quanxue Gao