English
Related papers

Related papers: Intrinsic Dimension Estimation via Nearest Constra…

200 papers

High dimensional data can have a surprising property: pairs of data points may be easily separated from each other, or even from arbitrary subsets, with high probability using just simple linear classifiers. However, this is more of a rule…

Machine Learning · Computer Science 2023-11-15 Oliver J. Sutton , Qinghua Zhou , Alexander N. Gorban , Ivan Y. Tyukin

We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them to the same class as their unperturbed counterpart. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yuchen Li , Safwan Hossain , Kiarash Jamali , Frank Rudzicz

Nowadays, deep learning methods, especially the convolutional neural networks (CNNs), have shown impressive performance on extracting abstract and high-level features from the hyperspectral image. However, general training process of CNNs…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Zhiqiang Gong , Ping Zhong , Weidong Hu

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan , Anatoly Juditsky , Vladimir Spokoiny

We propose regression networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each class. In high dimensional embedding…

Machine Learning · Computer Science 2020-06-22 Arnout Devos , Matthias Grossglauser

In this paper we propose an approach for learning low dimensional optimized feature space with minimum intra-class variance and maximum inter-class variance. We address the problem of high-dimensionality of feature vectors extracted from…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Abin Jose , Erik Stefan Ottlik , Christian Rohlfing , Jens-Rainer Ohm

Finding rare information hidden in a huge amount of data from the Internet is a necessary but complex issue. Many researchers have studied this issue and have found effective methods to detect anomaly data in low dimensional space. However,…

Artificial Intelligence · Computer Science 2014-05-07 Zhana Bao

Score-based diffusion models have demonstrated remarkable empirical success in learning high-dimensional distributions, particularly those exhibiting low-dimensional and multi-modal structures. However, theoretical understanding of their…

Machine Learning · Statistics 2026-05-29 Jingda Wu , Changxiao Cai

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang

Bayesian inference was once a gold standard for learning with neural networks, providing accurate full predictive distributions and well calibrated uncertainty. However, scaling Bayesian inference techniques to deep neural networks is…

Machine Learning · Computer Science 2019-07-18 Pavel Izmailov , Wesley J. Maddox , Polina Kirichenko , Timur Garipov , Dmitry Vetrov , Andrew Gordon Wilson

Deep learning with Convolutional Neural Networks has shown great promise in various areas of image-based classification and enhancement but is often unsuitable for predictive modeling involving non-image based features or features without…

Machine Learning · Computer Science 2020-09-02 Omid Bazgir , Ruibo Zhang , Saugato Rahman Dhruba , Raziur Rahman , Souparno Ghosh , Ranadip Pal

Many computer vision systems require users to upload image features to the cloud for processing and storage. These features can be exploited to recover sensitive information about the scene or subjects, e.g., by reconstructing the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Mihai Dusmanu , Johannes L. Schönberger , Sudipta N. Sinha , Marc Pollefeys

Supervised classification methods often assume the train and test data distributions are the same and that all classes in the test set are present in the training set. However, deployed classifiers often require the ability to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ryne Roady , Tyler L. Hayes , Ronald Kemker , Ayesha Gonzales , Christopher Kanan

Few-shot learning in image classification aims to learn a classifier to classify images when only few training examples are available for each class. Recent work has achieved promising classification performance, where an image-level…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Wenbin Li , Lei Wang , Jinglin Xu , Jing Huo , Yang Gao , Jiebo Luo

The merit of projecting data onto linear subspaces is well known from, e.g., dimension reduction. One key aspect of subspace projections, the maximum preservation of variance (principal component analysis), has been thoroughly researched…

Machine Learning · Computer Science 2022-09-27 Erik Thordsen , Erich Schubert

In this paper, we present contemporary techniques for visualising the feature space of a deep learning image classification neural network. These techniques are viewed in the context of a feed-forward network trained to classify low…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Ezra Webb , Cheng Lei , Chun-Jung Huang , Hirofumi Kobayashi , Hideharu Mikami , Keisuke Goda

The discovering of low-dimensional manifolds in high-dimensional data is one of the main goals in manifold learning. We propose a new approach to identify the effective dimension (intrinsic dimension) of low-dimensional manifolds. The scale…

Statistics Theory · Mathematics 2008-03-17 Xiaohui Wang , J. S. Marron

We propose a novel algorithm for the task of supervised discriminative distance learning by nonlinearly embedding vectors into a low dimensional Euclidean space. We work in the challenging setting where supervision is with constraints on…

Computer Vision and Pattern Recognition · Computer Science 2015-09-30 Gaurav Sharma , Bernt Schiele

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Evgeny Osipov , Denis Kleyko

Collaborative intelligence is a new paradigm for efficient deployment of deep neural networks across the mobile-cloud infrastructure. By dividing the network between the mobile and the cloud, it is possible to distribute the computational…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Hyomin Choi , Ivan V. Bajic