English
Related papers

Related papers: Supervised Manifold Learning for Functional Data

200 papers

Classifiers label data as belonging to one of a set of groups based on input features. It is challenging to obtain accurate classification performance when the feature distributions in the different classes are complex, with nonlinear,…

Machine Learning · Statistics 2021-10-06 Didong Li , David B Dunson

Recent advances in self-supervised learning have highlighted the efficacy of data augmentation in learning data representation from unlabeled data. Training a linear model atop these enhanced representations can yield an adept classifier.…

Machine Learning · Statistics 2024-05-07 Shulei Wang

A neural population responding to multiple appearances of a single object defines a manifold in the neural response space. The ability to classify such manifolds is of interest, as object recognition and other computational tasks require a…

Disordered Systems and Neural Networks · Physics 2022-08-30 Uri Cohen , Haim Sompolinsky

With the development of deep learning techniques, supervised learning has achieved performances surpassing those of humans. Researchers have designed numerous corresponding models for different data modalities, achieving excellent results…

Artificial Intelligence · Computer Science 2023-08-29 Qiang Li , Qiuyang Ma , Weizhi Nie , Anan Liu

Deep neural networks usually benefit from unsupervised pre-training, e.g. auto-encoders. However, the classifier further needs supervised fine-tuning methods for good discrimination. Besides, due to the limits of full-connection, the…

Computer Vision and Pattern Recognition · Computer Science 2016-05-10 Hailin Shi , Xiangyu Zhu , Zhen Lei , Shengcai Liao , Stan Z. Li

A fundamental challenge in semi-supervised learning lies in the observed data's disproportional size when compared with the size of the data collected with missing outcomes. An implicit understanding is that the dataset with missing…

Methodology · Statistics 2026-05-12 Yuqian Zhang , Jelena Bradic

Many scientific areas are faced with the challenge of extracting information from large, complex, and highly structured data sets. A great deal of modern statistical work focuses on developing tools for handling such data. This paper…

Methodology · Statistics 2017-10-05 Hyun Bin Kang , Matthew Reimherr , Mark Shriver , Peter Claes

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

Machine Learning · Computer Science 2020-04-28 Ozan Sener , Vladlen Koltun

In this paper, we present a new method for few-sample supervised feature selection (FS). Our method first learns the manifold of the feature space of each class using kernels capturing multi-feature associations. Then, based on Riemannian…

Machine Learning · Statistics 2022-07-19 David Cohen , Tal Shnitzer , Yuval Kluger , Ronen Talmon

The discovering of low-dimensional manifolds in high-dimensional data is one of the main goals in manifold learning. We propose a new approach to identify the effective dimension (intrinsic dimension) of low-dimensional manifolds. The scale…

Statistics Theory · Mathematics 2008-03-17 Xiaohui Wang , J. S. Marron

High-quality labeled datasets are essential for deep learning. Traditional manual annotation methods are not only costly and inefficient but also pose challenges in specialized domains where expert knowledge is needed. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Zhaocong liu , Fa Zhang , Lin Cheng , Huanxi Deng , Xiaoyan Yang , Zhenyu Zhang , Chichun Zhou

Function approximation based on data drawn randomly from an unknown distribution is an important problem in machine learning. The manifold hypothesis assumes that the data is sampled from an unknown submanifold of a high dimensional…

Machine Learning · Computer Science 2024-08-20 H. N. Mhaskar , Ryan O'Dowd

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

In machine learning, classification is usually seen as a function approximation problem, where the goal is to learn a function that maps input features to class labels. In this paper, we propose a novel clustering and classification…

Machine Learning · Computer Science 2025-02-25 Hrushikesh Mhaskar , Ryan O'Dowd , Efstratios Tsoukanis

Unsupervised learning of feature representations is a challenging yet important problem for analyzing a large collection of multimedia data that do not have semantic labels. Recently proposed neural network-based unsupervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Takahiko Furuya , Ryutarou Ohbuchi

We consider the regression problem of estimating functions on $\mathbb{R}^D$ but supported on a $d$-dimensional manifold $ \mathcal{M} \subset \mathbb{R}^D $ with $ d \ll D $. Drawing ideas from multi-resolution analysis and nonlinear…

Machine Learning · Statistics 2021-01-14 Wenjing Liao , Mauro Maggioni , Stefano Vigogna

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Most existing person re-identification algorithms either extract robust visual features or learn discriminative metrics for person images. However, the underlying manifold which those images reside on is rarely investigated. That raises a…

Computer Vision and Pattern Recognition · Computer Science 2017-03-27 Song Bai , Xiang Bai , Qi Tian

Deep learning usually requires large amounts of labeled training data, but annotating data is costly and tedious. The framework of semi-supervised learning provides the means to use both labeled data and arbitrary amounts of unlabeled data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Christoph Baur , Shadi Albarqouni , Nassir Navab

This work investigates the unexplored usability of self-supervised representation learning in the direction of functional knowledge transfer. In this work, functional knowledge transfer is achieved by joint optimization of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Prakash Chandra Chhipa , Muskaan Chopra , Gopal Mengi , Varun Gupta , Richa Upadhyay , Meenakshi Subhash Chippa , Kanjar De , Rajkumar Saini , Seiichi Uchida , Marcus Liwicki