English
Related papers

Related papers: Minimax-optimal semi-supervised regression on unkn…

200 papers

Manifold learning approaches seek the intrinsic, low-dimensional data structure within a high-dimensional space. Mainstream manifold learning algorithms, such as Isomap, UMAP, $t$-SNE, Diffusion Map, and Laplacian Eigenmaps do not use data…

Machine Learning · Statistics 2023-07-04 Jake S. Rhodes

In this paper, we propose a method to learn a minimizing geodesic within a data manifold. Along the learned geodesic, our method can generate high-quality interpolations between two given data samples. Specifically, we use an autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Cong Geng , Jia Wang , Li Chen , Wenbo Bao , Chu Chu , Zhiyong Gao

We investigate a family of regression problems in a semi-supervised setting. The task is to assign real-valued labels to a set of $n$ sample points, provided a small training subset of $N$ labeled points. A goal of semi-supervised learning…

Statistics Theory · Mathematics 2017-10-17 Dejan Slepčev , Matthew Thorpe

Semi-supervised learning methods using Generative Adversarial Networks (GANs) have shown promising empirical success recently. Most of these methods use a shared discriminator/classifier which discriminates real examples from fake while…

Machine Learning · Computer Science 2018-06-13 Abhishek Kumar , Prasanna Sattigeri , P. Thomas Fletcher

We consider the nonparametric regression estimation problem of recovering an unknown response function f on the basis of spatially inhomogeneous data when the design points follow a known compactly supported density g with a finite number…

Methodology · Statistics 2012-10-29 Anestis Antoniadis , Marianna Pensky , Theofanis Sapatinas

Estimating building footprint maps from geospatial data is of paramount importance in urban planning, development, disaster management, and various other applications. Deep learning methodologies have gained prominence in building…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Anuja Vats , David Völgyes , Martijn Vermeer , Marius Pedersen , Kiran Raja , Daniele S. M. Fantin , Jacob Alexander Hay

A recent paper (Neural Networks, {\bf 132} (2020), 253-268) introduces a straightforward and simple kernel based approximation for manifold learning that does not require the knowledge of anything about the manifold, except for its…

Machine Learning · Computer Science 2022-04-22 Eric Mason , Hrushikesh Mhaskar , Adam Guo

Consider a regression problem where there is no labeled data and the only observations are the predictions $f_i(x_j)$ of $m$ experts $f_{i}$ over many samples $x_j$. With no knowledge on the accuracy of the experts, is it still possible to…

Machine Learning · Statistics 2017-03-09 Omer Dror , Boaz Nadler , Erhan Bilal , Yuval Kluger

Optimization over the Stiefel manifold is a fundamental computational problem in many scientific and engineering applications. Despite considerable research effort, high-dimensional optimization problems over the Stiefel manifold remain…

Optimization and Control · Mathematics 2025-05-16 Andy Yat-Ming Cheung , Jinxin Wang , Man-Chung Yue , Anthony Man-Cho So

We introduce a semi-supervised learning estimator which tends to the first kernel principal component as the number of labelled points vanishes. Our approach is based on the notion of optimal target vector, which is defined as follows.…

Disordered Systems and Neural Networks · Physics 2007-05-23 Leonardo Angelini , Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

Feature descriptors play a crucial role in a wide range of geometry analysis and processing applications, including shape correspondence, retrieval, and segmentation. In this paper, we introduce Geodesic Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Jonathan Masci , Davide Boscaini , Michael M. Bronstein , Pierre Vandergheynst

Manifolds discovered by machine learning models provide a compact representation of the underlying data. Geodesics on these manifolds define locally length-minimising curves and provide a notion of distance, which are key for reduced-order…

Machine Learning · Computer Science 2023-05-25 Daniel Kelshaw , Luca Magri

This paper considers statistical inference for the explained variance $\beta^{\intercal}\Sigma \beta$ under the high-dimensional linear model $Y=X\beta+\epsilon$ in the semi-supervised setting, where $\beta$ is the regression vector and…

Methodology · Statistics 2020-12-01 T. Tony Cai , Zijian Guo

Euclidean gradient descent algorithms barely capture the geometry of objective function-induced hypersurfaces and risk driving update trajectories off the hypersurfaces. Riemannian gradient descent algorithms address these issues but fail…

Machine Learning · Computer Science 2026-03-10 Liwei Hu , Guangyao Li , Wenyong Wang , Xiaoming Zhang , Yu Xiang

Medical image segmentation is a fundamental and critical step in many clinical approaches. Semi-supervised learning has been widely applied to medical image segmentation tasks since it alleviates the heavy burden of acquiring…

Image and Video Processing · Electrical Eng. & Systems 2022-08-29 Yichi Zhang , Rushi Jiao , Qingcheng Liao , Dongyang Li , Jicong Zhang

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

In this paper, we present a new algorithm for semi-supervised representation learning. In this algorithm, we first find a vector representation for the labels of the data points based on their local positions in the space. Then, we map the…

Machine Learning · Computer Science 2020-08-05 Ershad Banijamali , Ali Ghodsi

This paper establishes a nearly optimal algorithm for estimating the frequencies and amplitudes of a mixture of sinusoids from noisy equispaced samples. We derive our algorithm by viewing line spectral estimation as a sparse recovery…

Information Theory · Computer Science 2013-04-02 Gongguo Tang , Badri Narayan Bhaskar , Benjamin Recht

Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. A prominent way to exploit unlabeled data is to regularize model predictions. Since the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Sukesh Adiga , Jose Dolz , Herve Lombaert

The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Zihang Liu , Chunhui Zhao