English
Related papers

Related papers: A Unified Semi-Supervised Dimensionality Reduction…

200 papers

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel

Unsupervised clustering is one of the most fundamental challenges in machine learning. A popular hypothesis is that data are generated from a union of low-dimensional nonlinear manifolds; thus an approach to clustering is identifying and…

Machine Learning · Computer Science 2017-12-27 Dejiao Zhang , Yifan Sun , Brian Eriksson , Laura Balzano

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Training neural networks using limited annotations is an important problem in the medical domain. Deep Neural Networks (DNNs) typically require large, annotated datasets to achieve acceptable performance which, in the medical domain, are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Bethany H. Thompson , Gaetano Di Caterina , Jeremy P. Voisey

A common assumption in semi-supervised learning is that the labeled, unlabeled, and test data are drawn from the same distribution. However, this assumption is not satisfied in many applications. In many scenarios, the data is collected…

Information Theory · Computer Science 2022-02-25 Gholamali Aminian , Mahed Abroshan , Mohammad Mahdi Khalili , Laura Toni , Miguel R. D. Rodrigues

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Dynamical Systems · Mathematics 2020-02-04 Andreas Bittracher , Stefan Klus , Boumediene Hamzi , Péter Koltai , Christof Schütte

Semantic segmentation has been widely investigated in the community, in which the state of the art techniques are based on supervised models. Those models have reported unprecedented performance at the cost of requiring a large set of high…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Rihuan Ke , Angelica Aviles-Rivero , Saurabh Pandey , Saikumar Reddy , Carola-Bibiane Schönlieb

Building a large image dataset with high-quality object masks for semantic segmentation is costly and time consuming. In this paper, we introduce a principled semi-supervised framework that only uses a small set of fully supervised images…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Mostafa S. Ibrahim , Arash Vahdat , Mani Ranjbar , William G. Macready

This paper considers a multiple-input-multiple-output (MIMO) system with low-resolution analog-to-digital converters (ADCs). In this system, we propose a novel communication framework that is inspired by supervised learning. The key idea of…

Information Theory · Computer Science 2020-08-07 Yo-Seb Jeon , Song-Nam Hong , Namyoon Lee

In semi-supervised learning for classification, it is assumed that every ground truth class of data is present in the small labelled dataset. Many real-world sparsely-labelled datasets are plausibly not of this type. It could easily be the…

Machine Learning · Statistics 2021-01-11 Matthew Willetts , Stephen J Roberts , Christopher C Holmes

In statistical dimensionality reduction, it is common to rely on the assumption that high dimensional data tend to concentrate near a lower dimensional manifold. There is a rich literature on approximating the unknown manifold, and on…

Machine Learning · Statistics 2022-02-22 Didong Li , Minerva Mukhopadhyay , David B. Dunson

In this work we propose a method for reducing the dimensionality of tensor objects in a binary classification framework. The proposed Common Mode Patterns method takes into consideration the labels' information, and ensures that tensor…

Machine Learning · Computer Science 2019-02-07 Konstantinos Makantasis , Anastasios Doulamis , Nikolaos Doulamis , Athanasios Voulodimos

Unsupervised and supervised learning methods conventionally use kernels to capture nonlinearities inherent in data structure. However experts have to ensure their proposed nonlinearity maximizes variability and capture inherent diversity of…

Machine Learning · Computer Science 2025-07-30 Mojtaba Moattari

While significant attention has been recently focused on designing supervised deep semantic segmentation algorithms for vision tasks, there are many domains in which sufficient supervised pixel-level labels are difficult to obtain. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Xide Xia , Brian Kulis

In statistical learning, high covariate dimensionality poses challenges for robust prediction and inference. To address this challenge, supervised dimension reduction is often performed, where dependence on the outcome is maximized for a…

Methodology · Statistics 2018-08-24 Patrick Staples , Min Ouyang , Robert F. Dougherty , Gregory A. Ryslik , Paul Dagum

We study the training of Vision Transformers for semi-supervised image classification. Transformers have recently demonstrated impressive performance on a multitude of supervised learning tasks. Surprisingly, we show Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zejia Weng , Xitong Yang , Ang Li , Zuxuan Wu , Yu-Gang Jiang

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional $\mathcal{O}(10^{\ge 2})$ stochastic inputs (e.g., forcing terms, boundary conditions,…

Machine Learning · Computer Science 2022-05-27 Katiana Kontolati , Dimitrios Loukrezis , Dimitris G. Giovanis , Lohit Vandanapu , Michael D. Shields

We present a new operator theoretic framework for analysis of complex systems with intrinsic subdivisions into components, taking the form of "residuals" in general, and "telescoping energy residuals" in particular. We prove new results…

Functional Analysis · Mathematics 2026-01-27 Palle E. T. Jorgensen , Myung-Sin Song , James F. Tian

In the rapidly evolving realm of machine learning, algorithm effectiveness often faces limitations due to data quality and availability. Traditional approaches grapple with data sharing due to legal and privacy concerns. The federated…

Machine Learning · Computer Science 2023-11-16 Sin Cheng Ciou , Pin Jui Chen , Elvin Y. Tseng , Yuh-Jye Lee