English
Related papers

Related papers: Semi-supervised deep learning for high-dimensional…

200 papers

Deep semi-supervised learning is a fast-growing field with a range of practical applications. This paper provides a comprehensive survey on both fundamentals and recent advances in deep semi-supervised learning methods from perspectives of…

Machine Learning · Computer Science 2023-10-31 Xiangli Yang , Zixing Song , Irwin King , Zenglin Xu

The goal of supervised representation learning is to construct effective data representations for prediction. Among all the characteristics of an ideal nonparametric representation of high-dimensional complex data, sufficiency, low…

Machine Learning · Computer Science 2022-09-02 Jian Huang , Yuling Jiao , Xu Liao , Jin Liu , Zhou Yu

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

A semi-supervised learning framework using the feedforward-designed convolutional neural networks (FF-CNNs) is proposed for image classification in this work. One unique property of FF-CNNs is that no backpropagation is used in model…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Yueru Chen , Yijing Yang , Min Zhang , C. -C. Jay Kuo

We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art…

Machine Learning · Statistics 2017-11-15 Randall Balestriero , Vincent Roger , Herve G. Glotin , Richard G. Baraniuk

Deep Neural Networks (DNNs) have been successfully applied to a wide range of problems. However, two main limitations are commonly pointed out. The first one is that they require long time to design. The other is that they heavily rely on…

Neural and Evolutionary Computing · Computer Science 2024-06-21 Adriano Vinhas , João Correia , Penousal Machado

Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manual labelling in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Wanli Ma , Oktay Karakus , Paul L. Rosin

Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN)…

Machine Learning · Computer Science 2019-05-28 Chengjian Sun , Chenyang Yang

In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-13 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

We propose to address the issue of sample efficiency, in Deep Convolutional Neural Networks (DCNN), with a semi-supervised training strategy that combines Hebbian learning with gradient descent: all internal layers (both convolutional and…

Neural and Evolutionary Computing · Computer Science 2021-09-21 Gabriele Lagani , Fabrizio Falchi , Claudio Gennaro , Giuseppe Amato

Learning data representations under uncertainty is an important task that emerges in numerous scientific computing and data analysis applications. However, uncertainty quantification techniques are computationally intensive and become…

Machine Learning · Computer Science 2025-08-06 Paz Fink Shustin , Shashanka Ubaru , Małgorzata J. Zimoń , Songtao Lu , Vasileios Kalantzis , Lior Horesh , Haim Avron

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

Deep Reinforcement Learning has shown its ability in solving complicated problems directly from high-dimensional observations. However, in end-to-end settings, Reinforcement Learning algorithms are not sample-efficient and requires long…

Machine Learning · Computer Science 2021-07-06 Nicolò Botteghi , Mannes Poel , Beril Sirmacek , Christoph Brune

Deep Neural Networks (DNN) are increasingly used as components of larger software systems that need to process complex data, such as images, written texts, audio/video signals. DNN predictions cannot be assumed to be always correct for…

Software Engineering · Computer Science 2022-12-15 Michael Weiss , Paolo Tonella

A combinatory approach of two well-known fields: deep learning and semi supervised learning is presented, to tackle the land cover identification problem. The proposed methodology demonstrates the impact on the performance of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Eftychios Protopapadakis , Anastasios Doulamis , Nikolaos Doulamis , Evangelos Maltezos

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

Deep neural networks (DNN) with a huge number of adjustable parameters remain largely black boxes. To shed light on the hidden layers of DNN, we study supervised learning by a DNN of width $N$ and depth $L$ consisting of $NL$ perceptrons…

Disordered Systems and Neural Networks · Physics 2023-08-01 Hajime Yoshino